H

Himanshu Kumar

Data Engineer

Bengaluru, Karnataka, India7 yrs 2 mos experience

Key Highlights

  • Over 6 years of data engineering experience.
  • Expert in building scalable ETL pipelines.
  • Led a major cloud data migration project.
Stackforce AI infers this person is a Data Engineer specializing in cloud data solutions and big data processing.

Contact

Skills

Core Skills

Data EngineeringEtl PipelinesData MigrationData Validation

Other Skills

Azure Blob StorageAWS GlueLambdaStep FunctionsRedshiftS3DatabricksPySparkPythonSQLShell scriptingKafkaHiveHBaseAirflow

About

Results-driven Data Engineer with 6+ years of experience in building and maintaining large-scale ETL pipelines, cloud data migrations, and big data processing. Hands-on expertise with Azure Blob Storage, AWS Glue, Lambda, Step Functions, Redshift, S3, and Databricks. Led a 74+ PB data migration project for a Microsoft client, moving billions of files from Huawei Cloud to Azure using AzCopy. Developed automated file-level validation using PySpark on Databricks, ensuring data and metadata consistency at scale. Proficient in PySpark, Python, SQL, and Shell scripting for data transformation, automation, and performance tuning. Experienced in working with Kafka, Hive, HBase, and orchestration tools like Airflow and IICS. Built serverless ETL frameworks and high-throughput pipelines processing 10TB+ of data daily. Strong foundation in data warehousing, data quality, and distributed computing. Adept at delivering reliable, scalable, and cost-effective data solutions aligned with business needs.

Experience

7 yrs 2 mos
Total Experience
--
Average Tenure
--
Current Experience

Cognizant

Associate

Aug 2022Present · 3 yrs 10 mos · Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates · On-site

Azure Blob StorageAWS GlueLambdaStep FunctionsRedshiftS3+12

Lumen technologies

Software Engineer

Apr 2019Aug 2022 · 3 yrs 4 mos · Bengaluru, Karnataka, India

Education

J N N College of Engineering, SHIMOGA

Bachelor of Engineering - BE — Computer Science

Aug 2013Jul 2017

Stackforce found 100+ more professionals with Data Engineering & Etl Pipelines

Explore similar profiles based on matching skills and experience