aman kumar

Data Engineer

Gurugram, Haryana, India7 yrs experience

Most Likely To SwitchHighly Stable

Key Highlights

Over 6 years of experience in AWS Data Engineering.
Proven track record in designing scalable data pipelines.
Strong collaborator with excellent problem-solving skills.

Stackforce AI infers this person is a Data Engineering professional specializing in cloud migration and ETL processes.

Contact

Skills

Core Skills

Aws Data EngineeringEtlData Analysis

Other Skills

AWS GlueAWS LambdaAWS S3AWS Step FunctionsAmazon CloudWatchAmazon S3Amazon Web Services (AWS)Analytical SkillsApache SparkAthenaAzure DatabricksAzure SQLBig DataBig Data AnalyticsBusiness Objects Data Integrator

About

Results-oriented Data Engineer with over 6 years of experience in AWS Data Engineering, ETL, and Data Analysis. Proficient in SQL, Python, PySpark, Databricks, and cloud platforms like AWS and Azure. Proven track record in designing and maintaining scalable data pipelines, cloud migration, and automation. Strong collaborator with solid problem-solving skills and a knack for improving system performance and data accuracy.

Experience

Deloitte

2 roles

Data Engineer

Jan 2022 – Present · 4 yrs 2 mos · Gurugram, Haryana, India

Migrated 4+ data sources from on-premises to AWS cloud, ensuring business continuity.
Built scalable pipelines using AWS S3, Glue, and Lambda, improving data availability.
Automated monitoring using CloudWatch and Lambda, reducing manual tasks by 30%.
Deployed AWS infrastructure using Terraform integrated with Jenkins for CI/CD.
Developed post-ingestion validation scripts in Python, cutting validation effort by 40%.
Handled data flattening, transformation, and lineage using Databricks and Athena.
Validated end-to-end data flow from source to target across various layers.
Implemented incremental load strategies in Databricks for efficient data ingestion.
Designed and deployed Autoloader in Databricks to support near-real-time data processing.
Tuned performance of Databricks jobs and notebooks for high-volume data processing.

AWS S3AWS GlueAWS LambdaCloudWatchTerraformPython+4

Consultant

Apr 2019 – Present · 6 yrs 11 mos · Gurugram, Haryana, India

Deloitte usi

ETL Developer

Mar 2019 – Jan 2022 · 2 yrs 10 mos · Gurugram, Haryana, India · Hybrid

Currently working on BOM & Trade ETL pods for different segments
End-to-End experience in working more than 3 development cycle (POD)
Worked in the data augmentation team as ETL and automation developer for data migration to Veritas system and BOM (Bill of Material) Analysis report generation of the Food and Petcare Nutrition deployment for Asia and North America Region for Mars Inc
Involved in gathering business requirements, functional requirements, and data specifications
Involved in Creation of jobs that specify data mappings and transformations by using Data Services Designer
Used designer to load data from different sources (SQL, Text files) to the target database
Improved the performance and reduced the coding with the use of @functions and variables
Worked with various transforms such as SQL, Table comparison, Row Generation, Query, Map Operation, Merge, Look Ups, Pivot, Case etc.

ETLData Services DesignerSQLData MappingData Transformation