Aditya Singh

Data Engineer

Bengaluru, Karnataka, India4 yrs 9 mos experience

Key Highlights

  • Expert in building cloud-native data solutions.
  • Proficient in both AWS and GCP data engineering.
  • Strong background in ETL and data warehousing.
Stackforce AI infers this person is a Data Engineer specializing in cloud data solutions across multiple platforms.

Contact

Skills

Core Skills

Data EngineeringCloud Data WarehousingMachine LearningEtl Development

Other Skills

AWSAWS DMSAWS GlueAWS LambdaAgileAirflowAmazon BedrockAmazon ComprehendAmazon Elastic MapReduce (EMR)Amazon KendraAmazon TranslateAmazon Web Services (AWS)Azure Data FactoryAzure DatabricksBigQuery

About

Data Engineer with a demonstrated history of working in the information technology and services industry. I have worked on projects involving the implementation of Data lake and Data warehouse. Skilled in ETL, IICS S3, Redshift, AWS, GCP, and Data Warehousing Concepts.

Experience

4 yrs 9 mos
Total Experience
1 yr 2 mos
Average Tenure
1 yr 4 mos
Current Experience

Amazon

Data Engineer II

Jan 2025Present · 1 yr 4 mos · Bengaluru, Karnataka, India

Tide

Data Engineer-2

Oct 2023Jan 2025 · 1 yr 3 mos · Delhi, India · Remote

Fynd (shopsense retail technologies ltd.)

Data Engineer

Nov 2022Oct 2023 · 11 mos · Mumbai, Maharashtra, India · On-site

  • Working with Jiomart Product and Analytics Team along Fynd Product Team.
  • Working on multiple cross (AWS, GCP) cloud data warehousing/ data lake projects end to end.
  • Working on creating multiple architecture for Data Pipelines in GCP which are cost & performance optimised.
  • Working on architectures related to migration of NoSQL data sources like MongoDB and relational databases
  • like MySQL and PostgreSQL to corresponding data lake as well as data warehouse.
  • Have working experience on services like GCP Dataproc ( including batches and workflow templates) ,
  • BigQuery (including query and cost optimisation , big lake , scheduled queries , external table etc ), Cloud
  • Functions (Gen1, Gen2), Datastream , GCS etc.
  • Automated pipeline creation , added error reporting , error handling etc.
  • Advance Commerce Lab: Researched on e-commerce data on various subjects like inventory, return &
  • cancellation, customer profiling, demand forecasting and shipment consolidation then came up with the
  • products using AI/ML to solve them.
AWSGCPData WarehousingData LakeData PipelinesMongoDB+9

Quantiphi

Data Engineer

Aug 2021Nov 2022 · 1 yr 3 mos · Mumbai, Maharashtra, India · Remote

  • Successfully built a serverless cloud native product using Python as wrapper to ingest data and
  • perform ETL to re-construct a data warehouse
  • Ingested data using AWS DMS and Kafka, implemented basic cleaning using Lambda.
  • Integrated ECS Containers using Step Function to orchestrate ETL Pipeline.
  • Wrote optimized SQL for formation of dimensions and facts.
  • Usage of DynamoDB for storing batch details and provide to frontend API calls.
  • Designed a Data Architecture on AWS cloud platform for Insurance Domain.
  • Ingested Data using DMS from a DynamoDB.
  • Performed cleaning of data using Python, Pyspark scripting.
  • Assembled a staging layer using Redshift spectrum.
  • Determined testing needed to assure the functionality and integrity of the ETL solutions.
  • Designing and implementing Dimensional and Fact tables using Data warehouse concepts like SCD1,
  • SCD2.
  • Well versed with Agile methodology of Project SDLC.
  • Developed several Informatica Mappings, Mapplets and transformations to load data from flat files into
  • data warehouse or directly DB to DB.
  • Developed various CFT involving IAM,EC2,S3,VPC,DMS.
  • Involved in documentations such as run guide, deployment document, post deployment checklist,
  • technical specification documents.
PythonAWS DMSKafkaLambdaSQLDynamoDB+5

Education

Army Institute of Technology, Pune

Bachelor of Engineering - BE

Jan 2017Jan 2021

Army Public School (APS)

Higher Secondary

Jan 2015Jan 2016

Stackforce found 100+ more professionals with Data Engineering & Cloud Data Warehousing

Explore similar profiles based on matching skills and experience