Jul 2023 – Present · 2 yrs 8 mos · Bengaluru, Karnataka, India

• Developed an end-to-end library for one of Amazon's largest data lake ingestion systems powered by Apache Flink also developed a Scala-based library to identify and count inconsistent rows that did not align with the destination table schema in one of Amazon's largest ETL pipeline management systems powered by Apache Spark.
• In addition developed a batch processing system for Amazon's largest data lake to compute comprehensive data profile metrics with daily metrics refreshing

May 2022 – Jul 2022 · 2 mos · Hyderabad, Telangana, India · On-site

• Designed and developed an end-to-end solution to transform Amazon's "Buy with Prime" return order details for
• the Machine Learning team.
• Designed an optimized schema to enhance the analysis of returns data.
• Built a pipeline for listening to return order events, transforming the data, and publishing it efficiently.
• Achieved a 60% reduction in manual data transfer efforts with robust unit test coverage to ensure reliability.
• Tech Stack: AWS SNS, SQS, Lambda, Java, EventBridge