Sep 2023 – Present · 2 yrs 9 mos · Bengaluru, Karnataka, India · Hybrid

• 1. Developed a data ingestion pipeline using AWS Glue, S3, and Redshift, enabling secure and efficient data transfer from multiple business sources.
• 2. Created a robust data orchestration solution using AWS Step Functions and EventBridge, streamlining scheduling and dependency checks for 30+ automated workflows.
• 3. Designed and deployed data models and transformation logic using Amazon Redshift and Glue, improving data quality by reducing errors by 30% and enabling faster insights.
• 4. Utilized Amazon Athena for ad-hoc querying of S3 data, facilitating quick data exploration and validation without additional infrastructure costs.
• 5. Designed and implemented S3 bucket lifecycle policies to manage data retention and cost optimization, including archival strategies with Amazon S3 Glacier.
• 6. Set up automated alerts and notifications for data pipeline failures and anomalies using Amazon SNS and CloudWatch Alarms.

Jan 2023 – Jun 2023 · 5 mos · Bengaluru, Karnataka, India · On-site