Jun 2021 – Feb 2026 · 4 yrs 8 mos · Hyderabad · Remote

• •Developed and optimized PySpark-based ETL pipelines for batch data processing and enrichment on AWS. •Worked on AWS Glue for data transformation, cataloging, and job orchestration. •Involved in data ingestion from various sources, cleansing, and processing using Spark SQL and Python. •Validated data across Athena and Hadoop environments to ensure accuracy and consistency. •Managed job scheduling, monitoring, and automation through Control-M. •Used GitHub for version control and Jira for defect tracking, sprint planning, and production issue management. •Analyzed and debugged production job failures using PuTTY and log analysis on Hadoop clusters. •Coordinated with cross-functional teams for deployment support, data validation, and issue resolution. •Prepared and updated Ops documentation, CRQ requests, and change logs as part of release management.