Aug 2024 – Feb 2026 · 1 yr 6 mos · Gurugram, Haryana, India

• Lead and mentor Junior data engineers, driving engineering best practices and improving delivery predictability and code quality.
• Collaborate closely with product, analytics, and business stakeholders to translate requirements into scalable data architectures supporting multiple downstream applications and dashboards.
• Built an Innovative Data Quality Index platform using Python FastAPI microservices, containerized and deployed on EKS as fan-out cron workloads.
• Led development of a Springboot microservice to receive data from Sprinklr webhooks and stream to Kafka for downstream analytics.
• Architect and own end-to-end batch data pipelines, processing TB-scale datasets on a daily basis.
• Design and implement high-performance ETL/ELT pipelines using Python, Spark, and SQL to optimize data processing latency and reliability.
• Serve as the primary point of contact for production stability, driving root-cause analysis and long-term reliability improvements.
• Designed scalable AI data pipelines for ingestion, embeddings, and retrieval—enabling secure, low-latency LLM experiences.

Aug 2022 – Aug 2024 · 2 yrs · Gurugram, Haryana, India

• Worked on Deutsche Telekom’s market facing products like OneApp, Shop, TV etc. to create robust real-time data pipelines that help maintain the flow of data in the entire product ecosystem using real-time data ingestion tools like Kafka, Apache NiFi, RabbitMQ and performed transformations and optimizations using PySpark / Structured Streaming.
• Steered the design and development of DWH solution for OneApp's Strategic dashboard for business Analytics with AWS redshift as a warehouse and Tableau as a BI tool. Using Pyspark and complex SQL for data transformation and load into DWH systems.
• Implement and manage Airflow workflows with retries, SLAs, and alerting to reduce manual interventions and improve operational efficiency.
• Simplifying ETL processes for real time flow of Data into various systems like Open Search, CDL (S3), Kibana using Apache Nifi as an ETL tool.
• Influence cross-functional stakeholders by clearly communicating technical trade-offs and roadmap decisions aligned with business priorities.
• Current Tech-Stack: Apache Nifi, pySpark, Python, AWS Glue, Lambda, EMR, Athena, Redshift, S3, Apache Airflow & Data Analytics using Tableau.

Jun 2021 – Aug 2022 · 1 yr 2 mos · Noida, Uttar Pradesh, India · Hybrid

• Functioned as a Data Engineer worked closely on the migration and development of risk analytic applications to latest Big Data technologies like Spark and Scala.
• Successfully delivered a number of highly scalable and optimized solutions for Morgan Stanley's Trade surveillance projects in the area of market risk and trading risk analytics.

Jul 2018 – May 2021 · 2 yrs 10 mos · Lucknow, Uttar Pradesh, India

• Worked as an Engineer in Big Data technologies under the Banking, Financial Services and Institutions (BFSI) domain for a leading Australian Bank CBA in the area of CRA (Customer Risk Analytics).
• Worked on the development and optimisation of multiple customer-risk-assessment batch processing jobs using raw data from CDL using the latest big data technologies like Apache Spark, Hive Hadoop etc.
• Worked on leading ETL tools like Informatica to deliver data pipelines to maintain the flow of data into disparate systems.

Jan 2018 – Mar 2018 · 2 mos · Lucknow, Uttar Pradesh, India · On-site

• Worked as an software development Intern as a ASP.NET developer.
• Extensive coding in C# as a backend language and HTML/CSS/JavaScript for front-end application design and validation for developing a web based application providing learning capabilities to students on-the-go.