May 2023 – Mar 2025 · 1 yr 10 mos · Gurugram, Haryana, India · On-site

• 1. Developed a scalable FAST API backend for a B2B SaaS web application, with RBAC to concurrently execute dynamic SQL queries using the Cube.js. Written multiple APIs, Dockerfile, manifest files, and finally launching it as a microservice in AWS managed kubernetes cluster.
• 2. Established an ETL platform (as an internal tool) from the ground up with Dagster(scheduler), integrating custom connectors for AWS S3, AWS Redshift, PostgreSQL, Google Sheets, Slack, SMTP, and many more with robust secrets management. This processed about 10GB data everyday.
• 3. Implemented CI/CD pipelines using GitHub Actions and Helm charts for internal open-source tools, like Dagster, JupyterHub, Commuter, Cubejs, Redis etc.
• 4. Contributed in data modelling using DBT, and ensuring data quality using DBT utils and great expectations.

Jan 2023 – Jun 2023 · 5 mos · Gurugram, Haryana, India

Sep 2021 – Jan 2023 · 1 yr 4 mos · Gurugram, Haryana, India

• Built an event driven, scalable, low-latency service using JAVA Spring Boot Framework, AWS DynamoDB & Postgres as backend data stores.
• Worked on multiple pipelines for sending app-events to multiple sources like CleverTap, Google Ad-Words, Branch, Facebook Ads etc

Aug 2020 – Sep 2021 · 1 yr 1 mo

• Building scalable and optimised data-platforms using Apache Hudi to help create a functional LakeHouse on AWS
• Automated reconciliations across each layer of ETL
• Transforming the EDL/EDW to best serving insight gathering and data analytics model

Feb 2020 – Jul 2020 · 5 mos

• Built ETL pipelines to ingest and transform data from on-premise sources to AWS (as a cloud platform)
• Worked with professionals to augment domain specific data-marts and warehouses
• Orchestrated and automated end-to-end ETLs