Oct 2023 – Aug 2025 · 1 yr 10 mos · Delhi, India · Hybrid

• Designed and developed a Lakehouse architecture leveraging open-source technologies and AWS-managed services, including Apache Iceberg, Spark, Airflow, DBT, Trino, and Superset.
• Implemented a near real-time data lake using Kafka, Debezium, and Spark Structured Streaming for seamless ingestion and processing of real-time data streams.
• Developed financial reports for stakeholders, delivering actionable insights and supporting business decision-making.
• Created an incremental data processing framework to handle data transformations on an hourly basis, optimizing efficiency and scalability.

Jan 2022 – Oct 2023 · 1 yr 9 mos · Gurugram, Haryana, India · Remote

• 1. Design and Develop Data Pipelines in Databricks using PySpak and Data Build Tool (DBT).
• 2. Developed ETL pipeline to ingest data from sources like Google Analytics and other rival's data using company standard framework in Python.
• 3. Developed Complex SQL queries in PySpark and DBT.
• 4. Scheduling the jobs through Databricks and Airflow.
• 5. Merge the code into the GIT Branch
• 6. Coordination with the stakeholders with day-to-day activities performed.
• 7. Developed CI/CD pipelines using Circle CI.

Jun 2017 – Dec 2021 · 4 yrs 6 mos · Noida · On-site

• 1. Designed and implemented a travel domain data lake using the Hadoop ecosystem.
• 2. Managed data analytics using Apache Hive and Apache Spark.
• 3. Implemented an optimised real-time streaming platform for an OTT video domain application using Apache Kafka and Cassandra.
• 4. Initiated a search engine for an OTT video domain application using ElasticSearch and Java.
• 5. Developed an ETL solution using AWS Kinesis and AWS Redshift.

Nov 2015 – Jun 2017 · 1 yr 7 mos · Noida Area, India · On-site

• 1. Assisted with the patent application process tracker system for SLW that helps attorneys quickly find information related to their cases.
• 2. Built the databases and UI with Java, JSF, Spring, and Hibernate as the full-stack developer on the team.
• 3. Implemented a multi-feature search engine for patent applications using Elasticsearch.
• 4. Optimized a legacy application by identifying memory leakage and performance issues.
• 5. Created a module in Core Java for the daily processing and storage of data for 10+ million patents.

Dec 2014 – Sep 2015 · 9 mos · Delhi, India · On-site

• 1. Developed an IDE project using the Eclipse RCP plugin.
• 2. Created modules that generate Java code by using AST through drag and drop and UI events.
• 3. Automated web application development using clicks and drag-and-drop features through an IDE.