Mar 2025 – Aug 2025 · 5 mos · Mumbai, Maharashtra, India

Nov 2022 – Mar 2025 · 2 yrs 4 mos · Mumbai, Maharashtra, India

• Develop, Document and support ETL mappings, database structures and BI reports.
• Perform unit testing for the developments done by you
• Participate in that UAT process and ensure quick resolution of any UAT issue.
• Manage different environments and be responsible for proper deployment of code in all client environments.
• Prepare release documents
• Prepare and maintain project documents as advised by Team Leads.

Aug 2019 – Sep 2020 · 1 yr 1 mo · padgha,Maharashtra

• Ingested data from multiple different data sources from the up streams comprising of data logs from payment history, batch data from banking transactions, structured data from user details.
• Develop and maintain ETL pipelines using Azure Data Factory with extensive usage of activities like Copy, Metadata, For Each, If else and performed transformations using Azure Databricks.
• Designed and implemented a real-time data pipeline to process semi-structured data by integrating 100 million raw records from multiple data sources using PySpark and Spark SQL .
• Worked closely with team members, stakeholders, and solution architects to incorporate changes to the existing pipelines which are running on Spark.
• Developed major optimizations in Databricks and provided most optimized solution to client resulted in significant lesser cost of running Spark workloads resulting in lower costs for cloud infrastructure, storage, and compute.