Aug 2019 – Dec 2025 · 6 yrs 4 mos

• Created and implemented enterprise-scale ETL/ELT pipelines using PySpark, SQL and Azure Data Factory improving performance by 40%. Built real-time streaming pipelines using ADF and Databricks Structured Streaming for high-volume ingestion. Developed SQL queries to automate generation of data reducing cost and latency. Automated provisioning and CI/CD workflows using ARM Templates, and Azure DevOps. Applied data modeling(star schema, fact/dimension) to design reporting datasets improving reporting speed by 20%. Partnered with business teams to define data strategy, standards, and governance best practices. Mentored 15+ engineers, conducted code reviews as per GXP standards, and enforced engineering excellence.

Aug 2015 – Aug 2019 · 4 yrs

• Citibank: Enhanced credit card reward redemption, reducing transaction time by 10%.

Aug 2015 – Present · 10 yrs 8 mos · Kolkata, West Bengal, India · On-site

• Senior Data Engineer with 9+ years of experience in designing and implementing scalable data solutions across healthcare and financial domains. Expert in Azure Data Factory, Databricks, ADLS, PySpark, Python, SQL, Spark, and Kafka, with proven ability to optimize large-scale ETL/ELT pipelines, enable real-time data streaming, and deliver robust data warehouse solutions. Strong background in data modeling, performance tuning, CI/CD, data governance, and cloud migration. Adept at collaborating with stakeholders and leading cross-functional teams to deliver measurable business outcomes

– Present