Nov 2023 – Present · 2 yrs 7 mos · Pune, Maharashtra, India · Hybrid

• Data Engineer at ZS Associates specializing in healthcare and pharmaceutical analytics, building scalable data pipelines and cloud-native solutions that power critical business decisions for global pharma clients.
• Key Responsibilities:
• Architect ETL/ELT data pipelines using Python, PySpark, and Apache Spark on Databricks, processing 25+ complex datasets from clinical trials (CTMS, adverse events), commercial pharma sources (IQVIA, VEEVA), and compliance systems
• Design data warehouses in Snowflake and AWS Redshift supporting Tableau and Power BI analytics dashboards
• Build automated compliance monitoring systems with real-time risk detection, data quality frameworks, and regulatory governance controls
• Orchestrate workflows using Apache Airflow, Jenkins, and CI/CD pipelines for production deployments
• Implement data modeling including SCD Type 2 for historical tracking and audit compliance
• Collaborate with cross-functional teams—clinical operations, compliance, business analysts, stakeholders
• Major Projects:
• 📊 Clinical Trials Risk Analytics: Built system processing TB-scale data from 25+ clinical sources, implementing anomaly detection for patient safety and regulatory compliance
• 📊 Automated Compliance Monitoring: Developed real-time compliance system analyzing commercial pharma data, eliminating 50-60% manual tracking
• 📊 Digital Privacy & Consent Management: Led cross-functional project implementing CCPA/GDPR-compliant cookie consent across 20+ websites
• Key Achievements:
• ✓ Reduced data processing time by 30% through SQL and Spark optimization
• ✓ Processed TB-scale healthcare datasets maintaining performance and cost efficiency
• ✓ Awarded bonus recognition twice for outstanding technical delivery
• ✓ Deployed 5+ production pipelines
• Technical Stack: Python, SQL, PySpark, Apache Spark, Databricks, Delta Lake, AWS (S3, Redshift, Glue, EMR), Snowflake, Apache Airflow, Hadoop, Tableau, Power BI, Alteryx, Git, Jenkins