Mar 2022 – Present · 4 yrs 2 mos · United States · Remote

• I built real-time data pipelines across AWS and GCP to power fraud detection and personalization models, achieving 99.99% uptime in production environments. I designed domain-level datasets using Avro and Protobuf to support feature stores and enable cross-team model reuse. I developed dbt-based transformation layers using Python and SQL to produce high-quality training and inference datasets, and applied Apache Iceberg, Delta Lake, and Apache Hudi to manage labeled data, backfills, and reproducible machine learning experiments. I automated infrastructure and environments using Terraform and Docker to support scalable model training and deployment. To ensure reliability, I implemented monitoring and anomaly detection for data drift, model quality, and SLA adherence. I guided teams on feature engineering, performance tuning, and production ML workflows across Python and Scala, while partnering with product and operations teams to translate healthcare and financial requirements into production-ready data models and feature pipelines. These standardization efforts reduced pipeline failures by 35% through consistent validation, backfill, and release workflows across domains.

Jan 2022 – Present · 4 yrs 4 mos · United States

Mar 2020 – Mar 2022 · 2 yrs

• I built and operated multi-cloud data pipelines across AWS and GCP, using AWS Glue, Lambda, Redshift, and S3 alongside GCP Dataflow and BigQuery to process over 1.2 TB of data daily. I architected secure Delta Lake frameworks with schema enforcement, GDPR and CCPA–compliant data masking, tokenization, and audit-ready datasets. I automated ETL pipelines using AWS Glue and Python, integrating data lineage tracking and encryption both at rest and in transit. I provisioned and managed infrastructure using AWS CDK and Terraform, significantly improving deployment speed and consistency across environments. To strengthen data reliability, I built and maintained more than 50 validation suites using Great Expectations, Soda Core, and Monte Carlo, reducing data quality incidents by 80%. I also implemented fine-grained access control and governance through Unity Catalog, AWS Lake Formation, and IAM, while mentoring junior engineers, leading design sessions, and collaborating within Agile teams to deliver secure, compliant analytics solutions.

Aug 2018 – Mar 2020 · 1 yr 7 mos

• I refactored and scaled ETL pipelines using Python, SQL, and Apache Airflow to ingest transactional and event-driven data into PostgreSQL and enterprise data warehouse systems. I led the migration of workflows to cloud environments leveraging Amazon EMR, Amazon Redshift, and Snowflake, improving scalability and cost efficiency. I integrated diverse data sources including APIs, CSV, JSON, and XML using Airflow, cron scheduling, and custom Python logic to build reliable centralized datasets. I delivered Tableau and Looker dashboards for key business KPIs such as GMROI and sell-through, while implementing role-based access control, PCI DSS compliance, and encryption standards. By optimizing SQL and Polars-based transformations, I reduced visualization latency by 60% and strengthened data governance through audit logging and Apache Ranger policies. I also built demand and pricing datasets used by forecasting and optimization teams, improving model input reliability, and worked closely with analysts and business stakeholders to define metrics, data contracts, and refresh SLAs for executive reporting.

Feb 2013 – Jul 2018 · 5 yrs 5 mos

• I improved overall data processing performance by 30% by integrating and optimizing datasets in PostgreSQL using Python and SQL-based workflows. I supported daily data pipeline operations through cron jobs and early Airflow deployments while helping transition workloads toward cloud-based infrastructure. I also designed secure data ingestion pipelines from APIs and FTP sources into centralized reporting layers, leveraging MongoDB and Elasticsearch to enable fast, scalable lookups. By tuning SQL queries through indexing and optimized joins, I reduced dashboard latency by 60% and implemented access control, encryption, and audit logging to strengthen data security. In parallel, I collaborated closely with senior engineers to introduce Docker-based containerization and automate CI/CD pipelines using Jenkins and GitHub Actions.