Divya Tiwari — Data Engineer
I am a Senior Data Engineer with 6+ years of experience designing, building, and optimizing scalable data platforms and pipelines on Google Cloud Platform (GCP). I specialize in migrating complex legacy systems (Teradata, Snowflake, SQL Server, Oracle, AS400) to modern cloud data warehouses like BigQuery, and in building reliable batch and streaming data workflows for analytics and ML. My core skills span GCP (BigQuery, Dataflow, Data Fusion, Cloud Composer, Cloud SQL, Pub/Sub, Cloud Functions), Python, advanced SQL, and data modeling for analytics and BI. I have led end-to-end implementations of ETL/ELT pipelines, containerized data workflows using Docker and Airflow, and infrastructure-as-code using Terraform and CI/CD (GitHub Actions). Some examples of impact: Led Teradata-to-GCP migrations, redesigning ETL pipelines and orchestration to achieve 50%+ faster processing, 60% infrastructure cost savings, and zero data loss. Optimized BigQuery and Teradata queries, improving query performance by up to 70% for 500+ daily users and reducing storage costs by 35%. Orchestrated and automated 500+ ETL pipelines across SQL Server, AS400, and Oracle into BigQuery with 99.9% uptime and 80% reduction in manual effort. Co-developed a Manufacturing Data Engine with Google, ingesting 1 TB+ PLC data daily with sub-second latency for real-time insights. Built Kafka-to-BigQuery streaming pipelines with Dataflow for high-throughput, real-time analytics. I enjoy solving complex data problems, improving performance and reliability, and collaborating with cross-functional teams to turn raw data into usable, trustworthy, analytics-ready datasets. Currently based in Munich and open to challenging data engineering opportunities across Europe. My core skills span GCP (BigQuery, Dataflow, Data Fusion, Cloud Composer, Cloud SQL, Pub/Sub, Cloud Functions), Python, and advanced SQL, with strong experience in data modeling, ETL/ELT, and dimensional data warehousing. I have worked extensively with Teradata, Snowflake, SQL Server, Oracle, and AS400, and build production-grade pipelines using Airflow, Docker, Terraform, Git, and CI/CD (GitHub Actions
Stackforce AI infers this person is a Data Engineering expert specializing in cloud migrations and data optimization.
Location: Munich, Bavaria, Germany
Experience: 6 yrs 3 mos
Skills
- Gcp
- Etl/elt
- Bigquery
Career Highlights
- Achieved 50%+ faster processing in ETL pipelines.
- Reduced infrastructure costs by 60% through optimization.
- Engineered pipelines with 99.9% uptime and 80% manual effort reduction.
Work Experience
EXL
Data Engineer (2 yrs 1 mo)
Quantiphi
Senior Data Engineer (2 yrs 5 mos)
Data Engineer (1 yr 9 mos)
Education
PG Diploma at Centre for Development of Advanced Computing (C-DAC)
Bachelor of Engineering - BE at Shivajirao S Jondhale College of Engineering Vishnu Nagar Dombivli (West) Dist Thane
HSC at Hindi Vidya Prachar Samitis Ramniranjan Jhunjhunwala College Opp Railway Station Ghatkopar West Mumb