Piyush Trivedi — Data Engineer

🚀 GCP & Azure Certified | Python Developer • Data Engineer | BigQuery • Dataproc • Dataflow • Airflow • PySpark • SQL • Big Data I'm Piyush Trivedi, a Python Developer & Data Engineer with 3.5+ years of experience building cloud-native ETL pipelines, automation frameworks, and performance-optimized backend systems across enterprise-scale environments. At TCS, I have contributed to two major enterprise projects—NetApp (Python automation & Data Engineering) and HSBC Migrata (GCP Data Migration & ETL Engineering). My work spans automation, data validation, large-scale migrations, distributed processing, and storage optimization. 🔹 What I Do Build scalable ETL/ELT pipelines using BigQuery, Dataproc (PySpark), Dataflow, Pub/Sub, GCS, Cloud Composer Design Python automation frameworks for log parsing, debugging, workflow execution, and system optimization Migrate large enterprise datasets (70+ TB) from Teradata/on-prem to BigQuery with full validation & reconciliation Optimize storage performance across WAFL, NAS, SAN, improving storage utilization by 20% Reduce manual triaging time significantly (up to 86%) using Python automation Improve system reliability through CI/CD, Docker, Kubernetes, Terraform, Jenkins, and Git-based workflows 🔹 Tech Skills Python, SQL, PySpark, Airflow, Dataproc, Dataflow, BigQuery, Pub/Sub, GCS, Docker, Kubernetes, Terraform, Jenkins, Linux, Hadoop, Shell, REST APIs, Storage Systems (WAFL/NAS/SAN) 🔹 Projects I Delivered NetApp – Cloud & Automation Python automation • PySpark jobs • Storage optimization • CI/CD integration • Debugging & performance tuning HSBC – Migrata Teradata → BigQuery migration • Dataproc pipelines • Composer orchestration • Data validation • Query optimization Intelligent Ticket Categorization (ML) Python NLP • GCP Cloud Functions • BigQuery • Automated triage routing 🔹 Certifications Google Cloud Professional Data Engineer AWS Certified Data Engineer – Associate Microsoft Certified Data Engineer Associate 💡 Let’s connect if you’re hiring or building: Cloud Data Engineering solutions (GCP preferred) Python automation & backend systems Big Data & distributed data pipelines High-performance, scalable data platforms 📬 Email: piyushtrivedi461@gmail.com

Stackforce AI infers this person is a Cloud Data Engineer specializing in scalable ETL solutions and data migration.

Location: Noida, Uttar Pradesh, India

Experience: 3 yrs 9 mos