Piyush Agarwal — Data Engineer
🚀 Senior Data Engineer | Azure | Databricks | Big Data | AI-Driven Analytics I build scalable, enterprise-grade data platforms that transform complex data into real-time, decision-ready insights. With 6.5+ years of experience across Adobe, EY, and TCS, I specialize in designing modern data architectures, distributed pipelines, and cloud-native analytics systems. 💡 What I Bring: • End-to-end Data Engineering (Ingestion → Transformation → Serving) • Scalable ETL/ELT pipelines using PySpark, SQL, Airflow • Cloud expertise: Azure (ADF, ADLS, Databricks, Delta Lake) & GCP • Real-time & batch processing using Kafka & Spark • Dimensional modeling & performance optimization 📈 Impact Highlights: • Redesigned 25+ legacy procedures into Spark pipelines → ⚡ 35% performance boost • Reduced SLA breaches by 40% through automated orchestration • Built AI-powered analytics (NL2SQL + anomaly detection) → 📊 50% reduction in ad-hoc effort • Delivered systems supporting multi-region enterprise reporting • Contributed to projects driving $300M+ business impact 🏢 Currently at Adobe, building Sales Operations Data Platforms with a focus on scalability, governance, and AI-driven insights. 🌐 Portfolio: https://piyush-agarwal-portfolio.netlify.app/ 🎯 I’m passionate about pushing the boundaries of Data Engineering by integrating AI, automation, and modern data stack technologies. 💼 Open to opportunities in Senior Data Engineering, Data Platform, and AI/Data roles.
Stackforce AI infers this person is a Data Engineering expert with a strong focus on AI-driven analytics in the SaaS industry.
Location: Bengaluru, Karnataka, India
Experience: 6 yrs 6 mos
Skills
- Data Engineering
- Cloud Computing
- Ai
- Big Data
- Business Intelligence
- Data Migration
- Data Analysis
Career Highlights
- Redesigned 25+ legacy procedures into Spark pipelines.
- Built AI-powered analytics reducing ad-hoc effort by 50%.
- Contributed to projects driving $300M+ business impact.
Work Experience
Adobe
Data Engineer (1 yr)
EY
Data Engineer (10 mos)
Tata Consultancy Services
Data Engineer (1 yr)
System Engineer (10 mos)
Capgemini
Associate Consultant (10 mos)
Senior Analyst (1 yr)
Analyst (1 yr)
Bharat Heavy Electricals Limited
Computerized numerical controlled machine (1 mo)
Bharat Sanchar Nigam Limited
Broadband (1 mo)
Education
Bachelor of Technology - BTech at DIT UNIVERSITY
Higher Secondary Certificate at ST. Francis Convent Sr. Sec. School, Bareilly, UP
Secondary School Certificate at ST. Francis Convent Sr. Sec. School, Bareilly, UP
