𝐑𝐚𝐣𝐞𝐬𝐡 𝐏𝐚𝐦𝐮𝐣𝐮𝐥𝐚 — Data Engineer

Lead Data Engineer | Cloud & Big Data Leader | Driving GenAI & AI Agent Innovation in Data Platforms Seasoned Lead Data Engineer with 12+ years of experience architecting and scaling Big Data platforms, real-time streaming pipelines, and cloud-native ETL systems. Expert in transforming raw, high-volume data into trusted, actionable insights that accelerate decision-making and business growth while delivering millions in cost savings through optimized pipelines and cloud efficiencies. Passionate about embedding Generative AI and AI Agents into the modern data stack—leveraging LLMs and autonomous agents for: Data quality validation & anomaly detection Schema evolution & automated ETL optimization Intelligent metadata management & AI-driven analytics What I Bring Big Data & Python Expertise: PySpark (SQL, Structured Streaming, ML), Python (Pandas, NumPy, Scikit-learn) Cloud & Data Stack: Azure Data Factory, Databricks, Delta Lake, Snowflake, Azure Functions Modern Engineering: FastAPI, MongoDB, GitHub, Splunk, CI/CD pipelines, Data-as-a-Service (DaaS) ML, Analytics & AI Agents: EDA, Statistics, ML models, AI-driven automation agents for monitoring, governance, and pipeline optimization BI & Visualization: Power BI (DAX, data modeling, interactive dashboards) Key Achievements Optimized MarTech clickstream pipeline → reduced runtime from 12+ hrs to <2 hrs, cutting cloud compute costs by 60% while boosting performance Built enterprise-grade DaaS platforms and SCD Type 2 pipelines, enabling multi-source integration and saving $1M+ annually in manual processing & rework Delivered production-grade global data solutions, reducing technical debt by 40% and cutting operational costs by 25% Pioneered AI Agent–based monitoring system → proactive data quality checks & automated remediation, preventing ~$500K/year in downstream data errors What Drives Me Building AI-augmented, future-ready data ecosystems, mentoring high-performing teams, and solving complex data challenges that unlock innovation, efficiency, and measurable business value.

Stackforce AI infers this person is a Big Data and Cloud Engineering expert specializing in AI-driven data solutions.

Location: Bengaluru, Karnataka, India

Experience: 13 yrs