Harish M — Data Engineer
I am a Data Engineer with 5 years of experience building real-time and batch data platforms using Databricks, AWS, Azure, PySpark, and Kafka across Healthcare, WFM, and Finance domains. What I Build: • Streaming & ETL Pipelines (Kafka → Spark → Snowflake/Athena) • AI-Ready Data Architecture (Delta Lake, Feature Store, Vector DB, RAG Prep) • Automated Data Validation (BDD Frameworks, CI/CD, Grafana Monitoring) • Cloud Migration Projects (HSDP → AWS, Azure → Databricks) Key Achievements: • Reduced data processing time by 40% using Spark optimization • Implemented BDD-based data validation — 60% testing time saved • Built real-time data ingestion for Nike WFM with Delta Lake, PySpark Open to: • Remote (US / Europe / Canada / UK) • Data Engineer / Platform Engineer / AI Data Engineer • Contract & Consulting Projects (USD/EUR) Passionate about building scalable, AI-powered data platforms that serve as the foundation for Analytics, ML, and Generative AI.
Stackforce AI infers this person is a Data Engineer specializing in real-time data platforms within Healthcare and Finance sectors.
Location: Hyderabad, Telangana, India
Experience: 5 yrs 5 mos
Career Highlights
- 5 years of experience in data engineering.
- Expert in building real-time data platforms.
- Passionate about AI-powered data solutions.
Work Experience
Accion Labs
Data Engineer (6 mos)
Cyient
Data Engineer (1 yr 2 mos)
Nike
Data Engineer (8 mos)
Calsoft
Associate Software Engineer (3 yrs 1 mo)
Education
Bachelor of Technology - BTech at AVN jobs