Rahul Kolish — Data Engineer

I’m a Data Engineer with 4+ years of experience building large-scale distributed data systems and real-time data pipelines that operate at serious scale. Currently, I work on high-impact systems processing 100TB+ data daily and 50M+ transactions/day, where my focus is on building reliable, cost-efficient, and production-grade data platforms. I’ve designed and optimized Spark-based ETL pipelines on AWS EMR, reducing infrastructure costs by 40% while improving processing performance by 60%. One of my key contributions includes architecting a real-time fraud detection system, which improved system reliability to 99.9% uptime and reduced fraud losses by 35% ($1.2M annually). I’ve also built AI-powered systems like PII detection with 97.8% precision, and developed data quality frameworks that improved accuracy across hundreds of datasets. Beyond pipelines, I enjoy solving deeper engineering problems — whether it’s optimizing Spark workloads, designing scalable data architectures, or building automation platforms that convert business requirements into production-ready pipelines (reducing manual effort by 70%). Tech Stack: Spark (Scala/Python), Kafka, Spark Streaming, Airflow, AWS (S3, EMR), OLAP systems, Data Warehousing, Prometheus, Grafana I’m particularly interested in working on large-scale data systems, real-time architectures, and impactful engineering problems that push the boundaries of scale and performance. Feel free to reach out via email or phone. Phone no. : 7018127219 Email: rahulkolish001@gmail.com

Stackforce AI infers this person is a Data Engineer specializing in Fintech and Big Data solutions.

Location: Noida, Uttar Pradesh, India

Experience: 3 yrs 11 mos