Manas Bhardwaj

Data Engineer

Navi Mumbai, Maharashtra, India2 yrs 3 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Optimized workflows processing over 5 billion records daily.
Designed automated ELT pipelines improving data accuracy.
Developed frameworks ensuring fault-tolerant data processing.

Stackforce AI infers this person is a Data Engineer specializing in SaaS with a focus on real-time data processing.

Contact

Skills

Core Skills

Real-time AnalyticsData Engineering

Other Skills

AWSAWS GlueAWS S3AirflowAlgorithm DevelopmentAlgorithmsAnomaly DetectionApache AirflowApache KafkaApache NiFiAthenaAzureAzure Data FactoryAzure DatabricksC++

Experience

Jio platforms limited (jpl)

Data Engineer

Dec 2023 – Present · 2 yrs 3 mos · Navi Mumbai, Maharashtra, India · On-site

Optimized real-time analytics workflows using Spark, processing 5B+ records daily for diverse business domains, leading to a 20% reduction in reporting latency.
Designed automated ELT pipelines with Azure and PySpark, improving data accuracy and reliability for executive dashboards.
Developed Scala-based datasets, enabling quicker anomaly detection and enhancing service reliability for millions of customers.
Implemented scalable Kafka ingestion frameworks orchestrated via Airflow, ensuring seamless, fault-tolerant data processing across cloud platforms.

Spark Structured StreamingReal-Time DashboardsCloud ScalabilityFault Tolerant SystemsETL DevelopmentPySpark+6