Mansi Gupta

Software Engineer

Ghaziabad, Uttar Pradesh, India4 yrs 8 mos experience
Highly Stable

Key Highlights

  • Expert in architecting large-scale ETL pipelines.
  • Achieved 86% cost savings in data transfers.
  • Reduced storage costs by 50% through optimization.
Stackforce AI infers this person is a Big Data Engineer with expertise in real-time data processing and cloud solutions.

Contact

Skills

Core Skills

Big DataEtlData Analysis

Other Skills

Apache KafkaAmazon Web Services (AWS)AWSData TransformationMongoDBJavaGrafanaPrometheusETL ToolsApache FlinkApache SupersetStatistical Data AnalysisOOPSExtractTransform

About

Experienced Data Engineer with 4+ years in architecting and optimizing large-scale ETL pipelines and real-time streaming platforms. Expert in scalable data ingestion, transformation, and storage using Kafka, Spark, and cloud-native solutions. Demonstrated success in cost-efficient data pipeline design, performance tuning, and enabling data-driven decision-making at scale.

Experience

4 yrs 8 mos
Total Experience
4 yrs
Average Tenure
8 mos
Current Experience

Lowe's india

Software Engineer

Sep 2025Present · 8 mos

Paytm

2 roles

Senior Data Engineer

Jul 2024Sep 2025 · 1 yr 2 mos

  • Worked on PGDWH across Payments, MIS, and EDC domains by creating dimension tables, building OLAP models, optimizing queries, and enabling RBI-compliant data cleanup, reducing storage by 25%.

Software Engineer [Big Data]

Aug 2021Jun 2024 · 2 yrs 10 mos

  • Worked on Growth Marketing Events by enhancing and contributing to a real-time ETL pipeline processing 20B+ messages/day, optimizing Kafka-to-S3 transfers (86% cost savings), enabling dynamic transformations (JSON to Avro, geohash), and improving data delivery for 10–20% better campaign performance.
  • Enhanced the PULSE analytics platform by developing real-time user segmentation for improved customer insights, and developed a Java-based historical service for FunnelHub using MongoDB aggregation with optimized retention, reducing storage costs by 50%.
Apache KafkaAmazon Web Services (AWS)Big DataETL

One97 communications limited

Intern

Mar 2021Jul 2021 · 4 mos

  • Facilitated the efficient ingestion of millions of Kafka events through the strategic utilisation of Kafka topics and streams, resulting in a 40% increase in data throughput.
  • Enhanced monitoring and alerting capabilities by seamlessly integrating Grafana and Prometheus resulted in cutting manual checks by 20%.
  • Performed a POC on Kafka’s log compaction feature to mitigate duplicate messages
Apache KafkaAmazon Web Services (AWS)Big Data

Gizmo blaze

Intern

Jul 2020Aug 2020 · 1 mo

Education

Dr. A.P.J. Abdul Kalam Technical University

Bachelor of Technology - BTech — Computer Science

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Big Data & Etl

Explore similar profiles based on matching skills and experience