Shubham Gupta

Data Engineer

Bengaluru, Karnataka, India7 yrs 7 mos experience

Highly StableAI Enabled

Key Highlights

Led development of a high-performance clickstream analytics platform.
Achieved 50% cost savings by replacing Google Analytics.
Recognized with Paytm Hall Of Fame and Star Award.

Stackforce AI infers this person is a Data Engineering expert in Fintech with a strong focus on Big Data solutions.

Contact

Skills

Core Skills

Data EngineeringAwsBig Data

Other Skills

AI AgentsAgentic AIAmazon BedrockAmazon Web Services (AWS)Apache AvroApache DruidApache FlinkApache KafkaApache SparkApache SupersetArtificial Intelligence (AI)Backend DevelopmentBig Data StreamingC++Clickstream Analytics

About

Skills and Tech Stack: Stream and Batch Data Processing, Data Modelling, Apache Flink, Apache Kafka, Apache Druid, Data Formats like Apache Parquet and Apache Avro, SQL, MongoDB, Redis, Apache Superset, AWS (EC2, RDS, S3, EKS, Lambda, Athena, CloudWatch), Kubernetes, ETL, Apache Spark, Distributed Systems, Microservices, REST APIs, Java, Scala, Python, Spring Boot, Flask, Generative AI, Data Structures and Algorithms etc.

Experience

Amazon

Data Engineer II (L5)

May 2024 – Present · 1 yr 10 mos · Bengaluru, Karnataka, India · Hybrid

Amazon Music's Data, Insights and Optimizations(DISCO) team

Data EngineeringStream ProcessingApache FlinkApache KafkaAWS

Paytm

3 roles

Lead Data Engineer

Promoted

Apr 2023 – May 2024 · 1 yr 1 mo · Noida, Uttar Pradesh, India

Working as Lead Data Engineer at Paytm's Central Data Platform team.
Work involves building data intensive applications and Near Real Time Big Data Streaming pipelines as well as Backend development.
Working on Paytm’s In-house Clickstream analytics platform processing the clickstream data (~22 Billion events/day | Peak 350k/sec) generated by the entire Paytm ecosystem Apps and providing meaningful visualizations to business analysts across Paytm. Also, providing required datasets to downstream ML & Data Science teams.
Successfully replaced Google Analytics with the In house tool resulting in ~50% cost savings.
Got recognised with Paytm Hall Of Fame and Paytm Star Award for consistently performing in the team.

Data EngineeringClickstream AnalyticsBig Data StreamingBackend DevelopmentData VisualizationBig Data