Prateek Asthana

Engineering Manager

Mumbai, Maharashtra, India10 yrs 8 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Over 10 years of experience in data engineering.
  • Expertise in building scalable data platforms.
  • Proven leadership in optimizing data resources.
Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech industries.

Contact

Skills

Core Skills

Data EngineeringData PipelinesReal-time StreamingEtl

Other Skills

AI AgentsAirlfowAlgorithmsAmazon DynamodbAmazon EKSAndroid DevelopmentApache NiFiApache SupersetBig DataCC++ClickHouseCloud FirestoreCommunicationComputer Networking

About

Accomplished Data Engineer with over 10 years of experience building scalable data platforms using Spark, Scala, Kafka, Python, AWS and Flink. Expertise in data pipelines, real-time streaming, CI/CD, data storages and data quality. Proven leadership in optimizing resources, driving impactful solutions in data ingestion, migration, modeling, warehousing and platform design. Strong communicator focused on delivering high-quality results and operational efficiency in fast-paced environments.

Experience

10 yrs 8 mos
Total Experience
2 yrs 3 mos
Average Tenure
1 yr 6 mos
Current Experience

Highlevel

Engineering Manager

Dec 2024Present · 1 yr 6 mos · Remote

Terrascope

Senior Data Engineer

Sep 2023Dec 2024 · 1 yr 3 mos · Bengaluru, Karnataka, India · Remote

  • EFDB Onboarding - Building efficient Python pipelines for emission factor data ingestion, transformation, storage (Postgres) and delivery, along with localization and sync services for translation and MongoDB export.
PythonPostgresMongoDBData EngineeringData Pipelines

Zupee

Senior Data Engineer

Jul 2021Aug 2023 · 2 yrs 1 mo · Gurugram, Haryana, India · Hybrid

  • Real Time Feature Store - Storing/managing aggregated data (features) by transforming raw fields to be used by ML models for training and serving. Streaming in Flink/Python to consume Kafka events.
  • User Segmentation - Creating user segments based on various attributes like games, payments etc and upload to Redis for campaigns and push notifications.
  • Tournament Recommendation - Contributed to ETL pipelines for game improvements and innovation by using ML models. It also included real time monitoring by analysing complexities and identified anomalies.
FlinkPythonKafkaRedisData EngineeringReal-time Streaming

Paytm

2 roles

Senior Software Engineer

Promoted

Dec 2019Jun 2021 · 1 yr 6 mos · Noida, Uttar Pradesh, India

  • Engage - Feature generation/scoring of every customer linked with Paytm based on its profile, transactions, bookings, market buys, wallet transfers and built ETL pipelines in Scala/Spark.
  • Insurance Recommendation - Contributed to internal activities for improvements, efficiencies and innovation to be used by ML models using Pyspark.
  • Trends/Insights - Generated insightful data and creating dashboards from active customers, active/onboarded merchants, transactions count/amount for every city, state, channel etc. using Spark.
ScalaSparkPythonData EngineeringETL

Software Engineer/Data Engineer

Oct 2018Dec 2019 · 1 yr 2 mos · Noida, Uttar Pradesh, India

Samsung r&d institute india-noida

Software Engineer

Jul 2015Sep 2018 · 3 yrs 2 mos · Noida Area, India · On-site

  • Knox & Secure Folder

Education

Motilal Nehru National Institute Of Technology

Bachelor of Technology (B.Tech.) — Computer Science

Jan 2011Jan 2015

St. Mary's Convent Inter College

Jan 1998Jan 2010

Stackforce found 100+ more professionals with Data Engineering & Data Pipelines

Explore similar profiles based on matching skills and experience