Priyansh Mangal

Data Engineer

Gurugram, Haryana, India8 yrs 2 mos experience

Highly Stable

Key Highlights

Expert in building scalable data platforms.
Proficient in real-time and batch data pipelines.
Strong background in optimizing data processing jobs.

Stackforce AI infers this person is a Data Engineering expert with a focus on scalable solutions in SaaS and Fintech.

Contact

Skills

Core Skills

Data EngineeringData PipelinesEtl

Other Skills

Data ArchitectsDistributed SystemsPlatform as a Service (PAAS)Apache SparkAmazon Elastic MapReduce (EMR)Extract, Transform, Load (ETL)CoachingMentoringScalabilityAmazon AthenaData WarehousingData ModelingHiveScalaJava

About

Big Data Engineer having expertise in building robust and scalable data platform, for real-time and batch data pipelines. Passionate for exploring new tools and technologies in data engineering world. I strongly believe in picking up the right tool/process/tech stack for the job. Worked with various types of industry from Startup to Unicorn to MNC where explored data at various scales. Programming Languages: Scala, Python, Java Data Engineering Technology Used - Apache Spark, Kafka, Flink, Faust, Hive, Trino, Iceberg, Data Modeling, Data Lake Best Practises: Code Coverage, CI/CD, Git, E2E Testing, Performance Testing.

Experience

8 yrs 2 mos

Total Experience

1 yr 9 mos

Average Tenure

1 yr 2 mos

Current Experience

Roku

Senior Data Engineer

Mar 2025 – Present · 1 yr 2 mos · Bengaluru, Karnataka, India · Hybrid

Data PipelinesData ArchitectsData Engineering

Uber

Data Engineer - Fintech

Jul 2024 – Mar 2025 · 8 mos · Hyderabad, Telangana, India

Distributed SystemsData Engineering

Expedia group

2 roles

Data Engineer III

Apr 2023 – Jul 2024 · 1 yr 3 mos

Distributed SystemsPlatform as a Service (PAAS)Data Engineering

Data Engineer II

Dec 2020 – Mar 2023 · 2 yrs 3 mos

Info edge india ltd

Senior Data Engineer

Mar 2020 – Nov 2020 · 8 mos · Noida, Uttar Pradesh

Created generic platform for ETL jobs, processing clickstream data and
creating data lake on s3 using delta lake. Contributed on platform to trigger spark
jobs in optimized way using EMR auto launcher .
Refactor, optimized and tunned spark job such reducing execution time by 2x and
saving EMR cost accordingly. Also saved cost and improve execution time of athena query by flattening the tables and changing source file format from
parquet to orc.

Apache SparkAmazon Elastic MapReduce (EMR)Data EngineeringETL

Innovaccer

Software Development Engineer

Jan 2018 – Mar 2020 · 2 yrs 2 mos · sector 62, Noida · On-site

Worked on Job Orchestration module to schedule spark jobs parallel for various bucketing configuration and trigger them using spark launcher with Spark Tuning.
Developed features and optimizing the product for Big Data Analytics using Scala, Apache Spark and Apache Hadoop Ecosystem. Building ETL, analytics model.
Contributed in developing features in measures module for getting measure HEDIS certified (NCQA).
Worked on Risk and CDI Module: A Risk score measures the individual beneficiaries’ relative risk.
And clinical documentation improvement (CDI) programs facilitate the accurate representation of a patient’s clinical status that translates into coded data.
Developed object-oriented core-framework in scala to implement ETL (read, write and transform from heterogeneous data sources like file (Parquet, Avro, ORC, CSV) and data stores (Elasticsearch, Mongo, Greenplum, Amazon Redshift) for Spark)
Developed Measure Definition Repo which is used for end to end testing of all hedis certified and mssp measure definitions make all validation check on all measure json files prior job execution.