Pratham Garg

Data Engineer

Ghaziabad, Uttar Pradesh, India3 yrs 11 mos experience

Key Highlights

Expert in building data platforms and pipelines.
Proficient in real-time data processing technologies.
Strong background in Python and data engineering.

Stackforce AI infers this person is a Data Engineer specializing in real-time data processing and data platform development.

Contact

Skills

Core Skills

Data EngineeringApache Airflow

Other Skills

Amazon RedshiftApache FlinkApache KafkaApache SparkCassandraCeleryData AnalysisData ScienceData StructuresDelta LakeDjango REST FrameworkEnglishFastAPIMongoDBMySQL

Experience

3 yrs 11 mos

Total Experience

3 yrs 11 mos

Average Tenure

3 yrs 11 mos

Current Experience

Payu

Data Engineer 2

Jun 2022 – Present · 3 yrs 11 mos

Building In-house DataPlatform (Django Rest Framework , Redis , Celery)
Buiding Realtime features via Spark Streaming for in house models(Apache Kafka , Cassandra , Delta Lake , Pyspark)
Building in-house Near Realtime Data Pipelines - OLTP (mysql, postgresql, mongodb, salesforce) to OLAP (Redshift)
Build batch spark pieplines , Orchestrating on Airflow
Building central meta storage layer for all data in the system

Django REST FrameworkRedisCeleryApache KafkaCassandraDelta Lake+8