Pratham Garg

Data Engineer

Ghaziabad, Uttar Pradesh, India3 yrs 9 mos experience

Key Highlights

Expert in building data platforms and pipelines.
Proficient in real-time data processing technologies.
Strong background in Python and data engineering.

Stackforce AI infers this person is a Data Engineer specializing in real-time data processing and data platform development.

Contact

Skills

Core Skills

Data EngineeringApache Airflow

Other Skills

Amazon RedshiftApache FlinkApache KafkaApache SparkCassandraCeleryData AnalysisData ScienceData StructuresDelta LakeDjango REST FrameworkEnglishFastAPIMongoDBMySQL

Experience

Payu

Data Engineer 2

Jun 2022 – Present · 3 yrs 9 mos

Building In-house DataPlatform (Django Rest Framework , Redis , Celery)
Buiding Realtime features via Spark Streaming for in house models(Apache Kafka , Cassandra , Delta Lake , Pyspark)
Building in-house Near Realtime Data Pipelines - OLTP (mysql, postgresql, mongodb, salesforce) to OLAP (Redshift)
Build batch spark pieplines , Orchestrating on Airflow
Building central meta storage layer for all data in the system

Django REST FrameworkRedisCeleryApache KafkaCassandraDelta Lake+8