Prakash Choudhary — DevOps Engineer

Currently leading the Batch ETL as a Lead Data Engineer with 10+ years of experience. My work encompasses designing, managing, and developing Lakehouse pipelines, Data Lakes, Data Mesh architectures, and Microservices. I bring expertise in a diverse Big Data stack, including Spark, Kafka, Airflow, Terraform, Iceberg and Databricks. Additionally, I possess deep expertise in the AWS Cloud, working extensively with services like S3, Glue, SQS, Lambda. My background also includes significant experience with distributed databases, including TiDB, MySQL, PostgreSQL, and MongoDB, enabling me to specialize in building scalable, robust and cost-effective data products that drive business value at Delhivery. Key Achievements: Real-Time Data Solutions: Built Kafka-based pipelines for seamless ingestion and transformation, leveraging tools like Delta Lake, AWS Glue, Terraform and Databricks to enable real-time decision-making. Cluster Optimization: Automated PrestoSQL/Trino cluster scaling with AWS Lambda, reducing scaling time by 85%. Technical Proficiencies: Programming: Python, SQL(Expert) Big Data Tools: Apache Kafka, PrestoSQL, PySpark, Hadoop, Hive, Airflow Databases: MySQL, PostgreSQL, MongoDB Cloud Services: AWS (S3, Glue, Lambda, Athena, EC2, RDS, CloudWatch, SNS) InfraAsCode: Terraform Version Control: Git, GitHub ETL and Data Pipelines: Expertise in designing efficient ETL workflows and real-time streaming pipelines I am passionate about optimizing workflows, enhancing data accessibility, and building innovative solutions that drive business outcomes.

Stackforce AI infers this person is a Data Engineering expert specializing in Big Data and Cloud solutions.

Location: Noida, Uttar Pradesh, India

Experience: 11 yrs 6 mos