Durgesh Choudhary

CTO

Gurgaon, Haryana, India8 yrs 9 mos experience

Key Highlights

  • Expert in building scalable data pipelines.
  • Proficient in microservices architecture and deployment.
  • Strong background in technical planning and system optimization.
Stackforce AI infers this person is a Backend-heavy Fullstack Engineer with expertise in IoT and E-commerce solutions.

Contact

Skills

Core Skills

MicroservicesData PipelineApi DevelopmentTechnical Planning

Other Skills

API IntegrationASP.NETAWS LambdaAlgorithmsApache KafkaApache MesosApache PinotArchitectural DesignAutomationCC#C++CUDACassandraCoding Standards

About

7+ years of experience of end to end handling tech systems. I am a programmer and a dreamer, believe in finding simple solutions to complex problems. - Handling full Software Development Life Cycle - planning, designing requirement specifications, building and testing, deployment, monitoring and scaling. - Strong grasp over data structures, algorithms and computer systems. - In-depth knowledge of network stack and analyzing latency issues and bottlenecks. - Good understanding and experience of event driven architecture with distributed messaging systems (eg Apache kafka) and distributed computing systems (eg Apache spark). - Experience with building various microservices and their intercommunications. - Good understanding of cloud providers and hands-on experience with AWS and GCP.

Experience

Zanskar securities

VP of Engineering

Feb 2024Present · 2 yrs 1 mo · Bengaluru, Karnataka, India · On-site

Battery smart

Principal Engineer

Dec 2022Oct 2023 · 10 mos · Gurugram, Haryana, India · On-site

  • Set up scalable and reliable IOT data pipeline capable of ingesting approximately 5,000 events per second, using Apache Kafka to collect data from multiple vendors. I then standardized this data into a unified structure utilizing Golang-based consumers. Subsequently, I directed the data into Apache Pinot for OLAP purposes and archived it in S3 in Parquet format, employing Spark streaming. Additionally, I configured Trino and Redash to facilitate various querying scenarios.
  • Designed and developed a last-mile delivery solution from the ground up, leveraging our existing fleet of EV drivers. Engineered a Golang service with PostGres, incorporating distinct modules for orders, order management, merchants, drivers, driver slot management, and driver availability management. Emphasizing independent deployability and scalability, the system was purposefully architected.
  • Set up invoice service in Java with DynamoDB, catering to both real-time and batch processing of a substantial volume of invoices, averaging around 10 lakh invoices per month. The utilization of openpdf allowed this service to achieve millisecond processing times.
  • Contributed to the team by guiding them in making informed architectural decisions for both new and existing service releases, advising on the optimal technologies to employ and the best practices to adhere to.
  • Supervised infrastructure operations to ensure the seamless functionality of tech systems, emphasizing scalability, redundancy, security, and cost optimization. The majority of our infrastructure is hosted on Kubernetes (EKS).
  • Designed and developed task service in TypeScript and MongoDB, carved from monolithic which was essential for supporting a diverse range of tasks and workflows and its entire lifecycle, playing crucial role in the day-to-day operations of both field and central teams for business operations.
Apache KafkaGolangApache PinotSpark streamingJavaDynamoDB+6

Zomato

Software Engineer II

Dec 2019Nov 2022 · 2 yrs 11 mos · Gurugram, Haryana, India · On-site

  • Extended merchant onboarding pipeline for different lines of businesses which consisted of pre-onboarding checks, paper and digital contracts, signing and capturing it in the system, real time communication and visibility of various onboarding stages for millions of merchants.
  • Improved merchant document verification system by integrating external APIs for document verification (e.g. NSDL, KnowYourGst, Pierian Services) for PAN, GST verification which improved compliance and reduced overall TAT for merchant onboarding from weeks to 1 or 2 days.
  • Extended and maintained merchant rate card system which maintained merchant commission model for different services across various lines of businesses which catered to order processing and invoicing and had throughput of millions of requests per day.
  • Extracted a microservice for merchant onboarding and documents from monolith and handled the migration of full traffic. Set up data sync back pipeline for analytics queries on redash.
API IntegrationDocument VerificationMicroservicesData SyncRate Card SystemAPI Development

Magicpin (samast technologies)

2 roles

Principal Engineer

Promoted

Jun 2019Nov 2019 · 5 mos

  • Managed merchant portal tech stack and was involved in product cycle from requirements gathering to delivery of all the features. Responsible for technical planning, architectural design and implementation of new products/ maintaining and scaling existing products for partner merchants.
  • Merchant portal fetched data from various sources DBs (MySQL, Postgres), in memory caches (redis, aerospike), document caches (Solr, Elasticsearch) and big data (Cassandra) and displayed it in an much interactive UI built on React.js (with Redux).
  • Involved in building data pipeline for analytics based on lambda architecture using Kafka to ingest real time events and then store them to Cassandra and Elasticsearch.
  • Performed latency analysis to keep querying time as small as possible and have built aggregations for complex queries using Spark in Java to dump data in Cassandra.
  • Wrote authorization layer for merchants which incorporated store, chain level hierarchy.
  • Automated several processes here using scripting languages like Python and bash.
  • e.g. automated emailers for partner merchants.
Technical PlanningArchitectural DesignData PipelineLatency AnalysisAutomation

Software Engineer

Nov 2016May 2019 · 2 yrs 6 mos

Yoctel solutions (p) ltd.

Software Developer

May 2013Jul 2013 · 2 mos · New Delhi, India

  • Built basic content management system (CMS) for Examonair platform using ASP.net with C# and jQuery.

Education

Indian Institute of Technology, Delhi

Dual Degree (B.Tech + M.Tech) — Computer Science and Engineering

Jan 2009Jan 2014

Sainik School Rewa, MP

Higher Secondary Education — Maths + Computer Science

Jan 2001Jan 2008

Stackforce found 100+ more professionals with Microservices & Data Pipeline

Explore similar profiles based on matching skills and experience