Deepak Goyal — Senior Software Engineer
At Confluent, my focus is on innovating serverless orchestration for self-balancing and self-scaling kafka clusters, leveraging my proficiency in data engineering and distributed computing to craft robust solutions. My recent tenure at Walmart Labs involved architecting a real-time Customer Data Platform, contributing to the seamless integration of information for over 600 million customers. The platform's success hinged on high availability, low-latency operations, and unwavering data durability. Leading with a forward-thinking approach, I played a pivotal role in developing the Identity Graph Conflation algorithm, enhancing the platform's efficiency by eradicating tail latencies. This foundational work, coupled with my algorithmic acumen and command of Confluent Cloud, positions me at the forefront of addressing complex challenges in real-time data processing and orchestration. Patents - System and Method for Bootstrapping Replicas from Active Partitions (US 16/256,856) - Methods and Apparatus for Data Repartitioning (US 16/548,628) - Event-Driven Identity Graph Conflation (US 16/777,692) Speaker at the following conferences: - Kafka Summit, London 2019 - Kafka Summit, New York 2019 - Rootconf, Bengaluru 2019
Stackforce AI infers this person is a SaaS expert specializing in real-time data processing and distributed systems.
Location: Bengaluru, Karnataka, India
Experience: 9 yrs 11 mos
Skills
- Kafka
- Confluent Cloud
- Real-time Data Processing
- Distributed Systems
- Distributed Processing
- Kafka Streams
- Knowledge Graph
- Performance Optimization
Career Highlights
- Innovated serverless orchestration for Kafka clusters.
- Architected a real-time Customer Data Platform for 600 million users.
- Developed algorithms enhancing data processing efficiency.
Work Experience
Confluent
Senior Software Engineer II (2 yrs 1 mo)
Walmart Labs
Senior Software Engineer (3 yrs 9 mos)
Software Engineer 2 (1 yr 10 mos)
Microsoft India
Software Engineer (2 yrs 3 mos)
Software Engineering Intern (1 mo)
Education
Bachelor's Degree at International Institute of Information Technology Hyderabad (IIITH)
High School at Government Model Sr Sec School, Sector-33, Chandigarh
Secondary School at St. Xaviers Chandigarh