Govind Prabhu

Senior Software Engineer

Bengaluru, Karnataka, India11 yrs 10 mos experience

Key Highlights

Expert in building scalable distributed systems.
Proven track record in AI infrastructure development.
Significant cost savings through optimized cloud solutions.

Stackforce AI infers this person is a Cloud Computing and AI Infrastructure expert with a focus on scalable distributed systems.

Contact

Skills

Core Skills

Distributed SystemsCloud InfrastructureAi InfrastructureData EngineeringSoftware Development

Other Skills

high-throughput traffic managementload balancingtraffic managementdistributed data processingdata pipelinesmachine learningRay frameworkdata processingservice journey developmentautomated testingAndroid app developmentSDK API creationDeep LearningData ScienceSQL

About

Senior software engineer with 11+ years of experience building and scaling large-scale distributed systems, multi-region platforms, and AI infrastructure. Currently working at Microsoft Azure Core AI on high-throughput compute orchestration and intelligent global traffic routing systems processing billions of requests daily across 40+ regions. Experienced in designing fault-tolerant backend platforms, distributed routing systems, multi-tenant infrastructure, and performance-critical services with strong focus on scalability, latency optimization, reliability, and cloud cost efficiency. Previously worked across Microsoft, Adobe, VMware, and British Telecom building: AI data processing systems distributed compute platforms global routing systems large-scale data pipelines metadata-driven platforms graph and distributed databases Strong interests include: distributed systems AI infrastructure large-scale backend architecture platform engineering performance optimization compute orchestration cloud infrastructure Technologies: Azure, Kubernetes, Kafka, Redis, Go, Java, Python, distributed systems, multi-region architectures, large-scale infrastructure.

Experience

11 yrs 10 mos

Total Experience

Average Tenure

Current Experience

Microsoft

Senior Software Engineer

May 2024 – Present · 2 yrs 1 mo · Bengaluru, Karnataka, India · Hybrid

LLM Traffic Orchestration
∗ Developed high-throughput traffic manager for routing inference requests across distributed model endpoints
∗ Increased system throughput by 2x while maintaining P50 latency SLA compliance
∗ Implemented intelligent load balancing across logical groups of backend services

high-throughput traffic managementload balancingdistributed systemsDistributed SystemsCloud Infrastructure

Adobe

Computer Scientist 2

Nov 2021 – May 2024 · 2 yrs 6 mos · Bengaluru, Karnataka, India

Designed and implemented a distributed data processing framework for Firefly to process millions of
data for training using Ray framework. This has reduced the training time by 40%.
Collaborated with a cross-functional team of researchers and engineers to design and implement
the Generative model architecture, achieving increased image quality of generated image by 10%
Created data preprocessing framework using Ray clusters. Migrated 13 ML models to this framework.
Ingested 300 million images for training by creating Data pipelines using MDS shard in Redshift. Saved around $20
million in cloud costs annually.

distributed data processingdata pipelinesmachine learningAI InfrastructureData Engineering

Vmware

Member Of Technical Staff

Jun 2019 – Oct 2021 · 2 yrs 4 mos · Greater Bengaluru Area

Bt

2 roles

Software Engineer

Promoted

Mar 2017 – Jun 2019 · 2 yrs 3 mos · Bengaluru, Karnataka, India

Analyst

Dec 2015 – Mar 2017 · 1 yr 3 mos · Bengaluru, Karnataka, India

► Was working in Single Resource Inventory Mangement Service (SRIMS) project. As part of it,
● Developed end-to-end service journey for Broadband Services
● Implemented a completely automated Operational Readiness Testing (ORT) tool for SRIMS.

service journey developmentautomated testingSoftware Development

Vmware

Software Engineer

Jul 2014 – Dec 2015 · 1 yr 5 mos · Greater Bengaluru Area

VMware Airwatch offers the industry's broadest, most respected portfolio for enterprise mobility management and security.
● Worked as a part of Android App wrapping team. Developed test app in various android MADP platforms, like Native (Java), Xamarin, Phonegap, IBM worklight, Titanium for Mobile Access Gateway testinng.
● Previous to this was in Java Device Service Team, creating SDK APIs for Airwatch Agent with Spring Core, Spring JPA, Hibernate, JAX-RS. These API are used to get real time data of the device, user who enrolled to device, unenrolling the device, to get various functionalities from console etc.

Android app developmentSDK API creationSoftware Development