Mohit Garg

VP of Engineering

Los Altos, California, United States20 yrs 8 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Leading AI networking for Microsoft Azure.
  • Building disruptive software for space technology.
  • Driving growth in cloud networking services.
Stackforce AI infers this person is a leader in AI Infrastructure and Cloud Networking.

Contact

Skills

Core Skills

NetworkingAi InfrastructureProduct StrategySoftware DevelopmentEngineering ManagementSystems Engineering

Other Skills

InfiniBandEthernethigh-performance networkingAI model optimizationAzure Orbitalmanaged satellite connectivityground stationsdisruptive software offeringscloud networkingsoftware solutionssupport cost reductionAzure hybrid connectivitymicroservices architectureDevOpsAzure Bastion

About

I lead AI Infrastructure Interconnect at Microsoft Azure, where my team builds and operates the networking backbone of the world’s largest AI supercomputers — systems that power large-scale model training and inference for partners like OpenAI and internal Microsoft workloads. Our mission is to deliver ultra-low-latency, high-bandwidth, and highly reliable networking for AI infrastructure at global scale. We work across InfiniBand, Ethernet, and NVLink technologies, driving innovation that connects thousands of GPUs into one cohesive supercomputer. From rack and fabric design to automation, observability, and quality systems, my team is at the heart of Azure’s AI growth story. In addition to my core role, I serve as the Site Leader for Azure Core Atlanta, representing a rapidly growing community of 600+ engineers driving cloud and AI innovation from one of Microsoft’s strategic campuses. I focus on building a vibrant, collaborative, and inclusive engineering culture, helping teams grow, connect, and scale their impact. Throughout my career, I’ve built and led global engineering organizations that operate at the intersection of hardware, software, and operations, with a relentless focus on technical excellence, operational rigor, and people growth. I’m passionate about turning bold ideas into production-scale systems — and about building teams that move with clarity, purpose, and impact.

Experience

20 yrs 8 mos
Total Experience
10 yrs 3 mos
Average Tenure
19 yrs 5 mos
Current Experience

Microsoft

7 roles

Vice President of Engineering, AI Network Infrastructure

Promoted

Sep 2024Present · 1 yr 8 mos

  • Leading AI Infrastructure Networking at Azure. My team builds and scales the high-performance networking that powers AI training and inferencing across one of the largest fleets of AI infrastructure in the world. We work across InfiniBand and Ethernet, optimizing for ultra-low latency, high bandwidth, and reliability to accelerate AI workloads. We also own MSCCL++ driving innovations in AI communication at scale. From custom networking stacks to congestion control, multi-tenant AI fabrics, and large-scale AI model optimization, we’re pushing the boundaries of AI networking.
InfiniBandEthernetAI infrastructurehigh-performance networkingAI model optimizationNetworking+1

Partner Director of Engineering, Azure Space and Mission Infrastructure

Promoted

May 2022Aug 2024 · 2 yrs 3 mos

  • Building multiple v0 products for Space and Silicon. We are always looking for talent who would like to create disruptive software offerings and transform these industries. Our first product offering called "Azure Orbital" - a managed satellite connectivity is already in public preview. We are deploying and virtualizing the ground stations across the globe and unifying hyper scale Azure cloud with Space.
Azure Orbitalmanaged satellite connectivityground stationsdisruptive software offeringsProduct StrategySoftware Development

Principal Software Engineering Manager

Promoted

Jan 2020Mar 2022 · 2 yrs 2 mos

  • As the site leader for Azure networking, Atlanta office, I am building two new teams from grounds up.
  • We are looking for motivated and professional developers who are interested is solving complex problems in cloud networking space and build software solutions to cut down support cost of running our services on Azure platform. We are also looking for software developers to build a new service from grounds up which would offer reliable, secure satellite connectivity to Azure though a network of ground stations deployed throughout the globe.
  • Look for all the great opportunities here :
  • https://careers.microsoft.com/us/en/search-results?keywords=%23aznetatl
cloud networkingsoftware solutionssupport cost reductionEngineering ManagementSoftware Development

Principal Software Engineering Manager

Promoted

Jul 2015Jan 2020 · 4 yrs 6 mos

  • Engineering manager, led the team of about 25 software engineers and leads for Azure hybrid connectivity using S2S, P2S VPN, Azure virtual WAN and security solution with Azure Bastion.
  • These solutions are built using micro services architecture that provides high reliability and horizontal scalability to support mission critical workloads and meet growing customer demand. All aspects of these services, from Azure portal UI and REST APIs, to core service implementation are built and operated by the team. These services are built using latest technologies such as CosmosDB, VM scale set, Azure Data Explorer, and Application insights, and incorporate open source extensively from Linux to .NET core. My accomplishments and responsibilities include:
  • Managing multi-discipline DevOps teams that own complete service life cycle from planning and development, to operations.
  • Leading the vision and delivery of new successful services such as Azure Bastion and Virtual WAN.
  • Driving growth of existing services such as Azure S2S and P2S VPN, and increased revenue by a factor of 10x.
  • Making Hybrid networking services margin positive by improving quality and reducing COGS.
  • Envisioning and implementing innovative solutions to drive down support cost of running services on azure by 30%
  • Growing the team from 6 engineers to 25+ engineers by growing the business and improving customer satisfaction.
  • Working closely with customers to deliver solutions that meet their requirements.
Azure hybrid connectivitymicroservices architectureDevOpsEngineering ManagementNetworking

Senior Software Engineer

Oct 2013Jul 2015 · 1 yr 9 mos

  • Revamped windows IKEv2 networking stack to enhance IPSEC performance by 6 times using IPSNPI. Developed and shipped key SDN components of Windows network controller including software load balancer, firewall and service chaining. Mentored junior members of the team and collaborated with different teams in Microsoft to build these features.
IPSEC performanceSDN componentsmentoringSoftware DevelopmentNetworking

Senior Software Engineer

Promoted

Sep 2009Sep 2013 · 4 yrs

  • Designed and implemented load balancing for windows DirectAccess solution. This involved writing a windows intermediate driver to intercepts the packets and perform load balancing. Also worked on different features of DirectAccess like iphttps, goal state management, powershell cmdlet, direct access policy management, certificate management and auto enrollment. Also built DirectAccess UI and made several performance optimizations to the DirectAccess product as a whole. Received awards for building quality gates for whole team using SNAP system.
  • Responsible for prototyping, designing and implementing windows multi-tenant S2S and P2S stack using windows networking compartments. Implemented a QoS library to enforce bandwidth reservation and cap to prevent starvation in multi-tenant environment. Both these are widely used in windows network controller today.
load balancingWindows DirectAccessQoS librarySoftware DevelopmentNetworking

Software Engineer

Sep 2006Sep 2009 · 3 yrs

  • Part of windows serviceability group where I owned windows networking TCP/IP stack. Shipped several hotfixes, service packs and security patches in windows networking stack across all versions of windows - NT, 2k, 2k3, XP, Vista and windows 7. Developed and tested compound TCP congestion control algorithm for high RTT links. Worked on black hole router detection and PMTU detection logic. Wrote multiple fuzzing tools to actively find security holes in windows networking stack. Got an award from Microsoft security response center for shipping 30+ security patches in windows.
TCP/IP stacksecurity patchescongestion control algorithmSoftware DevelopmentNetworking

Solidcore systems

Software Engineer

Jun 2005Sep 2006 · 1 yr 3 mos · New Delhi, Delhi

  • Worked on file system filter driver for flagship product of the company. Implemented features to parse windows binaries and create meta data for them. Designed and developed trie data structures for storing this meta data for all the files in the system while giving hooks for capabilities to update it during upgrade process. Also build a tool call scanalyzer to extract vital system information from customer's machine for diagnostic purposes. Fixed several bugs in the product with high quality.
file system filter drivermetadata parsingdiagnostic toolsSoftware DevelopmentSystems Engineering

Education

Indian Institute of Technology, Delhi

Bachelor's degree

Jan 2001Jan 2005

Stackforce found 100+ more professionals with Networking & Ai Infrastructure

Explore similar profiles based on matching skills and experience