Mohit Kumar

Engineering Manager

Bengaluru, Karnataka, India12 yrs 7 mos experience

Highly Stable

Key Highlights

Expert in AI infrastructure and LLM development.
Proven leadership in advancing complex software systems.
Strong background in team building and talent management.

Stackforce AI infers this person is a leader in AI infrastructure and data streaming technologies.

Contact

Skills

Core Skills

Large Language Models (llm)InferenceDistributed SystemsTechnical Leadership

Other Skills

CILLM TrainingObservabilityStrategic PlanningPeople ManagementHiringRecruitingLeadershipTeamworkCoachingCData StructuresLinuxAlgorithmsC++

About

At Cerebras Systems, my focus has been on cultivating an environment that fosters innovation in AI infrastructure. Our team's success in developing multimodal and inference cloud solutions stems from a deep understanding of data preprocessing and the LM Eval Harness, enabling high-performance AI model training and evaluation. Previously at Confluent, I led a talented team in advancing Confluent Cloud and Platform's capabilities, including Cluster Linking and private networking features. This experience honed my leadership in engineering complex software systems, underpinning my current mission to merge technical acumen with strategic vision to push the boundaries of AI technology. "Life is like riding a bicycle. To keep your balance, you must keep moving." — Albert Einstein

Experience

12 yrs 7 mos

Total Experience

2 yrs 7 mos

Average Tenure

2 yrs 2 mos

Current Experience

Cerebras systems

Engineering Manager

Mar 2024 – Present · 2 yrs 2 mos · Bengaluru, Karnataka, India · On-site

At Cerebras Systems, I played a pivotal role in building a high-performing engineering team from scratch and developing critical infrastructure for LLM benchmarking and model quality.
I led initiatives to enhance CI processes and established a campus outreach program with IIIT Bangalore. My efforts resulted in a streamlined new hire onboarding process and improved performance management, ensuring we maintained a high talent bar.
I lead customisation & Model Delivery (C&MD) team which is responsible for deploying LLM (Llama - 8b/70b/Scout/Maverick, Qwen3-coder/thinking/instruct, OpenAI OSS) in inference mode. The Team ensures high model quality & performance on WSE (Wafer Scale Engines), onboards new evaluations in automated infrastructure. Team heavily deals in LLM evaluations and inference metrics.

Large Language Models (LLM)inference

Confluent

Engineering Manager

Nov 2020 – Feb 2024 · 3 yrs 3 mos · India

Leading a team of highly performant and talented software developers.
Worked on:
Cluster Linking in Confluent Cloud and Confluent Platform
Confluent Cloud - v2 peering, private DNS, private links
C3 SSO, CP OAuth

Distributed SystemsTechnical Leadership

Nutanix

Staff Engineer

Dec 2017 – Nov 2020 · 2 yrs 11 mos · Bengaluru, Karnataka, India

Nutanix Openstack driver development, automation development and testing for Pike and Queen releases, end-to-end, using Python.
AHV (Acropolis Hypervisor) networking, Xi virtual networking, EW firewalls, OVS

Vmware

Member of Technical Staff

Dec 2014 – Dec 2017 · 3 yrs

1. Kubernetes & NSX-T integration
2. PCF (Pivotal Cloud Foundry) & NSX-T integration
3. One patent application for enhancement in multipath routing [Granted]
4. Routing/Micro-segmentation on NSXv & NSX-T
5. Earned VCIX-NV (VMware Certified Implementation Expert - Network Virtualization)
6. Multiple spot awards