Arpit Singh — Senior Software Engineer

I work as an Applied Machine Learning Engineer in the Artificial Intelligence Research organization at NVIDIA, specializing in AI platform and building scalable services for large-scale deep learning applications. My recent work includes agentic evaluations, retrieval-augmented generation (RAG) evaluations, and advanced LLM evaluation frameworks to assess accuracy and performance. In the last five years, I have also specialized in artificial intelligence infrastructure on distributed systems at NVIDIA, focusing on building services for large-scale deep learning model training. I have over a decade of experience spanning Cisco, Nutanix, and NVIDIA, bringing a wealth of expertise in AI infrastructure, networking, and distributed systems. I hold two granted patents and have seven more pending, and I have contributed to Kubernetes as an open-source contributor, including work that shipped in production releases. Academically, I hold dual master’s degrees—one in Computer Science from Stony Brook University and another in Electronics and Communication from IIT Roorkee—and I am currently pursuing graduate professional courses in AI from Stanford University. I believe that the breadth of my experience across AI infra, networking, and compute, combined with the depth of my expertise in each domain, enables me to wear many hats and deliver impact across diverse organizational and business needs. Key Strengths: LLM evaluations, AI infra, Distributed systems, Operating systems generalist, API design, Kubernetes, Docker containers, Envoy Languages : Golang, Python, C/C++, bash Patents: 1) https://patents.google.com/patent/US20190235900A1 2) https://patents.google.com/patent/US20200150950A1/en 3) https://patents.google.com/patent/US20200045116A1

Stackforce AI infers this person is a Cloud Computing and AI Infrastructure expert with extensive experience in distributed systems.

Location: Sunnyvale, California, United States

Experience: 13 yrs 2 mos