Jul 2022 – Jun 2025 · 2 yrs 11 mos · Bengaluru, Karnataka, India · Hybrid

• SambaStudio: Designed and developed an advanced Large Language Model Operations (LLMOps) platform that allows enterprise customers to securely manage AI operations within their premises. This platform streamlined the deployment, fine-tuning, and management of cutting-edge large language models (LLMs) across both on-premises and cloud environments. It simplified cluster management for custom AI accelerator chips and servers via an intuitive app and SDK, while also supporting large-scale distributed training, fine-tuning, and batch inference tasks.
• o This initiative transformed SambaNova from a hardware-focused company working with research labs into a Full-stack enterprise AI solution provider.
• o Platform showcased exceptional performance, including running the latest Llama models as OpenAI-compatible inference APIs at record-breaking speeds of over 1000 tokens per second, all while maintaining stringent data security within client environments.
• Team Leadership: Led and scaled engineering team, fostering innovation, ownership, and high performance
• Technical Strategy: Defined and executed technical roadmaps aligned with product objectives, scaling from 1 to many on-premise customers
• Architecture: Led architecture and design reviews, ensuring scalable, secure, and high-performing solutions
• DevOps: Spearheaded DevOps and CI/CD adoption, resulting in faster build and validation times.
• Sambaverse: Assisted in designing a system to test and compare responses from hundreds of advanced AI models through a unified endpoint, helping identify the most suitable models for specific applications and greatly streamlining the model selection process.
• o Sambaverse platform leveraged the Composition of Experts (COE) architecture, hosted on SambaStudio at scale, to deliver exceptional flexibility and performance.
• Mentorship: Mentored and coached team of engineers, enabling career growth and technical excellence.

Apr 2021 – Jun 2022 · 1 yr 2 mos · Remote

• Led the initiative to introduce existing cluster deployment for the AI platform with enhanced security policies, improving extensibility and driving adoption, including successful implementations in major financial institutions.
• Engaged in architectural reviews and contributed to improving designs for cross-team features.
• Continued mentorship of senior and junior engineers to enhance team productivity and efficiency.

Oct 2018 – Mar 2021 · 2 yrs 5 mos · Remote

• Build native ML Ops platform that allows customers to seamlessly integrate ML into their automation workflows with minimal effort. It offers simple solutions for building, deploying, managing, and enhancing ML models. Our team developed this solution from the ground up and made it accessible for on-premise, cloud, and air gapped installations.
• o AI Center was the first product in UiPath which we built on Kubernetes using various open source CNCF components and custom-built Java and Python micro services.
• o At the peak of it, SaaS platform was running on a cluster with 500+ nodes spread across multiple availability zones.
• o Filed 3 patents as part of this effort around ML models packaging, delivery and usage of ML models in RPA workflows.
• Led enhancement of platform with RBAC, security, storage support, multi-tenancy as well as support for both cloud and air-gapped deployments, expanding customer reach and adoption.
• Mentored junior engineers, conducted code reviews, and provided architectural guidance, enhancing overall team productivity.

Jul 2016 – Oct 2018 · 2 yrs 3 mos · On-site

Nov 2014 – Jun 2016 · 1 yr 7 mos · On-site

Mar 2014 – Oct 2014 · 7 mos · On-site

Sep 2012 – Mar 2014 · 1 yr 6 mos · On-site

Jul 2011 – Aug 2012 · 1 yr 1 mo · Bangalore · On-site