Mar 2026 – Present · 3 mos

• • Building an event-driven automation system to streamline vendor data intake by automating AWS infrastructure provisioning, security scanning, data validation workflows, data transfer, and dataset catalog registration.

Jun 2023 – Feb 2026 · 2 yrs 8 mos

• Built a unified LLM & RAG evaluation framework at NVIDIA, streamlining fragmented tools into a single extensible platform. Supports academic/custom benchmarks, LLM-as-a-judge, safety/security evals, and diverse model backends (NeMo, HuggingFace, Llama, OpenAI, DeepSeek, etc.).
• Worked on data acquisition from external vendors for Physical AI and robotics training, and on web scraping pipelines for LLM training datasets.
• Led the design and development of NVIDIA Eval Factory — a unified platform to build, certify, and operationalize standardized LLM evaluation benchmarks across the company.
• Built an automated ASR evaluation pipeline on Kratos (Kubeflow), reducing evaluation time from 2–3 weeks to just 1–2 days.
• Drove a 90%+ reduction in dataset processing time by parallelizing the TTS data pipeline (leveraging vertical and horizontal scaling on large-scale GPU infrastructure) and enabling archive-based uploads. This optimization allowed 28 English datasets to be processed in just 2–3 days instead of months, a 10× improvement. This pipeline was later used to process 100+ datasets across multiple languages.
• Designed and developed an Evaluator Microservice using Python FastAPI and PostgreSQL to externalize API-based LLM evaluation capabilities for enterprise users.
• Created an OpenAI API-compatible Inference API Server for NVIDIA's TensorRT-LLM Engine.
• Improved evaluation observability and reliability by designing and implementing a progress tracking solution within the Evaluator Microservice.
• Designed and developed CI/CD pipelines and testing frameworks for MLOps projects.
• Integrated the LLM eval-tool into customers' CI/CD pipelines to automate model evaluations.
• Authored the NTech paper titled "NeMo Eval Tool: A Unified Evaluation Framework for LLMs and Retrievers/RAGs," which was selected as a Software Paper for NVIDIA's NTech India presentation
• Filed and received acceptance for U.S. patent for Evaluator Microservice

Oct 2019 – May 2023 · 3 yrs 7 mos

• 🐳 Kubernetes & Infrastructure Management
• Engineered a zero-impact Kubernetes upgrade controller that successfully upgraded 100+ clusters (e.g., v1.18 to v1.22) without disrupting long-running deep learning pods
• Built a scalable workflow engine using Temporal and Golang to automate infrastructure provisioning, Kubernetes setup, and workload deployments, supporting 100+ concurrent task execution
• Developed a web service to streamline cluster/application deployments, cutting Nvidia BCP cluster provisioning time from days to hours
• Automated Kubernetes deployment on NVIDIA GPU platforms (H100, A100, DGX) using Infrastructure-as-Code
• Developed an autopilot for automatic Kubernetes SSL certificate renewal. It reduced the number of broken clusters caused by expired certificates
• Developed Helm charts for Kubernetes application deployments
• 🚀 CI/CD & DevSecOps Platform Development
• Designed and built a security service that helps developers detect and remediate security vulnerabilities before release, including container scans, dependency scans, static code analysis, secret detection, and IaC security checks
• Built a managed CI/CD platform to ensure seamless integration, deployment, security, and testing of applications throughout their lifecycle
• Created a test framework for the DevSecOps service using PyTest and GitlabCI, which reduced manual testing time by 93%
• Developed Jenkins and GitLab CI pipelines to automate DevOps & CICD operations
• ⚙️ Automation & Tooling
• Developed a Host State Management solution for software deployment in air-gapped and non-air-gapped environments
• Created a self-service framework for tenant onboarding to AWX(Ansible Tower), reducing manual onboarding time and boosting customer satisfaction
• To increase speed of cluster operation and minimize downtime due to manual errors, developed automation for infra and k8s management
• Built a CLI for HashiCorp Vault secret migration to enable secret management in external Data Centers