Nishant Rai

Lead ML Engineer

San Francisco, California, United States8 yrs 4 mos experience
Highly StableAI Enabled

Key Highlights

  • Expert in Multi-Modal Learning and Computer Vision.
  • Led perception research at Waymo for autonomous vehicles.
  • Graduated top of class from IIT Kanpur.
Stackforce AI infers this person is a Machine Learning and Computer Vision expert in the autonomous vehicle industry.

Contact

Skills

Core Skills

Machine LearningArtificial Intelligence (ai)Computer VisionArtificial IntelligenceSelf-supervised Learning3d Geometry ReconstructionSoftware DevelopmentQuantitative AnalysisHuman-robot InteractionMulti View Clustering

Other Skills

Algorithm DesignAlgorithm EvaluationAlgorithmsC++Cloud FrameworksComputational GeometryData ManagementDeep LearningGraph AlgorithmsHuman Action UnderstandingMatlabMulti-Modal LearningMulti-modal foundation modelsNatural Language ProcessingPython

About

Currently at OpenAI, working on research around making models helpful on real world tasks, building and leveraging the rapid advancements in foundation models we've seen in recent times. Previously a Tech Lead in the Perception team at Waymo, focusing on 1. Efficient multi-modal foundation model research, alongside 2. Teaching robots how to understand the most complex agents on roads - humans! I was fortunate to have my time at Stanford funded through research and course appointments. While there, I served as a research assistant in the Stanford Vision and Learning Lab. Before Stanford, I completed my undergrad in CS at IIT Kanpur, graduating top of my class with distinction. Having a soft spot for startups, I've navigated through roles at Waymo, Nuro, Fyusion, Rubrik, and more. I am broadly interested in Computer Vision and Deep Learning applications. While my journey in the field began with a focus on Multi-Modal Learning, it branched into Video Understanding and Self-Supervised Learning, and has recently expanded into Foundation Vision-Language Models. Beyond my professional pursuits, I am a passionate sports enthusiast along with a love for skiing and diving. In quieter moments, I find solace in writing, sketching and immersing myself in books.

Experience

Openai

Member of Technical Staff

Aug 2024Present · 1 yr 7 mos · San Francisco, California, United States

  • Teaching models to perform economically valuable work across large sources of knowledge.
Machine LearningNatural Language ProcessingDeep LearningArtificial Intelligence (AI)

Waymo

Tech Lead at Perception

Jul 2021Aug 2024 · 3 yrs 1 mo

  • Research and development of Multi-modal foundation models for better perception
  • Computer Vision and ML Research for perception models to understand the world around us.
  • Teaching cars how to understand the most complex agents on road aka "Humans"
Computer VisionMachine LearningMulti-modal foundation models

Nuro

Perception - ML Intern

Jun 2020Sep 2020 · 3 mos · San Francisco Bay Area

  • • Working in the Perception team to deploy Machine Learning models enabling our bots to drive!
Machine Learning

Stanford university

3 roles

MS in Computer Science

Promoted

Sep 2019Jun 2021 · 1 yr 9 mos

  • Distinction in Research for my thesis: "Less is more: Reducing the need for supervision"
  • Specializing in Artificial Intelligence: specifically Computer Vision and Machine Learning
  • Fortunate to be funded through course and research appointments
Artificial IntelligenceComputer VisionMachine Learning

Research Assistant: Vision and Learning Lab

Sep 2019Jun 2021 · 1 yr 9 mos

  • Research Assistant at SVL working on approaches reducing the supervision needed for vision models with Dr. Ehsan Adeli, Dr. Juan Carlos, and Dr. Fei Fei Li.
  • Research collaborations with Toyota Research Institute and Panasonic Research.
  • Topics of Interest: Self-Supervised Learning, Multi-Modal Learning, Human Action Understanding, Video Understanding
Self-Supervised LearningMulti-Modal LearningHuman Action UnderstandingVideo UnderstandingComputer Vision

Course Assistant: CS231N ('21, '20) and CS145 ('19)

Sep 2019Jun 2021 · 1 yr 9 mos

  • CA'ed one of my favorite courses to teach throughout my time at Stanford
  • CS231N: Convolutional Neural Networks for Visual Recognition - http://cs231n.stanford.edu/
  • CA'ed CS145: managing course logistics, grading, creating assignments and exams.

Fyusion, inc

ML Research Intern

Jun 2019Sep 2019 · 3 mos · San Francisco Bay Area

  • Worked on weakly-supervised approaches for 3D Geometry Reconstruction from multi-view 2D images.
  • Published "Weak Multi-View Supervision for Surface Mapping Estimation"
3D Geometry ReconstructionWeakly-supervised approaches

Rubrik, inc.

Software Engineer

Jul 2017Jun 2019 · 1 yr 11 mos

  • Contributed to Rubrik's central data management module
  • Parallelized the cloud upload framework resulting in a 3-4x speedup
  • Designed and implemented Rubrik’s first globally distributed SLA framework
Data ManagementCloud FrameworksSoftware Development

Two roads tech

Quantitative Trading Intern

May 2017Jul 2017 · 2 mos

  • Analyzing and designing approaches to leverage open/close gap dynamics in equity prices to build profitable trading strategies.
  • Analyze desirable properties of a gap and formulate ways to model these properties numerically
  • Analyze yield of designed heuristics and utilize ML algorithms to boost profits.
Quantitative AnalysisMachine Learning

The university of british columbia

Research Intern

May 2016Jul 2016 · 2 mos · Vancouver, Canada Area

  • Mentored by Justin Hart, Post Doc and Elizabeth Croft, Head of CARIS Lab, for prediction of single-arm reaching motion by humans in order to create smooth and safe Human-Robot interactions.
  • Designed algorithms to merging point clouds from Kinects at multiple view-points. Supporting project for improving the performance of other setups present in the lab.
Human-Robot InteractionAlgorithm Design

Parc, a xerox company

ML Research Intern

Nov 2015Dec 2015 · 1 mo

  • Mentored by Om Deshmukh, Senior Researcher (Area Manager, Multimedia Analytics), and Sumit Negi, Principal Researcher, for developing and evaluating algorithms for Multi View Clustering using Non Negative Matrix factorization.
  • Published "Partial multi-view clustering using graph regularized NMF".
Multi View ClusteringAlgorithm Evaluation

Inria

Summer Research Intern

May 2015Jul 2015 · 2 mos · Paris Area, France

  • Worked as a summer intern on various projects in graph algorithms at INRIA.
  • Mentored by Laurent Viennot and Adrian Kosowski to explore algorithms to find efficient alternative short routes in massive road networks.
  • Mentored by Adrian Kosowski to find good local features which are suitable predictors for global features in graphs. Research utilized in "Evolving structure of the maritime trade network".
Graph Algorithms

Education

Stanford University

Masters with Distinction in Research — Computer Science

Jan 2019Jan 2021

Indian Institute of Technology, Kanpur

Bachelor's — Computer Science

Jan 2013Jan 2017

Stackforce found 100+ more professionals with Machine Learning & Artificial Intelligence (ai)

Explore similar profiles based on matching skills and experience