Khush Agrawal

Product Engineer

Pittsburgh, Pennsylvania, United States3 yrs 11 mos experience
Most Likely To Switch

Key Highlights

  • Implemented hierarchical RL for real-life dozer control.
  • Developed stair-climbing and assistive robots.
  • Achieved significant performance improvements in RL applications.
Stackforce AI infers this person is a Robotics and Machine Learning specialist with a focus on reinforcement learning applications.

Contact

Skills

Core Skills

Machine LearningReinforcement LearningRobotics

Other Skills

PyTorchJAXCEmbedded SystemsTensorFlowPython (Programming Language)C (Programming Language)MatlabLaTeXGitLinuxROSOpenCVSolidWorksArduino

About

I was previously a graduate student at CMU, working with Dr. Aviral Kumar on scaling offline RL. During the summer of 2024, I worked on autonomous construction, where I implemented a new hierarchical RL method for real-life Caterpillar dozer control, demonstrating improvements in controller time, success rate, and safety. Before graduate school, I worked on reinforcement learning (RL) at CMU as a research associate for two years, focusing on offline RL and deployable model-free RL. During my undergraduate studies, I worked at Professor Shital Chiddarwar’s IvLabs, where I built a stair-climbing robot and an assistive robot. In the summer of 2020, I worked in Professor David Held’s R-PAD Lab as part of the Robotics Institute Summer Scholars program, where I focused on deformable object manipulation.

Experience

3 yrs 11 mos
Total Experience
1 yr 11 mos
Average Tenure
2 yrs 4 mos
Current Experience

Aim intelligent machines

Intern

May 2024Aug 2024 · 3 mos · Seattle, Washington, United States · On-site

  • Deployed a hybrid RL algorithm (abstract MBRL + MFRL) to control real-world dozers
  • Achieved 60% step-time reduction, 25% improvement in success rate, and a principled approach to safety
  • Delivered smooth, dataset-like control behavior, surpassing traditional action-level MPC methods
  • Implemented a scalable ML workflow using a CI/CD pipeline, GCP, Docker, and GitHub actions
RoboticsMachine LearningPyTorchReinforcement Learning

Machine learning department at cmu

Graduate Assistant

Jan 2024Present · 2 yrs 4 mos · Pittsburgh, Pennsylvania, United States

  • With Dr. Aviral Kumar
  • Addressing scalability challenges in value-based offline RL methods by analyzing scaling rules
  • Studying the effect of tokenization in offline RL to improve scalability and performance
  • Implemented distributed training with CQL, AWR, and SAC for transformer models in JAX
  • Employing RL to improve OpenVLA and solving real-world robotic manipulation tasks
Machine LearningPyTorchReinforcement LearningJAX

Carnegie mellon university

2 roles

Research Associate

Sep 2021Apr 2023 · 1 yr 7 mos · Pittsburgh, Pennsylvania, United States

  • Advisor: Dr. Howie Choset
  • Developed a hierarchical reinforcement learning method for temporal abstraction (skill learning)
  • Applied variational autoencoders to implement probabilistic graphical models
  • [With NASA JPL] Utilized constraint optimization to discover parametric gaits for JPL’s EELS (new snake-like morphology) robot
  • Trained RL policies (PPO + domain randomization for sim2real) for locomotion in IsaacGym and deployed on a real-world snake robot
RoboticsMachine LearningPyTorchReinforcement Learning

Robotics Institute Summer Scholar

May 2020Sep 2020 · 4 mos · Pittsburgh, Pennsylvania, United States

  • Worked with Dr. David Held on investigating state representations for deformable objects
  • Trained a deep neural network for learning per-pixel latent descriptors for deformable objects
  • Trained an RL agent (DDPG) to manipulate a fabric using high and low dimensional state based observations
  • Designed a custom Blender-based fabric simulator for downstream manipulation tasks
RoboticsMachine LearningPyTorchReinforcement Learning

Ministry of youth affairs

Delegate

Jul 2019Aug 2019 · 1 mo · Moscow, Russia

  • Aimed at promoting mutual understanding of science, values, and culture to develop international relations.
  • Represented India in an eight-day delegation in Russia.

Ivlabs, vnit

Undergraduate Student Researcher

Jun 2018Apr 2021 · 2 yrs 10 mos · Nagpur Area, India

  • Applied machine learning on robotic-systems to solve real-world problems
  • Developed a person following robot to assist people in carrying payload
  • Developed a novel algorithm for long-horizon object tracking
  • Developed a stair climber robot for indoor navigation
CEmbedded SystemsRoboticsMachine LearningPyTorchReinforcement Learning

Education

Carnegie Mellon University

Master of Science - MS — Robotic Systems Development (MRSD)

Jan 2023May 2025

Visvesvaraya National Institute of Technology

Bachelor of Technology - BTech — Electronics and Communications Engineering

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Machine Learning & Reinforcement Learning

Explore similar profiles based on matching skills and experience