Shoubhik Debnath

Software Engineer

Santa Clara, California, United States11 yrs 10 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in multimodal learning and visual grounding.
  • Led significant projects in robotics and AI at NVIDIA.
  • Strong background in deep learning and simulation technologies.
Stackforce AI infers this person is a Robotics and AI Research Specialist with a focus on deep learning and simulation technologies.

Contact

Skills

Core Skills

Machine LearningDeep LearningComputer VisionRoboticsSoftware Development

Other Skills

.NET3D ModelingAlgorithmsAutoencodersAutonomous VehiclesCC#C++CSSCascading Style Sheets (CSS)Cloud ComputingComputer ScienceCore JavaData ScienceData Structures

About

I am a Research Engineer working on Perception at Meta Superintelligence Labs (MSL). My interests include multimodal learning, visual grounding, sim2real transfer learning, self-supervised representation learning. Prior to Meta, I contributed to the research and development of robotics and autonomous vehicles simulation efforts at NVIDIA. I am excited about deep learning and a strong believer of it's potential to solve day-to-day challenging problems.

Experience

Facebook ai

Research Engineer, MSL

Jan 2022Present · 4 yrs 2 mos · Menlo Park, California, United States

  • My current research is focused on multimodal learning, visual grounding. Some of my recent works include,
  • 1) SAM 3: Core-contributor of state-of-the-art model segmentation model.
  • 2) Llama 4: Contributor, enabled image grounding capabilities.
  • Previously, I contributed to research projects around representation learning (ConvNext V2), 3D (PointInfinity) and scaling MAE (Exploring long-sequence masked autoencoders). I have also been involved in Meta AI research projects like SAM 2, Llama 3.
multimodal learningvisual groundingself-supervised representation learningMachine LearningDeep Learning

Nvidia

2 roles

Senior Research And Development Engineer

Promoted

Jun 2020Jan 2022 · 1 yr 7 mos

  • Contributed to the research and development of below projects.
  • 1. ISAAC SIM, DRIVE SIM - NVIDIA's simulation platform based on Omniverse for robotic systems and autonomous vehicles.
  • 2. My primary research focus is around Sim2Real transfer learning to address the domain gap problem via techniques like domain randomization, self-supervised learning, domain adaptation.
  • My area of work is at the intersection of robotics, computer vision, simulation and deep learning.
Sim2Real transfer learningdomain randomizationself-supervised learningdomain adaptationRoboticsDeep Learning

Research and Development Engineer 2

May 2018May 2020 · 2 yrs

  • Project Isaac Sim: Robotics, Simulation and Deep Learning
RoboticsSimulationDeep Learning

Robotic embedded systems laboratory, university of southern california

Robotics Student Researcher

Aug 2017May 2018 · 9 mos · Los Angeles, California

  • Advised by Professor Gaurav Suhkatme and Professor Lantao Liu
  • Designing and developing novel reinforcement learning algorithms for efficient path planning for underwater marine vehicles.
reinforcement learningpath planningRobotics

Amgen

Software Engineering Intern

May 2017Aug 2017 · 3 mos · Thousand Oaks, California

  • 1. Automated Vision Inspection via Deep Learning: I was the technical lead for the project. I developed a machine learning algorithm using Google’s Tensorflow that can adaptively learn to classify between defective/ non-defective images of syringe or vials. This approach enhanced the vision system by reducing the number of ejects by around 30% which eventually saved both time and money for Amgen.
  • 2. Virtual Tour: Developed a generic framework for virtual tour using Unity that can be deployed in multiple platforms like iOS, Android mobile app or deployed as a WebGL app. This can be leveraged for orientation for new hires or general demonstration to any audience.
  • 3. 3D Molecule Visualization: Contributed to a tool named UnityMol using Unity and C# for scientists at Amgen to visualize and interact with molecule in a virtual environment using VR devices like HTC VIVE, Oculus Rift.
Deep LearningMachine LearningUnitySoftware Development

Interaction lab, university of southern california

Robotics Student Researcher

Sep 2016May 2017 · 8 mos · Los Angeles, California

  • Advised by Professor Maja Mataric
  • 1. Contributed to the development Kinect Bridge that enables transfer of messages from Microsoft Kinect on the Windows end (Server) to ROS messages at the Ubuntu end (Client).
  • 2. Build computational techniques that will enable social robots to encourage social and cognitive growth in children, including those with social or cognitive deficits.
KinectROSRobotics

Microsoft

Software Engineer

Jul 2014Jul 2016 · 2 yrs · Hyderabad Area, India

  • 1. Cloud Based ETL Framework: Developed a cloud based solution on Azure that reduced the deployment time for ETL related entities by 80%. Gave a talk at Microsoft’s Machine Learning, Analytics and Data Science (MLADS) Conference.
  • 2. Let's Envisage: Lead a team of 4 to build a tool that smartly assigns work items to members of team for particular sprint using machine learning. The project was started by me as a side project in order to solve a day-to-day problem in software industry that eventually drove interest among the Microsoft community globally. I eventually filed a patent for the same at Microsoft.
  • 3. Manage Rewards and Promotions Tool: Contributed to Microsoft's appraisal tool which is currently used by 20000 managers across Microsoft. I contributed to backend application development using SQL Server 2014 and service layer using .NET and Visual C#.
Cloud ComputingMachine LearningSQL.NETSoftware Development

Technical university munich

Robotics Student Researcher

Jan 2014Jun 2014 · 5 mos · Munich Area, Germany

Microsoft

Software Engineer Intern

Jun 2013Aug 2013 · 2 mos · Hyderabad Area, India

Education

University of Southern California

Master of Science (MS) — Computer Science (Data Science)

Jan 2016Jan 2018

Indian Institute of Technology, Mandi

Bachelor of Technology (BTech) — Computer Science and Engineering

Jan 2010Jan 2014

Technical University of Munich

Bachelor Thesis — Computer Vision Group - Prof. Daniel Cremers

Jan 2013Jan 2014

Holy Cross School, Agartala

ISC — Science

Stackforce found 100+ more professionals with Machine Learning & Deep Learning

Explore similar profiles based on matching skills and experience

Shoubhik Debnath - Software Engineer | Stackforce