Soham Ghosh

AI Researcher

Sunnyvale, California, United States9 yrs 11 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in developing multimodal AI models.
  • Strong background in computer vision and reinforcement learning.
  • Proven track record in leading innovative software projects.
Stackforce AI infers this person is a specialist in AI and machine learning, focusing on computer vision and multimodal systems.

Contact

Skills

Other Skills

EngineeringNatural Language Processing (NLP)Product DevelopmentProgrammingWeb Development

About

I am interested in advancing AI through understanding visual content better. Currently, I work in Mistral AI on this mission. Before this, I was in Google Research and Deepmind working on SOTA vision encoders. I also worked as a research associate in Prof Ruslan Salakhutdinov's lab working on SLAM and meta-RL. In the past I have been a founding employee at a insure-tech company, interned at Alexa Smart Home Machine Learning, IBM Research Singapore and mobile analytics startup Quettra.

Experience

Mistral ai

AI Research Scientist

Aug 2024Present · 1 yr 7 mos · Palo Alto, California, United States

  • Multimodal models

Google

2 roles

Senior Software Engineer

Promoted

Apr 2023Aug 2024 · 1 yr 4 mos

  • Google Deepmind
  • Training the most capable multimodal embedding models
  • Improving vision encoders by leveraging self-supervision along with language supervision
  • Large scale vision-language models e.g. Multimodal MUM (https://blog.google/products/search/introducing-mum/) and contrastive representation learning (https://arxiv.org/abs/2212.04979

Software Engineer

Jun 2019Apr 2023 · 3 yrs 10 mos

  • Cloud AI Video Intelligence:
  • Action recognition and localization
  • Video search

Carnegie mellon university

3 roles

Research Associate

Promoted

Dec 2018May 2019 · 5 mos

  • Working on deep neural networks for Simultaneous Localization and Mapping
  • Improving sample-efficiency of meta-reinforcement learning through concurrent rollouts and reward shaping.
  • Advisor: Ruslan Salakhutdinov

Graduate Teaching Assistant - Introduction to Deep Learning

Aug 2018Nov 2018 · 3 mos

  • TA for 11-785 Introduction to Deep Learning (Fall 2018) under Prof Bhiksha Raj
  • Designing homework assignments
  • Holding office hours
  • Conducted recitations on CNNs and VAE
  • Mentoring deep learning project teams.
  • This course is primarily conducted in PyTorch.

Graduate Teaching Assistant - Introduction to Machine Learning

Jan 2018May 2018 · 4 mos

  • TA For 10-601 Introduction to Machine Learning (Masters) Spring 2018 under Prof Matt Gormley
  • Conducted recitations
  • Regular office hours
  • Setting exam questions and grading
  • Specifically focused on MLP, MAP, Naive Bayes, decision trees part of syllabus.

Amazon

Applied Scientist Intern

May 2018Aug 2018 · 3 mos · Greater Seattle Area

  • Implemented neural early fusion and double fusion semantic similarity models in TensorFlow for word-sense disambiguation given context in home automation using voice assistants
  • Used PySpark to process and extract large stream datasets and perform feature processing

Ibm

Research Intern

May 2016Aug 2016 · 3 mos · Singapore

  • Proposed denoising auto-encoder architectures for traffic speed and travel time estimation large urban road networks from sparse raw GPS sensor data implemented in Theano
  • Shape File data fusion from multiple data sources to enhance accuracy of nearest neighbour traffic estimation.

Asia risk transfer solutions

Software Development Lead (Founding Employee)

Feb 2016Jul 2017 · 1 yr 5 mos · Singapore

  • Led development from scratch of web-based large-scale data driven agricultural risk pricing enterprise software with automatic data-cleaning capabilities and visualisations built using AngularJS, Node.js and PostgreSQL for primary insurance companies (Innovation award at 7th Asia Insurance Technology Awards).
  • Developed a full-stack prototype desktop dashboard prototype application for managing parametric insurance products.

Quettra, inc.

Software Engineer Internship

May 2015Aug 2015 · 3 mos

  • Extended internal web tools to be used for tagging and untagging database entries which made the process more efficient.
  • Built a dashboard using AngularJS with graphs drawn using d3.js for viewing analytics data which is part of a product.

Beautyful minds educations

Web Developer

Mar 2012Jun 2012 · 3 mos · Singapore

  • Worked on design of website for company, and back end processing as well as front end development of an intelligent, PHP server based question bank and attendance system for students.

Hwa chong institution

Teaching Intern

Jan 2012Mar 2012 · 2 mos · Singapore

  • Conducted classes for two JC1 classes for a term, teaching H2 level Mathematics, and also handled administrative work for the Mathematics department.

Education

Carnegie Mellon University

Master of Science (M.S.) — Computational Data Science

Jan 2017Jan 2019

Nanyang Technological University Singapore

Bachelor of Engineering (BEng) — Renaissance Engineering Programme

Jan 2012Jan 2016

University of California, Berkeley

Exchange Program — Computer Science

Jan 2014Jan 2015

Raffles Institution

GCE 'A' Level

Jan 2008Jan 2011

Stackforce found 100+ more professionals with Engineering & Natural Language Processing (NLP)

Explore similar profiles based on matching skills and experience