Jason Soo Hoo

CTO

Menlo Park, California, United States16 yrs 6 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Over 12 years in software and machine learning engineering.
Led teams of 40+ in high-impact AI/ML projects.
Proven track record in scaling engineering organizations.

Stackforce AI infers this person is a leader in AI/ML engineering with extensive experience in cloud computing and logistics.

Contact

jthoo100781@yahoo.com LinkedIn

Skills

Core Skills

Generative AiSoftware Engineering ManagementMachine LearningEngineering ManagementBusiness StrategySoftware DevelopmentCross-functional Team LeadershipWeb Development

Other Skills

.NET FrameworkAI DataAgile MethodologiesAmazon Web Services (AWS)Apache KafkaApache SparkArtificial Intelligence (AI)Business RequirementsC#Cloud ComputingCode ReviewData IngestionDatabasesDigital StrategyDistributed Computing

About

I have over 12 years of experience in software and machine learning engineering with proven senior engineering leadership for multiple $100+ million businesses across Gen AI, "Classical" AI/ML, and supply chain. Global leadership experience of teams of 40+. My objective is to build and scale high-performing Al/ML engineering organizations, and foster the continual professional growth and development of my teams.

Experience

Google

2 roles

Gen AI Engineering Manager

Promoted

Feb 2025 – Present · 1 yr 1 mo · Hybrid

Nov 2025 - Present: I am leading a new team focused on generative AI multimodal use cases. Our mission is to accelerate the development of SOTA multimodal models through improved 1P and 3P data and drive faster integration of SOTA models within Google's products. Our efforts span across pretraining, posttraining, and automatic prompt optimization.
Feb - Nov 2025: I lead a team focused on developing data processing integrations with machine learning frameworks. We build tools to boost development velocity and optimize accelerator utilization for cutting-edge Gen AI models. Our efforts improve experimentation and production processes, aligning with Google's mission to advance generative AI in both 1P (Gemini, Bard) and 3P (Vertex, Google Cloud Customer) products.

AI DataGenerative AIMultimodalLarge Language Models (LLM)Software Engineering Management

Software Engineering Manager

Dec 2023 – Feb 2025 · 1 yr 2 mos · Hybrid

Leading AI Platform development for GKE, with the goal of making GCP the go-to cloud provider for AI/ML applications. My team's two focus areas are:
1) Ray on GKE (and K8s) - making k8s and GKE the most efficient, easiest to use, platform to run Ray while also integrating Google Cloud's differentiated features (TPUs, fast storage, checkpointing) We have released multiple improvements to OSS Ray and KubeRay, and our own Ray add-on for GKE. This has seen excellent customer adoption, going from 0 -> 1 over the past year, with XX customers using our features on GKE and achieving > 500% growth in TPU/GPU hours.
2) GKE HyperCompute Clusters - allow users to create clusters for AI workloads with minimal configuration. Clusters are setup according to best practices. This is all in service of letting our customers focus on what delivers their business value - their AI workloads - and not worrying about AI infrastructure.

Machine LearningEngineering ManagementArtificial Intelligence (AI)

Career Break

Oct 2023 – Nov 2023 · 1 mo · San Francisco Bay Area

Parenting, travel through Scandinavia and the Arctic Circle, consulting on LLM/NLP AI/ML projects.

Affinity.co

Director of Software Engineering and Machine Learning Engineering

Apr 2023 – Sep 2023 · 5 mos · Menlo Park, California, United States · Hybrid

AI/ML and software engineering leadership in LLM, Gen AI, and NLP, improving deal flow and sourcing for venture capital and private equity. Lead 2 senior engineering managers and 20+ ICs.
Created ML strategy for custom ML models leveraging NLP and LLM / Gen Al for personalized recommendations to venture capital and private equity workflows.
Created and implemented strategy to decrease time to market by 20% by utilizing AWS and Databricks ecosystems.
Standardized hiring, evaluation, and mentoring practices across the organization.

Business StrategyMachine LearningSoftware ArchitectureEngineering ManagementArtificial Intelligence (AI)

Amazon

Software Development Manager

Aug 2022 – Mar 2023 · 7 mos · Palo Alto, California, United States

Led experimentation, development, and scaling of AI/ML demand forecasting models for Physical Stores, delivering $30+ million free cash flow.
Directed development of ML revenue forecasting application, saving over 2,500 hours of finance labor annually.

Software DevelopmentDistributed ComputingMachine LearningSoftware ArchitectureEngineering ManagementArtificial Intelligence (AI)

Walmart global tech

Senior Software Engineering Manager II

Jul 2019 – Aug 2022 · 3 yrs 1 mo · Bentonville, Arkansas, United States

Directed development of novel ML freight consolidation and routing solutions, resulting in $50+ million cost savings.
Founded and scaled teams that delivered $300+ million revenue, monetizing Walmart's transportation services.
Led 5 cross-cultural teams of 40+ people across the US and India, including two senior engineering
managers.

Cross-functional Team LeadershipDistributed ComputingMachine LearningSoftware ArchitectureEngineering ManagementArtificial Intelligence (AI)

Esolutionsgroup

3 roles

Director Of Engineering

Promoted

Jan 2015 – Jul 2019 · 4 yrs 6 mos · Waterloo, Ontario, Canada

Led software engineering and product management. Built public sector digital website and mobile app business to $15+ million annual recurring revenue.

JavaC#Software DevelopmentSoftware ArchitectureWeb DevelopmentEngineering Management

Software Engineering Manager

Promoted

Jan 2013 – Dec 2014 · 1 yr 11 mos · Waterloo, Ontario, Canada

Created framework of reusable components to quickly create websites which is extensible to user needs,
reducing delivery time from 14 days to 3 days (> 75%).
Led a tiger team of 5 people and executed a scalable streamlined website for elections information and
results which reached 80+% of the Canadian population.

JavaC#Software ArchitectureWeb DevelopmentEngineering ManagementSoftware Development