Amit Marathe — Director of Engineering
I am passionate about leading geographically distributed ML teams to build and scale innovative multimodal LLM and GenAI solutions. My focus is on enabling the infrastructure that allows these technologies to solve real-world problems and make a difference. I am dedicated to bringing cutting-edge LLM research to life through practical applications. My focus is on bridging the gap between research and production for LLMs, leading the development of end-to-end infrastructure for productionization, from pre-training to launch governance, including fine-tuning tools, evaluation tools and multi-agent systems. I have experience in optimizing LLM serving and training efficiency using various techniques, including compiler and scheduler optimizations, quantization, and other inference optimization methods I've collaborated closely with Google DeepMind on several initiatives, bringing research advancements into production and contributing to the development of cutting-edge GenAI models. I'm a strong leader with experience in building and leading high-performing global teams of ML engineers, SWEs and TPMs, driving successful project delivery and business outcomes. I believe in fostering a collaborative engineering culture, which is why I built the BrickML community, connecting over 1,500 Googlers with hands-on experience across the end-to-end ML stack. I also lead hackathons to drive innovation and boost team morale, encouraging everyone to learn, experiment, and grow. Key Skills & Technologies: GenAI & LLMs: LLM productionization, model training and deployment, pre-training infrastructure, fine-tuning tools, evaluation tools, agents, multi agent systems, launch governance Cloud Platforms: Google Cloud, AWS, Azure Software: Python, C++, TensorFlow, PyTorch, Jax, scikit-learn, Kubernetes, Docker, Data Engineering: Spark, Hadoop, Synapse, AzureML
Stackforce AI infers this person is a leader in AI and ML infrastructure development.
Location: San Francisco, California, United States
Experience: 25 yrs
Skills
- Large Language Models (llm)
- Machine Learning
Career Highlights
- Led global ML teams to innovate GenAI solutions.
- Bridged research and production for LLMs.
- Founded BrickML community for ML collaboration.
Work Experience
Director, Core ML (4 yrs 4 mos)
Inseego Corp
Director of AI & ML (2 yrs)
HP
Senior Manager (Section Manager), AI & Data Science (6 yrs 8 mos)
ZOLL Medical Corporation
Senior Software Engineering Manager (2 yrs 1 mo)
Boston Scientific
R&D Manager, Software Engineering (8 yrs 11 mos)
Wipro Technologies
Software Engineer (1 yr 1 mo)
Tektronix
Software Intern (5 mos)
BARC
Intern (3 mos)
Education
Master of Science - MS at University of Michigan
Self Driving Car Nano Degree at Udacity
Bachelor of Engineering - BE at Birla Institute of Technology and Science, Pilani