Pratik Bhavsar

Co-Founder

India9 yrs 10 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • Authored four influential books on AI engineering.
  • Led the development of key AI benchmarks.
  • Founded a community for AI engineers.
Stackforce AI infers this person is a highly skilled AI engineer with expertise in NLP and generative AI.

Contact

pratik.a.bhavsar@gmail.comLinkedIn

Skills

Core Skills

Ai EvaluationGenerative AiNlpMlops

Other Skills

RAGAI AgentsLangGraphVibe CodingLarge Language Models (LLM)Artificial Intelligence (AI)BloggingMachine LearningPrompt EngineeringNatural Language ProcessingLangChainSemantic SearchSearch Engine RankingTransformersDeep Learning

About

I have spent my career working across the AI stack, figuring out what great AI products actually look like in production. Six years with startups have wired me to move fast and care deeply about what ships. Turns out, the teams that build great AI products share a common trait. A rigorous system and a good understanding of how everything connects back to the end product goal. That is what I care about, and it is why I am writing books on AI Engineering. At Galileo, I lead open source evaluations and developer relations. I built the Agent Leaderboard (open benchmark for AI agents on real-world tasks), the Hallucination Index (tracking factual reliability across foundation models), and the BRAG benchmark for RAG evaluation. I have published four books on agents, RAG, multi-agent systems, and LLM evaluation through galileo.ai. But I do not just write about this stuff. I build with it. Vibe coding, agent engineering, agent harness design, benchmarking from scratch. If there is a new way to stress-test AI in production, I have probably tried it and written about it. Before Galileo, I was a founding engineer at Enterpret and built NLP systems at Morningstar. I care a lot about sharing what I learn along the way and write about my opinions at pakodas.substack.com. Outside of all this, I love reading fiction, cooking at home, and gossiping about what is next at maxpool.dev. More about me and my work: pratik.ai Books: Eval Engineering (https://galileo.ai/eval-engineering-book) Mastering Multi-Agent Systems (galileo.ai/mastering-multi-agent-systems) Mastering Agents (galileo.ai/mastering-agents-ebook) Mastering LLM-as-a-Judge (galileo.ai/mastering-llm-as-a-judge) Mastering RAG (galileo.ai/mastering-rag) I founded Maxpool in 2019, now a community of AI engineers building production AI systems. Join us: maxpool.dev Talks: Latent Space podcast, PyData, Dair.ai, WiMLDS Featured: Andrew Ng's newsletter, AI Developers to Watch

Experience

9 yrs 10 mos
Total Experience
2 yrs 4 mos
Average Tenure
7 yrs 3 mos
Current Experience

Galileo

AI Engineer

Jun 2023 – Present · 2 yrs 10 mos · India · Remote

  • Leading evaluation leaderboards for agent and RAG
  • Wrote a book on eval engineering: https://galileo.ai/eval-engineering-book
  • Authored 4 books on GenAI: https://galileo.ai/mastering-genai-series
  • https://galileo.ai/blog/agent-leaderboard-v2
  • https://galileo.ai/blog/agent-leaderboard
  • https://github.com/rungalileo/hallucination-index
RAGAI AgentsLangGraphVibe CodingLarge Language Models (LLM)Artificial Intelligence (AI)+7

Enterpret

Founding engineer - NLP Scientist

Feb 2021 – May 2023 · 2 yrs 3 mos · Remote

  • Employee no. 6 @pre-seed
  • Built semantic search, reranking, text generation, MLOps, NLP pipelines to categorise more than 50k+ topics of customer feedback! A lot of work on auto-labeling and fine-tuning.
Large Language Models (LLM)Prompt EngineeringAI EvaluationMLOpsSemantic SearchLangChain+2

Jina ai

AI Engineer

Sep 2020 – Dec 2020 · 3 mos · Remote

  • Employee no. 6 @seed
  • Worked on the open-source neural search framework - Jina
Search Engine Ranking

Taskhuman

Principal Data Scientist

Oct 2019 – Sep 2020 · 11 mos · Remote

  • Employee no. 15 @seed
  • Lead development of core semantic search using transformers for autocompletion and search.
  • Developed and deployed unsupervised deep learning based recommendation engine
  • Designed personalised notification system
  • Technologies: Python | Pytorch | Elasticsearch | AWS | FAISS
Search Engine Ranking

Maxpool

Founder

Jan 2019 – Present · 7 yrs 3 mos · India

  • http://maxpool.dev
  • An open community of professionals building the future of GenAI.

Morningstar

Senior Data Scientist

Sep 2017 – Oct 2019 · 2 yrs 1 mo · Mumbai Area, India

  • 1st hire in the new quantitative research team
  • Lead full-stack NLP with deep learning
  • Researched and deployed models for financial datapoint extraction from documents using Deep Learning (Evaluated seq2seq, LSTM and CNN with BERT/ELMo)
  • Secured 1st prize at Morningstar Hackathon by developing a ML solution for tabular information extraction
  • Lead inner-sourcing of data science Python libraries
  • Sentiment Analysis of Financial Text Using Deep Learning - BERT/ULMFiT
  • Search and Recommendation engines using Elasticsearch
  • Quantitative Fund Rating using Machine Learning
  • (https://www.morningstar.com/blog/2018/03/05/machine-learning.html)
  • Technologies: Python | Keras | PyTorch | Spacy | scikit | Elasticsearch | AWS | Docker
AI Evaluation

Reckrut.com

Head of Data Science

May 2017 – Aug 2017 · 3 mos · Mumbai Area, India

  • Product strategy | NLP systems
  • Building information extraction system of candidate profile and client data
  • Building analytics to improve the call conversion ratio

Book lovers society (nlp startup)

Founder

Apr 2016 – Apr 2017 · 1 yr · India

  • Worked on developing a search engine to find books by natural language instead of title or author name
  • Launched chatbot for book suggestions on Facebook messenger
  • Strategised digital marketing for advertising the chatbot on Instagram and Facebook
  • Worked with NER to extract intent and give suggestions on specific topics

Education

Indian Institute of Technology, Bombay

Master of Technology (M.Tech.)

Jan 2013 – Jan 2015

National Institute of Technology Surat

Bachelor of Technology (B.Tech.)

Jan 2008 – Jan 2012

Stackforce found 100+ more professionals with Ai Evaluation & Generative Ai

Explore similar profiles based on matching skills and experience

AM

Akshit Madan

Developer Relations Engineer

at Harness

Bengaluru, India3 yrs 5 mos exp
Continuous Integration and Continuous Delivery (CI/CD)Artificial Intelligence (AI)Software DevelopmentCloud ComputingMobile Applications
PK

Prabhakar Kumar

Accumulated Expertise

at Career-Wide Experience

Bengaluru, India0 mo exp
Vimalkumar T

Vimalkumar T

Marketing Consultant

at NocoDB

Bengaluru, India14 yrs 9 mos exp
AI-Driven Project & Time ManagementGenerative AI Integration in MarketingSaaS Marketing with AI Enhancements
Shivam Singh

Shivam Singh

Expert Automation Engineer

at NielsenIQ

India2 yrs 7 mos exp
Sai V J

Sai V J

Technical Team Lead

at ValueLabs

Hyderabad, India12 yrs 3 mos exp
Quality Control
AM

Aparna Mehrotra

Product Technical Lead

at Infosys

Bengaluru, India0 mo exp
Swastik .

Swastik .

ML Intern

at TechnoHacks EduTech Official

Rohini, India0 mo exp
Artificial Intelligence (AI)Machine Learning
MOHAMMAD SHAFEE UR RAHAMAN

MOHAMMAD SHAFEE UR RAHAMAN

Python Engineer – Gen AI Intern

at ADVI GROUP OF COMPANIES

Hyderabad, India0 mo exp
Python (Programming Language)Machine Learning