Shivam Rana

Co-Founder

New Delhi, Delhi, India10 yrs 2 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Led engineering team for Azure OpenAI projects.
  • Founded a startup focused on AI control planes.
  • Developed innovative solutions for large-scale LLMs.
Stackforce AI infers this person is a SaaS-focused Senior Software Engineer with expertise in AI and LLM technologies.

Contact

Skills

Core Skills

AiLarge Language Models (llm)

Other Skills

AI AgentsPython (Programming Language)ProgrammingAlgorithmsSoftware DevelopmentMathematicsWeb DevelopmentCLinuxPHPCSSC++JavaScriptMySQLHTML

Experience

10 yrs 2 mos
Total Experience
2 yrs 1 mo
Average Tenure
1 yr 9 mos
Current Experience

Microsoft

Senior Software Engineer

Jul 2024Present · 1 yr 9 mos · Noida, Uttar Pradesh, India

  • Part of the Azure OpenAI Engine team, working on large-scale LLM inference and reliability and leading a team of 3 engineers.
  • Designed and built a reusable distributed agent orchestration framework, adopted by multiple internal teams to accelerate debugging, operations, and incident response.
  • Developed and deployed agents for:
  • Automated identification and resolution of engine bugs
  • Faster triage and resolution of customer issues
  • Detecting GPU loss and inefficiencies caused by inference engine crashes
  • Reduced manual debugging effort and shortened incident resolution times across Azure OpenAI workloads.
AIAI AgentsPython (Programming Language)Large Language Models (LLM)

Stealth startup

Co-Founder

Sep 2023Jun 2024 · 9 mos · New Delhi, Delhi, India

  • Founded and led a small engineering team to build an AI control plane for operating multiple LLMs through a single API.
  • Hired and mentored engineers and drove execution from concept to MVP. Built systems for LLM routing, observability, rate limiting, safeguards, fallbacks, and experimentation.
  • Conducted customer discovery and early pilots. Ultimately paused the product due to limited go-to-market traction for a developer-focused infra tool.

Google

Software Engineer

Jul 2019Aug 2023 · 4 yrs 1 mo · Bengaluru, Karnataka, India

  • Designed and developed the first version for personalized featured carousels on the Google TV home screen.
  • Led the engineering team for Play/Youtube movies partner portal. Worked closely with major film studios to improve the overall experience of the portal.
  • Drove quality and reliability efforts in Google Ads (Local Ads), leading initiatives that improved key advertiser metrics.

Flipkart

Software Engineer II

Feb 2017Jul 2019 · 2 yrs 5 mos · Bengaluru Area, India

  • Led Flipkart’s IVR platform and customer contact routing team.

Codenation

Software Development Engineer

Jun 2015Aug 2016 · 1 yr 2 mos · Bengaluru Area, India

Hackerrank

Summer Intern

Jun 2014Jul 2014 · 1 mo · Bengaluru Area, India

Education

Jaypee University of Engineering and Technology, Guna

Bachelor of Technology (BTech) — Computer Science

Jan 2011Jan 2015

Stackforce found 100+ more professionals with Ai & Large Language Models (llm)

Explore similar profiles based on matching skills and experience