Mar 2020 – Present · 6 yrs 3 mos · Bellevue, Washington, United States

• AI & Search
• Took ownership of the Global Load Balancer and quota management system for teams accessing LLMs in the AI org. Made it model agnostic due to which it now seamlessly supports ~150 models (including their variants).
• Added tools to make it more resilient against live sites.
• Worked to increase stability of Bing’s streaming index from 97% to 99.9%.
• Mentored junior engineers and drove technical excellence through code reviews and design sessions

Sep 2017 – Feb 2020 · 2 yrs 5 mos · Bellevue, Washington, United States

• Bing it!
• Co-implemented the first streaming semantic index (ANN) index for Bing. Closely worked with hardware teams to leverage network FPGAs for nearest neighbor computations. This led to major relevance gains Also created software fallback of the entire FPGA logic by leveraging Intel’s AVX 512 instructions. These made the computation 8x faster.

Nov 2015 – Aug 2017 · 1 yr 9 mos · Bellevue, Washington, United States

• Bing it!
• Helped on integrating BitFunnel, (a text based search engine) into Bing’s fresh streaming index for Web, News & Multimedia. Took ownership of the training pipeline and created selection models which consumed 30% less memory and reduced latencies by 20%.

May 2013 – Jul 2013 · 2 mos · Hyderabad Area, India

• Removed gaps in BizTalk’s Provisioning Service to make it Product Agnostic. Improved Scalability by enabling the PS’s schedular components to work simultaneously on independent deployments. Added a layer of abstraction so that the PS could receive and identify CRUD operations.