Sep 2022 – Present · 3 yrs 9 mos · Seattle, Washington, United States · On-site

• Architected Conversation History, the core conversational-memory service for Alexa+, enabling seamless context transfer between agents and sustaining human-scale multi-turn dialogue.
• Built a real-time context-compression pipeline that trims conversation history by 83% tokens, cutting median LLM inference latency and reducing hallucinations while preserving recall.
• Implemented incremental pagination with server-side prompt caching for the live dialogue window.
• Created a declarative history-rules framework that lets agents inject runtime filters on stored context, boosting answer accuracy across Alexa+.
• Invented and launched a state-of-the-art prompt-optimization technique that abbreviates action and argument tokens, cutting LLM output length and trimming 200 ms off each Alexa+ inference while preserving prediction accuracy, measurably accelerating end-to-end response times.
• Spearheaded Bring-Your-Own-Content, by which, developers/enterprise customers can ingest their data and have Alexa answer questions from it by performing Retrieval Augmented Generation.
• Developed a multi-tenant service with a ML document ingestion pipeline, LLM Tool registration workflow and a ML vector store, enabling developers to ingest their data and onboard Search Tool(s) on to Alexa.

Dec 2020 – Jan 2022 · 1 yr 1 mo

• Created a Build Platform used by hundreds of thousands of third-party Alexa Skill Developers across the globe for building Alexa Skills. More than a dozen ML teams in Alexa use this platform and its APIs to offer their advanced ML capabilities to third-party developers.
• Currently, leading a team of engineers to build ASK CLI, Alexa Conversation Description Language and a bunch of new capabilities for Alexa's offline and online developer tools.

Dec 2017 – Dec 2020 · 3 yrs

• Created Alexa's Intent History Search API used by thousands top Skill Developers to learn about customer interaction with skills and train their language model for better performance, conceived and created some of Alexa's Dialog Management capabilities used by thousands of Skills, created workflow interruption feature, errors framework, integrated a new AI-driven dialog manager with Alexa Skills Kit and helped bring it to market in 2020.

Oct 2016 – Dec 2017 · 1 yr 2 mos

• Helped bring Amazon's Natural Language Understanding, Speech Recognition, Entity Resolution and Dialog Management features to thousands of developers across the globe through Alexa Skills Kit.

Jul 2015 – Oct 2016 · 1 yr 3 mos