Sep 2022 – Present · 3 yrs 6 mos

• Azure Modeling and Simulation Workbench
• https://learn.microsoft.com/en-us/azure/modeling-simulation-workbench/modeling-simulation-workbench-overview
• Leading various tracks in developing the v1 of Azure MSWB.

Sep 2021 – Sep 2022 · 1 yr

• Azure Synapse ML
• I played a key role in the design of containerized model prediction on Azure Synapse.
• Contributed to enabling hyper parameter optimization, designing the platform wide telemetry and onboarding model prediction on PowerBI Trident.

Apr 2020 – Aug 2021 · 1 yr 4 mos

• Azure Open Supply Chain Platform
• I was one of the first hire in the team and got the opportunity to build Azure Open Supply Chain Platform (OSCP) from ground up.
• I was a core member of OSCP’s Data Platform team where I led the design and development of fundamental building blocks of the platform. The platform supported various capabilities like data ingestion and export, cross-tenant data sharing, schema and model management to name a few.
• Right from the initial stages until the product’s private preview and further, I worked extensively with PMs and with customers to understand their pain points and to reiterate on the feedback in making sure that we are solving the right problem.

Dec 2021 – May 2022 · 5 mos · Remote

• Helped engineers with data structures, algorithms and system design.

Oct 2019 – Apr 2020 · 6 mos

• Flipkart Data Platform

Apr 2018 – Sep 2019 · 1 yr 5 mos

• Flipkart Data Platform

Oct 2017 – Apr 2018 · 6 mos · Bengaluru Area, India

• Worked on the design for multi-tenant ingestion.
• Designed and developed a data processing platform to support SQL workloads at a high scale.
• Technologies/Languages : Spark, Spark Streaming, SparkSQL, Kafka, Scala, Python, S3, Redis

Nov 2016 – Sep 2017 · 10 mos · Bengaluru Area, India

• Worked on developing and scaling a self-serve Analytics Platform.
• Developed a streaming platform using Spark Streaming to process ~2M events/min in near real time.
• Worked on productionizing a low latency data query platform using Presto and Alluxio.
• Designed and developed an Orchestration framework to schedule and run ETL and Analytics jobs on Azkaban.
• Worked on migration of all the Data Engineering components from AWS to Azure.
• Technologies/Languages : Spark, Kafka, Scala, Presto, Alluxio, S3, Redshift, Secor, Redis, Aerospike, Python, SQL, Memsql.

May 2016 – Oct 2016 · 5 mos · Bengaluru Area, India

• Amazon AppStore and Amazon Alexa.
• AppStore: Being a part of the the ingestion team, worked on policies for verifying app content and features.
• Alexa: Worked on developer communication automation.

Jul 2015 – Apr 2016 · 9 mos · Bangalore Area, India

• Worked on developing a platform to support near real time processing of data using Spark Streaming.
• Worked on enabling data ingestion from various sources across Flipkart.
• Worked on the migration of Insights Platform from Hadoop to Spark.
• Technologies/Languages used: Spark, Spark Streaming, Hadoop, HBase, Kafka, Scala, Java, Hive.

Jan 2015 – Jun 2015 · 5 mos · Bangalore Area, India

• Worked primarily on Dockerizing a distributed environment comprising of Hadoop, HBase, Hive, Zookeeper and MySql.
• Won the most 'Business Relevant Hack' in the annual HackDay.
• Technologies/Languages : Hadoop, HBase, Hive, Zookeeper, MySql, Java.