Aug 2019 – Nov 2020 · 1 yr 3 mos

• 1. QDS Azure - Prototyped, built & operated the kubernetes native QDS control plane using Azure Kubernetes Service (azure-eu.qubole.com). Lead the zero down time migration of azure.qubole.com control plane from chef based AWS stack to k8s based Azure stack
• 2. Hybrid QDS - Core member of a team that built a completely kubernates based QDS control plane and data plane.
• a. Containerized Qubole’s DataPlane to run it fully on kubernetes rather than on AWS/Azure/GCP VMs. The hybrid platform could launch presto and spark clusters in irrespective of the cloud.
• b. Also worked on the ability to install Qubole in private clouds via Kubernetes Operators e.g.: Jupyter Operator - Built Jupyter Operator and integrated it with QDS that could spawn a standalone kubernetes based Jupyter Notebooks application which can launch Spark Clusters from the notebook over which customers can run their Machine Learning/Big Data related queries over Hive Metastores.
• c. Worked on presto operator that could launch Presto clusters and integrated it with QDS on K8s platform.
• 3. Worked on making SSH connections from Qubole Control Plane to customer's dataplane fault tolerant. The end goal of this project was that commands submitted by customers should not fail if Qubole's Tunnel service is facing a partial outage. We were able to successfully roll this ability out to production.
• 4. Golang based API Gateway - Built a lightweight and highly scalable Golang based API Gateway. Production rollout involved flipping live traffic from a legacy rails based application to one based on Golang with 0 downtime and around 80% cost reduction.

Jul 2018 – Jul 2019 · 1 yr

• 1. Kube-native QDS control plane - Core member of a team that worked on migrating all the components of QDS control plane from the legacy chef based architecture to a fully microservices based model on Kubernetes. Built Qaas - a CLI to manage the multi cloud and multi environment QDS deployments. Proposed and implemented the build and deploy CI/CD pipelines framework.
• 2. QDS on GCP - Worked on Qubole’s ControlPlane and DataPlane on GCP with the ControlPlane fully on K8s. gcp.qubole.com was the first prod environment in qubole to run fully on K8s.
• 3. QDS in a Box - Only developer working on disposable Dev environments at Qubole. Command line tool to bringup and manage a minimal developer version of QDS stack in a single VM. Gave over 10x improvement in development & testing velocity.
• 4. Project Owner - Led Amazom Linux 1 to Amazon Linux 2 migration of QDS platform

Jan 2018 – Jun 2018 · 5 mos

• 1. Implemented the first ELK stack infrastructure at Qubole that helps support engineers in easily analyzing the logs related to every event in Qubole’s platform.
• 2. Command line tool for analyzing the amount of money spent in Qubole’s Azure platform across various types of components like VMs, Images, Disks, load balancers, etc.

May 2017 – Jul 2017 · 2 mos · Mumbai, Maharashtra, India

• Part of the team responsible for developing insights.turtlemint.com which is used by product management and sales teams to analyze new deals and revenue growth.