Dec 2019 – Apr 2021 · 1 yr 4 mos · London, United Kingdom

Jul 2016 – Nov 2019 · 3 yrs 4 mos

• Data Science Team -
• 1. Created an infrastructure for running Zeppelin servers in Qubole's control plane using K8s clusters. Worked on containerisation of Zeppelin web service, bring up and management of the application pods, consistency between multiple instances of Zeppelin server.
• 2. Explored multiple ways of deploying Machine Learning models and wrote an integration blog with Qubole clusters. Worked on an exploratory project to save various ML models along with their hyperparameters and accuracy for discoverability and reproducibility.
• 3. Provided support for AWS GPU enabled instances along with NVIDIA drivers and CUDA toolkit to increase the computing performance with parallel computing.
• 4. Worked on support for Deep Learning as a service in Qubole which will allow data scientists to run frameworks like TensorFlow, Keras etc. out of the box on Qubole clusters. Fine tuned Hadoop and Spark configurations to run Deep Learning jobs.
• Cluster Management Team -
• 1. Added support for Oracle Public Cloud in Qubole Data Services. Created cluster orchestration layer, automated creation and publishing of machine images with Qubole packages.
• 2. Integrated spot blocks (stable and cheaper VMs) in Qubole clusters.
• 3. Worked on bastion hosts and private subnets to bolster the security of Qubole clusters.
• 4. Designed and implemented a fix to allow users to bypass the UDF size limit of 16 KB imposed by AWS and other clouds.

Jan 2016 – Jun 2016 · 5 mos

• 1. Developed a ruby client for Presto server to replace the JAVA client so that the end to end delay is reduced. Improved latency by 3 seconds.
• 2. Provided support for Oracle DB import/export using opensource tool SQOOP, which allows users to create hive tables in cloud storage using data stored in their datastores.

May 2015 – Jul 2015 · 2 mos · Hyderabad Area, India

• 1. Developed a user interface to enable engineers to query the VMS boxes to check the space left in a storage box so that loss of data due to insufficient memory can be prevented.
• 2. Developed a UI to enable engineers to check if a stock data is present in a specific box so that the data can be properly tracked.
• 3. Created a user interface to enable admins (team leads) to modify or control the internal the access of internal services (web pages) at Factset

May 2014 – Jul 2014 · 2 mos · Mumbai Area, India

• Created a Bibliography App for the site MetaStudio
• The project was inspired by a firefox addon Zotero to help the users of MetaStudio to create a personal library where they can store metadata of articles, journals , books or anything they come across on the internet. This library can then be used to cite references at the time of writing a page, course or post in Metastudio .This will help in reducing plagiarism and will add credibility to the pages.