Jul 2022 – Sep 2025 · 3 yrs 2 mos

• Working in governance domain for Apache Spark and Key projects are as follows:
• Developed, Launched and Maintained Fine Grain Access Control for Apache Spark with Support for All OTFs like Iceberg, Hudi and Delta.
• Lead, Developed and Launched Multi Dialect Views with Data Access Control for Apache Spark and support for OTFs

Oct 2021 – Jul 2022 · 9 mos

• Continued working on Elastic Map Reduce Team focusing on development of Big Data Analytics Applications. Key projects being:
• Apache Hive currency, maintenance, optimization, security improvements and telemetry.
• Apache Hive Metastore Service
• Apache Hive Iceberg integration in EMR
• Evaluation of new applications for EMR

Jan 2021 – Oct 2021 · 9 mos

• Worked in Elastic Map Reduce Team focusing on development of Big Data Analytics Applications of Hive and Tez. Key projects being: Hive EMRRFS-S3 optimized Committer, Hive on EMR serverless, performance improvement optimisation for Hive.

Jul 2019 – Dec 2020 · 1 yr 5 mos

• Worked on transactional capabilities in Hive considering multi-engines like Spark and Presto support. This included designing and optimizing for cloud-native systems, developing in-house testing infrastructure, monitoring, alerting, and contributing back to the Open Source.

Jul 2018 – Jun 2019 · 11 mos

• Worked on Apache Hive, a data warehouse infrastructure tool to process structured data in Hadoop. Key assignments were, add eventual consistency check for object stores, improving the initial mapper estimation in Tez execution engine considering Auto-Scaling and Hive Version Upgrade.

May 2018 – Jul 2018 · 2 mos · Hyderabad Area, India

• Evaluated some of the open-source libraries for mobile-specific UI components based on React and Integrated them in the DESCO JavaScript Stack. Setup two full-stack app for InOut (leave management portal) and DESFlow (Request Tracker) mobile revamped version show casing the new UI components.

Aug 2017 – Dec 2017 · 4 mos · PIlani

• Worked under Dr. Yashvardhan Sharma on Event Extraction from code mixed data(Hindi, Malayalam, and Tamil) of social media text.

May 2017 – Jul 2017 · 2 mos · Kanpur Area, India

• Worked under Dr. Deepak Gupta to develop a Cost-Effective Anti-counterfeiting technology. My project involved identifying 3D textures, authenticating images and generating signatures of images for indexing and searching. This was a part of the larger project to commercialize a patented lab implementation to tackle counterfeiting problem for any product that is being sold anywhere, with the plan to move it out of the IITK lab in the form of an independent startup entity.

May 2016 – Jul 2016 · 2 mos · Gujarat, India

• Worked on Vehicle Detection to analyze traffic flow within the campus. Developed a system in which given a video, vehicles are detected in each frame using SVM and Haar Cascade Algorithm. The system ran on Distributed File System for large-scale data processing using Dumbo API.