May 2022 – Dec 2024 · 2 yrs 7 mos · Bangalore Urban, Karnataka, India

• 1. Added support for cross region shortcuts in Microsoft Fabric letting user to create shortcuts to capacities in different regions.
• 2. Integrated the support to create shortcuts to ADLS storage using cloud connections. This enables user to store the credentials securely and use it to access external data sources
• 3. Lead engineer for XTable integration in OneLake. Allowing customers to work on Iceberg in fabric. Designed and implemented E2E starting from the POC to Public preview.
• 4. Worked on enhancements related to latency, scalability and reliability of shortcut path resolution bringing latency to lower single digit milli-second.

Jan 2021 – May 2022 · 1 yr 4 mos · Bangalore Urban, Karnataka, India

• 1. Synapse CICD - SME for the CICD offerings by Synapse. I worked on azure devops extension and Synapse Github action which is heavily used by all of our customers. I worked directly with the PM and customers for adding new features and resolving customer issues.
• 2. Synapse Notebook service - I worked on key features of notebook service such as AZ enablement, AZNB integration, latency improvements and setting up an internal config store.
• 3. PowerBi - Workspace level CMK encryption for Dataverse and other data sources.

Jul 2019 – Dec 2020 · 1 yr 5 mos

• As a part of ETL and middleware team, my work involved maintaining data engineering tools and middleware services.
• 1. Worked on UI and Middleware of Qubole pipeline service which is a spark structured streaming platform.
• 2. Multiple improvements to existing airflow.
• 3. Complete architectural change in Qubole Pipeline services.
• 4. Added support to set AWS Glue as default metastore of the account.
• 5. Proactively resolved various customer issues.
• 6. Authored a CLI tool called afctl to build and deploy airflow projects from scratch.
• 7. Create and record airflow tutorials on youtube.
• 8. Multinode support for Airflow on k8s

Jan 2019 – Jul 2019 · 6 mos

• During my internship my work involved :
• 1. Added role-based access control in Airflow and upgrade Airflow version. This involved adding mapping from Qubole's ACL to airflow's RBAC.
• 2. Published multiple blogs and tutorials for the customers and the public.
• 3. Added UI support to add multiple hive table dependency checks in Qubole's scheduler.
• 4. Worked on creating automation tests for Airflow's RBAC.
• 5. Worked on improving stability of Airflow and various UI related issues.

Jun 2018 – Aug 2018 · 2 mos

• As a summer intern, my work involved providing airflow to our customers on an anaconda based environment with an upgraded python version. The entire setup was to be ported from a multi-node architecture which it was made for, Spark in this case to a single node for Airflow. This product had a very big customer impact as within 2 months of next release 90% of the customers moved to this environment.

Jun 2017 – Jul 2017 · 1 mo

• Worked on various techniques to improve clustering of data. Along with this worked on various side projects on image processing, computer vision, natural language processing, deep learning and parallel processing.