Apr 2021 – Present · 4 yrs 11 mos

Jan 2020 – Sep 2020 · 8 mos · Gurugram, Haryana, India

• Created a data-quality and assertion framework to monitor and alert on anomalies allowing Data Science teams to be more confident in their sources.
• Setup Trino (formerly known as PrestoSQL) and migrated existing workloads from AWS Athena to improve query response times, save costs, get deeper visibility into workloads and then use that information to drive requirements and roadmap.
• Setup a CI pipeline for Trino (formerly known as PrestoSQL) to allow deploying new versions with confidence and enabling to identify regressions or bugs at production scale.
• Designed and implemented change-data-capture systems over various types of data stores including DynamoDB, MongoDB, ElasticSearch etc.
• Implemented a pipeline to write data to S3 in Parquet format in near realtime manner (< 5m latencies at loads upto 9k msgs/s).
• Integrated Amundsen (https://lyft.github.io/amundsen/) as a data catalog system and upstreamed patches.
• Implemented processes and guidelines to build a culture of upstreaming patches to avoid the costs of maintaining internal forks of open-source software.
• Initiated process improvements by implementing zero-code integration of new data pipelines, parent POMs, CI pipelines for dependency upgrades.

Dec 2018 – Jan 2020 · 1 yr 1 mo · Gurugram, Haryana, India

• Joined in WMS team to setup a streaming data platform and a data warehouse:
• Setup a streaming data warehouse using change data capture and implemented predictive alerts and real-time metrics to identify bottlenecks or system issues. Built with Kafka Streams, Debezium and PostgreSQL.
• Designed and implemented an end-to-end visibility and analytics platform for customers and internal teams. Built with Spark, Redis and PostgreSQL.
• Designed and implemented an automated billing system with ability to generate invoices for historical periods and on-demand.
• Designed a retry framework for client-integration APIs for configurable and flexible retry policies over RabbitMQ.

Jul 2017 – Dec 2018 · 1 yr 5 mos · Gurgaon, India

• Joined in Search team to improve product discovery, personalisation and performance:
• Designed and implemented features to personalise filters and the ability to see similar products based on product attributes in real-time.
• Designed and implemented a recommendations framework for suggesting fit accuracy and size recommendations with 99%tile response times of under 30ms.
• Migrated user profile, authentication and related services for 40mn users with zero downtime to a multi-tenant tech stack with real-time two-way sync.
• Broke two modules out of a legacy PHP monolith into Go based microservices each handling 5mn calls per day with 99%tile response times under 50ms.
• Created a drag and drop UI dashboard to manage synonyms for the search service backed by Redis providing hot-reload capabilities that were missing earlier.
• Created the monitoring and job management system for migration of 2.5mn products' data to a new data store in a multi-tenant setup.
• Created several utility tools to help other business units speed up their work and automated away most of the data management related flows.
• Initiated lots of process improvements like utilizing Redis protocol format to bring down a 6 hour data import process to under 3 minutes, reduced service build and deploy times by 20 minutes, sped up personalisation data ingestion to under an hour from 5 hours in Cassandra.

Jun 2016 – Aug 2016 · 2 mos · Greater Delhi Area

• Developed and implemented a licensing architecture based on public key cryptography for web applications to prevent piracy of software developed by NIC.
• Implemented a centralized web-service to keep track of issued licenses and detect unlicensed copies.
• The system was implemented using Java Struts2, Hibernate ORM and used PostgreSQL as the database.

Aug 2015 – May 2016 · 9 mos · Greater Delhi Area

• Part of the team responsible for communicating with the prospective employers for placement opportunities.
• Part of the team that organized and coordinated the 2016 outgoing batch’s placement sessions.

Dec 2014 – Feb 2015 · 2 mos · Dhanbad-Ranchi Area

• Developed a module for Mecon Ltd.'s e-Office solution which allowed people to organize meetings, keep track of due dates and responsibilities and automated the process of generation and updation of minutes of meetings in their departmental meetings, saving valuable time.
• The system was implemented using ASP.NET MVC and used MS-SQL Server as the data backend.

Sep 2014 – Aug 2016 · 1 yr 11 mos · Greater Delhi Area

• Organized three technical workshops - Ethical Hacking and Network Security, Android Development and Python Programming.
• Organized a photography competition during annual fest AlgoRhythm and used it to acquire event photos.
• Managed the recruitment of new members for the society and also helped with the management and organisation of the annual Techno-Cultural fest, AlgoRhythm.

Aug 2014 – May 2016 · 1 yr 9 mos · Greater Delhi Area

• Conducted sessions for getting people started with Mozilla’s mission and contributing to the project.
• Presented a talk titled, “Breaking Into Open Source”, where I discussed some techniques for getting into OSS development.

Aug 2013 – Apr 2015 · 1 yr 8 mos · Greater Delhi Area

• Contributed articles and performed the editing and short-listing of articles submitted to the magazine.
• Served as the lead graphic designer for events and orientations related to the magazine and as assistant designer for the magazine.
• Came up with online campaign ideas to improve the online presence of the magazine and the team.