Nov 2022 – Mar 2023 · 4 mos

• Building Twitter 2.0 - Data scrubbing for one of the largest data sources within Twitter.

Jul 2021 – Oct 2022 · 1 yr 3 mos

• Providing Airflow as a service to Twitter teams. Part of Data Platform team at Twitter.

Feb 2021 – Jul 2021 · 5 mos · On-site

Jun 2018 – Jan 2021 · 2 yrs 7 mos · On-site

• Working with the team responsible for Data Ingestion into the Data Lake. Part of the Intuit Data Platform.
• Ingesting data from different RDBMS and NoSQL databases using Kafka Connect and Golden Gate. Working on both real-time and batch ingestion patterns.

Aug 2016 – Jun 2018 · 1 yr 10 mos · Bengaluru Area, India

• Led a team of amazing engineers & and partnered with in-house Data Scientists to co-develop state of the art multi-tenant Recommender System. Training Collaborative Filtering, Content Based, Naive Bayes and a bunch of more algorithms on Bigdata stack (Spark) with multiple pipelines to ingest gigabytes of daily data. On the other side developing a highly scalable & high throughput low latency system to deliver recommendations.

Jul 2015 – May 2016 · 10 mos

• Worked on Marketing Data Warehouse system on Big Data Platform. Solved ETL problems using Hadoop, Hbase, Hive, Spark, and re-designed job scheduling using ALAP scheduling.

Apr 2014 – Jun 2015 · 1 yr 2 mos

• Worked with Platforms team with primary focus on:
• Messaging as a Service
• Performance & Scalability
• Availability & Reliability

Jun 2011 – Mar 2014 · 2 yrs 9 mos

• Worked on the Loyalty Engine from scratch to end, which had its development on Java, Hibernate, Spring and MySql.
• Worked on the Capillary's client application on .NET Platform.