Jul 2021 – Oct 2024 · 3 yrs 3 mos · Bengaluru, Karnataka, India · Hybrid

• Leading legacy migration effort to Spark for data platform in Linkedin
• Part of data platform team in linkedin internal cloud team
• Building next generation data platform for metrics generation and ETL workflows using DBT

Sep 2020 – May 2021 · 8 mos · Berlin, Germany

• Building platform for streaming data to support all global efforts

Apr 2019 – Sep 2020 · 1 yr 5 mos

• Helping out data science team in scaling data models by building data pipelines and services
• Migrated personalisation, recommendation and other revenue generating data pipelines from server side to client side events
• Scaled the pipeline to handle avg load of 300 GB/day and max load of 10 TB/day on Amazon Elastic MapReduce
• Developed python web-service for cross-sell recos to handle peak loads of 1Mil RPM and avg loads of 100k RPM. Used flask, gunicorn, supervisor, aerospike to handle loads
• Developed the customer service data pipeline for real-time escalations and customer service QA using Spark on Microsoft HDInsights
• Helped grow the team size from 2 to 7. Interviewed and mentored new recruits for seamless on-boarding

Dec 2017 – Mar 2019 · 1 yr 3 mos

• Set up data pipeline for unloading of all kafka logs to Blob storage for backup purposes using Secor
• Integrated footwear size recommendations on sizing service
• Maintained Apache Airflow used in data-sciences and pushed adoption across other teams

Oct 2016 – Nov 2017 · 1 yr 1 mo · Bengaluru Area, India

• Refactored and deployed python ML models on production for real-time credit assesment and instant disbursal
• Coordinated with data science team and designed HBase schema pertaining to data needs
• Wrote Kafka consumers to ingest real time data from Debezium to HBase
• Wrote ETL(Extract, Load & Transform) code to load historical data to warehouse
• Developed and deployed back-end of analytics platform on AWS using django

Feb 2016 – Aug 2016 · 6 mos · Bengaluru Area, India

• Worked on various products including:
• 1. Help Requests: Developed a Q/A feature in which user can resolve his/her query by creating help requests in Django. Used celery workers to maintain tasks and celery beat to send regular updates until the help request is solved.
• 2. Automated IVRS system: Developed an IVRS system which placed calls on specific times to connect 2 users on platform. Used Twilio services to place the calls and wrote multiple web-hooks to gracefully handle every possible situation in a call.
• Worked on other projects like implementing Facebook and Twitter signups, automating eotd, sending regular updates about session requests and questions, and few more projects.

Jul 2015 – Dec 2015 · 5 mos · Mumbai Area, India

• Developed road based search as a part of Maps team
• Enabled complex routing queries in real time with resonse time < 50 ms
• Used open source PostGIS (extension of PostGRESQL) as database framework to handle geospatial queries
• Developed backend in Ruby On Rails

Dec 2014 – Jan 2015 · 1 mo · Amirtapuri

• Ranked 3rd in BITS Pilani 1st round qualifiers.
• Participated in ACM- ICPC regionals held at Amiratapuri.

May 2013 – Aug 2013 · 3 mos · New Delhi Area, India

• The Indian arm of the global Red Cross organization. I was involved in developing a software for managing IRCS volunteers and notifying the nearby volunteers in case a natural disaster strikes. I developed it using PHP and it is an internal service updated regularly by IRCS employees.

Feb 2013 – Jan 2014 · 11 mos · Pilani, Rajasthan

• As the coordinator of Alumni Research Talks 4.0, I bagged LinkedIn as the Title Sponsor. I was responsible for handling a team of 50 members. It was the most successful event in which over 400 people participated. My job was to search and invite speakers who excelled in research fields in Computer Science. 4 speakers from IBM research, Apple, LinkedIn and Indian Institute of Science presented the opportunities in their fields in ART 4.0.