Jul 2023 – Apr 2025 · 1 yr 9 mos · London Area, United Kingdom · Hybrid

• Working in the Data Platform & Analytics team
• Highlights,
• Building, maintaining, enhancing exsisting 𝗿𝗲𝗮𝗹 𝘁𝗶𝗺𝗲 𝗱𝗮𝘁𝗮 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗶𝗻𝗴 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 for few of the TWS's critical business like f𝗶𝗻𝘁𝗲𝗰𝗵, 𝗰𝗿𝘆𝗽𝘁𝗼, 𝗰𝗮𝘀𝗶𝗻𝗼, 𝗴𝗮𝗺𝗲𝘀 etc.
• 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗳𝗿𝗼𝗺 𝘀𝗰𝗿𝗮𝘁𝗰𝗵 𝗗𝗮𝘁𝗮 𝗩𝗶𝗿𝘁𝘂𝗮𝗹𝗶𝘀𝗮𝘁𝗶𝗼𝗻 𝗹𝗮𝘆𝗲𝗿(for all TWS businesses) for compute over Data lake with Spark(batch ETL) + Flink(stream ELT) + Trino(Analytics engine) + Iceberg(catalog manager) + Kafka(ingestion) + hdfs/parquet(storage layer) + OpenMetadata(Governance) to reduce DWH dependencies & provide 𝗴𝗲𝗻𝗲𝗿𝗶𝗰 𝘂𝗻𝗶𝗳𝗶𝗲𝗱 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝗮𝗻𝗱 𝘀𝘁𝗼𝗿𝗮𝗴𝗲 𝗹𝗮𝘆𝗲𝗿 𝗳𝗼𝗿 𝗮𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗠𝗟 use cases.
• Optimising and enhancing exsisting data governance services & capabilities for d𝗮𝘁𝗮 𝗾𝘂𝗮𝗹𝗶𝘁𝘆, 𝗳𝘂𝗹𝗹 𝗿𝗲𝗰𝗼𝗻𝗶𝗹𝗮𝘁𝗶𝗼𝗻(𝘀𝗼𝘂𝗿𝗰𝗲->𝗞𝗮𝗳𝗸𝗮->𝗹𝗮𝗸𝗲->𝘁𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻𝘀->𝗢𝗟𝗔𝗣 𝗹𝗮𝘆𝗲𝗿𝘀), lineage and metadata management to adhere to evolving industry standards.
• Maintaining legacy in-house data platform services for generic 𝘄𝗼𝗿𝗸𝗳𝗹𝗼𝘄 𝗲𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻(𝘀𝗽𝗮𝗿𝗸, 𝗳𝗹𝗶𝗻𝗸), 𝗾𝘂𝗮𝗹𝗶𝘁𝘆, 𝗵𝗲𝗮𝗹𝘁𝗵, 𝗳𝗮𝗰𝘁'𝘀 𝗹𝗶𝗳𝗲𝗰𝘆𝗰𝗹𝗲, 𝗺𝗮𝘁𝗲𝗿𝗶𝗮𝗹𝗶𝘇𝗲 𝘃𝗶𝗲𝘄 etc.

Jun 2022 – Jun 2023 · 1 yr · London Area, United Kingdom · Hybrid

• Working in the Insights team.
• Highlights,
• Built eToe(devices->app->server->kafka->snowflake->analytics) framework to capture all "Grocery" related events and metrics (Services, Partners, Users, etc.) which can be used by building features such as a 𝗿𝗲𝗰𝗼𝗺𝗺𝗲𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝘀𝘆𝘀𝘁𝗲𝗺, 𝗰𝗼𝘀𝘁-𝗲𝗳𝗳𝗲𝗰𝘁𝗶𝘃𝗲 𝘀𝘂𝗯𝘀𝘁𝗶𝘁𝘂𝘁𝗶𝗼𝗻𝘀, 𝗮𝗻𝗼𝗺𝗮𝗹𝘆 𝗶𝗻 𝗼𝗿𝗱𝗲𝗿 𝗽𝗶𝗰𝗸𝗶𝗻𝗴 𝘁𝗶𝗺𝗲. This has significant impact on effort toward acheving profitability for Deliveroo grocery business.
• Built finance(billing) eToe pipeline(third party ingestion + Snowflake) to enable 𝗿𝗲𝗮𝗹𝘁𝗶𝗺𝗲 𝗶𝗻𝘃𝗼𝗶𝗰𝗲 𝘃𝗮𝗹𝗶𝗱𝗮𝘁𝗶𝗼𝗻 & 𝗮𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀.
• Build unified data model in Snowflake for Grocery combining (grocery, partners, riders, users..) data in summarised(multi dimensional), granular(hourly, monthly...) star schema model with data governance features (ACLs, quality checks, reconcilations, completeness & avalability metrics)

Aug 2021 – Feb 2022 · 6 mos · London Area, United Kingdom · Remote

• Leading transpiler team.
• Highlights,
• Worked on building transpiler to convert Ab Initio jobs-> prophecy IR -> Spark jobs
• Leading migration plan for Prophecy clients by enhancing existing transpiler to support more components for Spark jobs.

Nov 2019 – Aug 2021 · 1 yr 9 mos · Bengaluru, Karnataka, India · On-site

• Leading data platform team at Swiggy.
• Highlights,
• Built from scratch ETL jobs execution framework which 𝗰𝗮𝗻 𝗱𝘆𝗻𝗮𝗺𝗶𝗰𝗮𝗹𝗹𝘆 𝗱𝗲𝘁𝗲𝗰𝘁𝘀 𝗱𝗲𝗽𝗲𝗻𝗱𝗲𝗻𝗰𝗶𝗲𝘀 𝗯𝘆 𝗽𝗮𝗿𝘀𝗶𝗻𝗴 𝗦𝗤𝗟𝘀, 𝗰𝗿𝗲𝗮𝘁𝗶𝗻𝗴 𝗷𝗼𝗯 𝗱𝗲𝗽𝗲𝗻𝗱𝗲𝗻𝗰𝗶𝗲𝘀 & scheduling them efficiently on Snowflake by 𝗹𝗲𝘃𝗲𝗿𝗮𝗴𝗶𝗻𝗴 𝗰𝗮𝗰𝗵𝗲(𝗰𝗼𝗹𝗼𝗰𝗮𝘁𝗶𝗻𝗴 𝗾𝘂𝗲𝗶𝗿𝗲𝘀) 𝗮𝗻𝗱 𝘄𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲 𝘀𝗲𝗹𝗲𝗰𝘁𝗶𝗼𝗻(𝗱𝗮𝗶𝗹𝘆 𝗽𝗿𝗼𝗺𝗼𝘁𝗲 𝗼𝗿 𝗱𝗲𝗺𝗼𝘁𝗲 𝗾𝘂𝗲𝗿𝘆 𝗯𝗮𝘀𝗲𝗱 𝗼𝗻 𝗾𝘂𝗲𝗿𝘆 𝘀𝘁𝗮𝘁𝘀 𝗳𝗼𝗿 𝗹𝗮𝘀𝘁 𝗱𝗮𝘆) 𝘁𝗼 𝗿𝗲𝗱𝘂𝗰𝗲 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝗰𝗼𝘀𝘁. This framework manages graph between 800 daily ETL jobs having more than 15k compute heavy queires. This helped to 𝗿𝗲𝗱𝘂𝗰𝗲 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝗰𝗼𝘀𝘁 𝗯𝘆 𝟯𝟬% for daily ETL jobs and improvised refresh 𝗮𝘃𝗮𝗹𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗦𝗟𝗔𝘀 𝗳𝗼𝗿 𝗳𝗲𝘄 𝗰𝗿𝗶𝘁𝗶𝗰𝗮𝗹 𝗱𝗮𝘀𝗵𝗯𝗼𝗮𝗿𝗱𝘀 𝗯𝘆 𝘂𝗽𝘁𝗼 𝟴 𝗵𝗼𝘂𝗿𝘀.
• Lead the effort to migrate Snowflake data center migration from Sydney to Singapore 𝘄𝗶𝘁𝗵𝗼𝘂𝘁 𝘀𝗻𝗼𝘄𝗳𝗹𝗮𝗸𝗲 𝗱𝗼𝘄𝗻𝘁𝗶𝗺𝗲 𝗮𝗻𝗱 𝗼𝗻𝗹𝘆 𝟰 𝗵𝗼𝘂𝗿𝘀 𝗸𝗮𝗳𝗸𝗮 𝗶𝗻𝗴𝗲𝘀𝘁𝗶𝗼𝗻 𝗹𝗮𝘁𝗲𝗰𝘆 during migration.
• Evaluated, proposed & performed POCs for 𝗗𝗿𝗲𝗺𝗜𝗢(𝗱𝗮𝘁𝗮 𝗹𝗮𝗸𝗲 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝗲𝗻𝗴𝗶𝗻𝗲) 𝗮𝗻𝗱 𝗗𝗮𝘁𝗮𝗯𝗿𝗶𝗰𝗸'𝘀 𝗗𝗲𝗹𝘁𝗮 𝗹𝗮𝗸𝗲(𝗹𝗮𝗸𝗲 𝗶𝗱𝗲𝗺𝗽𝗼𝘁𝗲𝗻𝗰𝘆) for Swiggy Data platform use cases.
• Evaluated & presented data govenrnance tools Atlas, Alatian, Atlan for Swiggy's data governance use cases.
• Tech stack,
• Distributed File system (EMRFS, S3)
• Data formats (Parquet, ORC, RC, JSON, Thrift, Avro)
• Big data query execution engines (EMR, Presto, Yarn, Hive, Snowflake, DremIO)
• Data streaming (Kafka, Spark Streaming, Druid, Flink)
• Schedulers (Airflow, Chronos)
• AWS (EMR, RDS, Lambda, SQS, SNS, Fargate, ECS, ECR, EKS, DremIO, CE integrations, S3FS, EFS, Glacier, DDB)
• Airflow (inhouse, Qubole, Astronomer, AWS)
• Data Governance (Atlas, Alatian, Atlan)
• UI integrations (Zeepline, PoweBI, Superset)
• PL,
• Java, Python, scala, bash, shell...

Dec 2015 – Dec 2020 · 5 yrs · Bengaluru, Karnataka, India · On-site

Dec 2015 – Nov 2019 · 3 yrs 11 mos · Bengaluru Area, India · On-site

• Data Platform Team (Lead)
• Worked on building Apache foundation project Lens. The lens is a 𝐒𝐐𝐋 𝐪𝐮𝐞𝐫𝐲 𝐞𝐱𝐞𝐜𝐮𝐭𝐢𝐨𝐧 𝐞𝐧𝐠𝐢𝐧𝐞 𝐟𝐨𝐫 𝐜𝐮𝐛𝐞 𝐝𝐢𝐦𝐞𝐧𝐬𝐢𝐨𝐧𝐚𝐥 𝐝𝐚𝐭𝐚. Apache lens is used to power InMobi's analytical use cases around its ad-exchange/real-time bidding platform (~𝟖 𝐛𝐢𝐥𝐥𝐢𝐨𝐧 𝐝𝐚𝐢𝐥𝐲 𝐚𝐝 𝐢𝐦𝐩𝐫𝐞𝐬𝐬𝐢𝐨𝐧𝐬, 𝟔𝟎 𝐛𝐢𝐥𝐥𝐢𝐨𝐧 𝐝𝐚𝐢𝐥𝐲 𝐚𝐝 𝐫𝐞𝐪𝐮𝐞𝐬𝐭𝐬) 𝐰𝐢𝐭𝐡 𝐚𝐯𝐠 𝟏𝟒𝐤/𝐬𝐞𝐜 𝐝𝐚𝐬𝐡𝐛𝐨𝐚𝐫𝐝 𝐪𝐮𝐞𝐫𝐢𝐞𝐬(SLA 10ms) 𝐚𝐧𝐝 𝐚 𝐩𝐞𝐚𝐤 𝐥𝐨𝐚𝐝 𝐨𝐟 𝟏𝟏𝟎𝐤/𝐬𝐞𝐜 𝐪𝐮𝐞𝐫𝐢𝐞𝐬 𝐞𝐱𝐞𝐜𝐮𝐭𝐞𝐝 𝐛𝐲 𝐋𝐞𝐧𝐬 𝐨𝐯𝐞𝐫 𝐒𝐧𝐨𝐰𝐟𝐥𝐚𝐤𝐞/𝐌𝐑/𝐒𝐩𝐚𝐫𝐤/𝐃𝐫𝐮𝐢𝐝/𝐕𝐞𝐫𝐭𝐢𝐜𝐚.
• 1. Implemented Authentication and Authorisation
• 2. Implemented 𝐇𝐀 𝐚𝐧𝐝 𝐬𝐭𝐚𝐭𝐞𝐥𝐞𝐬𝐬𝐧𝐞𝐬𝐬 𝐟𝐨𝐫 𝐋𝐞𝐧𝐬 𝐬𝐞𝐫𝐯𝐢𝐜𝐞𝐬.
• 3. Implemented a few 𝐪𝐮𝐞𝐫𝐲 𝐫𝐞𝐰𝐫𝐢𝐭𝐞𝐫𝐬/𝐫𝐞𝐬𝐨𝐥𝐯𝐞𝐫𝐬 𝐦𝐨𝐝𝐮𝐥𝐞𝐬.
• 4. 𝐈𝐦𝐩𝐥𝐞𝐦𝐞𝐧𝐭𝐞𝐝 𝐜𝐮𝐬𝐭𝐨𝐦 𝐩𝐚𝐫𝐪𝐮𝐞𝐭 𝐨𝐯𝐞𝐫 𝐭𝐡𝐫𝐢𝐟𝐭 𝐰𝐫𝐢𝐭𝐞𝐫 𝐟𝐨𝐫 𝐈𝐧𝐌𝐨𝐛𝐢'𝐬 𝐬𝐮𝐦𝐦𝐚𝐫𝐢𝐬𝐞𝐝 𝐝𝐚𝐭𝐚.
• 5. Implemented data availability APIs
• 6. Worked on various features and bug fixes on query building and Lens services.
• Worked in building an 𝗮𝘂𝘁𝗼-𝘀𝗰𝗮𝗹𝗮𝗯𝗹𝗲 𝗾𝘂𝗲𝗿𝘆 𝗲𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻 𝗲𝗻𝗴𝗶𝗻𝗲 𝗮𝘀 𝗣𝗔𝗔𝗦 𝗼𝗳𝗳𝗲𝗿𝗶𝗻𝗴 𝗼𝗻 𝗔𝘇𝘂𝗿𝗲 𝘂𝘀𝗶𝗻𝗴 𝗟𝗲𝗻𝘀 𝗮𝗻𝗱 𝗣𝗿𝗲𝘀𝘁𝗼 𝗳𝗼𝗿 𝗜𝗻𝗠𝗼𝗯𝗶 (video https://www.youtube.com/watch?v=zEvqrAss7Iw&t=1024s).
• OEM Services Team
• Worked on writing Android oem services for android to analyze user's interest and behavior and use this data to post more relevant ads.
• Primarily worked on designing and implementing 𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀 𝗳𝗼𝗿 𝗲𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝘁 𝗰𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝗼𝗻 𝗼𝗳 𝘂𝘀𝗲𝗿 𝗯𝗲𝗵𝗮𝘃𝗶𝗼𝗿 𝗱𝗮𝘁𝗮. Implemented 𝗿𝗲-𝘁𝗮𝗿𝗴𝗲𝘁𝗶𝗻𝗴 𝗳𝗲𝗮𝘁𝘂𝗿𝗲 𝗶𝗻 𝗼𝗲𝗺 𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀 𝗳𝗼𝗿 𝗲-𝗖𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗣𝘂𝗯𝗹𝗶𝘀𝗵𝗲𝗿𝘀 𝗶𝗻 𝗜𝗻𝗠𝗼𝗯𝗶.

Jun 2014 – Dec 2015 · 1 yr 6 mos · Hyderabad Area, India

• Worked in a team responsible for developing data centre infrastructure stack and service management layer for Microsoft products and services. Worked in security team, primarily worked on securing SMTP Gateways for domain less clusters.
• Worked in Azure monitoring team on backend to develop highly performant, distribute, scalable, highly available and reliable application that monitors and reports live health of resources/services running on Azure infrastructure.

Oct 2013 – May 2014 · 7 mos · Hyderabad Area, India

• Worked in a team responsible for developing analytics to run campaigns that reach the right people at the right time and in the right context by mining hundreds of terabytes of telecom data to understand consumer behavior to make discovering new customers and multiplying revenues simple and efficient.
• Responsibilities :
• 1. Design data service layer with its interface with other modules and front-end.
• 2. Worked on salt,salt-cloud to automate system deployment on cloud.
• 3. understood various machine learning algorithms.

May 2012 – Oct 2013 · 1 yr 5 mos

• Working with Netezza Performance system (NPS). NPS is a data warehouse appliance for combining storage, processing, database and analytic s into a single system. Worked to develop various tools that serve as a system monitoring, performance monitoring and database administration tool on Windows and Web client for NPS system.
• Responsibilities
• I. Primarily working to design and implement core level changes for these tools in accordance with changes in platform architectures, hardware architectures and databases of NPS systems by following complete software development cycle.
• II. Estimating and achieving quarterly goals as a component lead for these tools.
• III. Addressing critical bugs and helping customer support in case of any customer critical issues with respect to these tools.
• IV. Incorporating or addressing any enhancement requests by customers in these tools regularly.
• V. Proposing various projects with respect to these tools.

May 2011 – Jun 2012 · 1 yr 1 mo

Aug 2009 – Jul 2011 · 1 yr 11 mos

Jun 2008 – Jun 2009 · 1 yr

• As a team we are responsible to analyse and implement various debugging techniques and develop a generalized debugging environment for multiple languages.
• Objective of our debugger is to carry out static/dynamic slicing of source code according to nature of failure and instrument those slices for better and faster analysis of code to reduce efforts on manual debugging.