Dec 2022 – Present · 3 yrs 3 mos

• Leading a team of 16 engineers to design and scale Next Gen Kafka ingestion into the Offline Datalake, ingesting 10T kafka messages/day. Established technical vision, aligned cross-functional teams, and ensured timely delivery of key milestones. Scale: Ingest ~10 trillion messages per day(~10PB data per day) from ~10k kafka topics to
• datalake.
• Built the team from the ground up, defining charters, hiring talent across levels (IC2 to IC4), and mentoring engineers in distributed systems.
• Collaborated with senior leadership to align ingestion infrastructure with LinkedIn’s long-term data strategy.

Mar 2022 – Nov 2022 · 8 mos

• Transitioned and led the Bangalore-based team for database ingestion into the datalake, ensuring a smooth charter transition from HQ.
• Reduced major production incidents from 12 per quarter to nearly zero by implementing automation, validation frameworks, and operational best practices.
• Led the migration of ~8K datasets to next-gen ingestion infrastructure, ensuring zero downtime and cost savings (~5x compute reduction).
• Drove stakeholder alignment across multiple engineering teams cross-geography to ensure adoption of new storage format for CDC.

Apr 2021 – Feb 2022 · 10 mos

• Led Data Delete Team for Offline Datalake, ensuring GDPR compliance and data deletion for exabyte scale storage.
• Established contracts with stakeholders for appropriate SLAs and SLOs, enhancing customer satisfaction.
• Built Limited Retention Service for offline storage, resulting in the deletion of over 10 million objects.

Jun 2018 – Apr 2021 · 2 yrs 10 mos

• Designed and built an exabyte scale anonymized data warehouse for GDPR compliance.
• Transitioned legacy system to event trigger based microservice architecture, reducing operational support.
• Achieved significant impact by decreasing anonymization flows managed by SRE from 200 plus to 1.