Sourav Dasgupta

Director of Engineering

Bengaluru, Karnataka, India16 yrs 5 mos experience

Highly Stable

Key Highlights

Bootstrapped data organizations across multiple companies.
Expert in building scalable data platforms and teams.
Deep experience in data engineering for B2B and B2C.

Stackforce AI infers this person is a Data Engineering leader with expertise in SaaS and Ad Tech industries.

Contact

sourav.dasgupta@harness.io LinkedIn

Skills

Core Skills

Data PlatformArchitectureData EngineeringData Analytics

Other Skills

Agile DevelopmentAirflowAmazon Elastic MapReduce (EMR)Amazon RedshiftApache IcebergApache KafkaApache PinotApache SparkApache Spark StreamingBatch & Stream ProcessingBatch ProcessingBig DataBusiness IntelligenceCoaching & MentoringCore Java

About

Brief: Data Platform & Data Products leader with focus on making data reliable, available, scalable and cost-efficient with deep exposure to 0 to 10 journeys in B2B and B2C. Deep expertise in bootstrapping Data teams. Experience: 15+ years experience in designing, implementing & managing low latency, high throughput, near-real-time, distributed Data Platforms & Data Products (data pipelines, data warehouses, data lakes, data lakehouse, data tools & frameworks). 8+ years of experience in building teams from scratch (0 to 10 journey). Tech Expertise: Data Warehousing, Data Architecture & Strategy, Data Analytics, Big Data, Data Observability, Batch & Stream Processing, MPP (Massive Parallel Processing), Data Modelling, Data Orchestration, MDM (Master Data Management), Functional & Object Oriented Programming. Technologies: Hadoop,Spark,Iceberg,Snowflake,Redshift,Kafka,MSSQL Server,Mysql,Core Java & Springboot, Scala, Python. People & Process Expertise: Hiring, Data Org Building, Agile Development, Coaching & Mentoring, Product Thinking, OKR Setting, Performance Measurement, Technology & Process Instrumentation. Domain Knowledge: Ecommerce(Storefront, Marketing/Growth, Logistics, Inventory, Merchandising, CS, Finance) & Ad Tech (Programmatic Ads, Contextual Ads, Domain Parking). Passion: Building Data Teams ground up, Scaling Data Teams for 10X leap, Designing Data Platforms & Data Products. Key Contributions: Bootstrapped Data Org at Quince as a horizontal practice cutting across all verticals. Bootstrapped Data Engg at media.net for programmatic ads product suite. Strengths: Objective, Empathetic & Result Oriented.

Experience

16 yrs 5 mos

Total Experience

3 yrs 1 mo

Average Tenure

11 mos

Current Experience

Harness

Director of Engineering

Jun 2025 – Present · 11 mos · Bengaluru, Karnataka, India · Hybrid

Responsible for two Data Platform charters at Harness -
#1 AppSec Data Platform - A multi cloud, portable, OSS backed, streaming first platform for powering API observability & security products.
#2 Data Activation & Analytics - Bootstrapping a new charter responsible for building a self-serve analytics platform with generic query and semantic abstractions to power analytics modules of 20+ products

Outcome focusedApache KafkaApache SparkApache PinotApache IcebergKafka Streams+10

Quince

Senior Engineering Manager - Data Platform

May 2023 – Jun 2025 · 2 yrs 1 mo · Bengaluru, Karnataka, India · Hybrid

On a mission to help Quince become a multi billion dollar organization by leveraging data to measure the past, capture the present & predict the future.
Managing the vision, mission and strategy for the data engg team
Building the data engg team ground up
Taking care of all verticals across demand & supply - Site, Growth(Acquisition & Retention), Logistics, Inventory, Merchandising, Customer Support
Owning the tools and platforms for efficient storage,processing,retrieval & quality of data
The cost governor of Data Platform overseeing annual budget, projections, actuals and vendor contracts. Responsible for creation and execution of cost sustainability roadmap.
Key Contribution
Bootstrapped Data Org (Data Engg and Data Analytics)
Built the Data Platform ground up for catering to supply and demand domains and strategic finance
Built marketing data stack focussed on various attribution models (Last Touch, First Touch, Multi Touch, Hybrid etc) for measuring efficiency of various paid channels
Built GAAP compliant finance data assets by consolidating all revenue and cost metrics across the org
Rearchitected proprietary Lakehouse into open table format based Lakehouse on top of Iceberg to make it future ready for low cost, pluggable, dynamic compute
Designed highly available Kafta Gateway(REST) for clickstream data ingestion with millisecond latency
Launched Data Governance program to bring in metric governance, data observability, lineage, monitoring & alerting
Instrumented the core capabilities as foundational health metrics for the platform

Python (Programming Language)AirflowLookerSnowflakeAmazon Elastic MapReduce (EMR)Apache Spark+5

Media.net

Sr Manager

Sep 2016 – Apr 2023 · 6 yrs 7 mos · Bangalore

I lead all data engineering initiatives for programmatic ads product.
I manage a team of developers responsible for creating & managing near-real-time data pipelines/data warehouses/olap stores/transnational data-stores/master data/replication infrastructure.
I own the analytics platform for programmatic ads having both internal & external audience

PythonDistributed SystemsCore JavaData PipelinesApache SparkSpring Boot+21

Amazon

Data Engineer II

Feb 2016 – Sep 2016 · 7 mos · Bangalore

- Building end-to-end data pipeline for payments org (IN marketplace).

Data PipelinesBusiness IntelligenceData AnalyticsExtract, Transform, Load (ETL)Data ModelingDatabases+6

Directi

Sr. Database Developer

Jul 2012 – Feb 2016 · 3 yrs 7 mos · Greater Bengaluru Area

Worked with Media.net, Directi's internet advertising division, which runs the 2nd largest contextual ads program globally and powers the Yahoo! Bing Network Contextual Ads program (http://contextualads.yahoo.net/).
Worked on Content Monetization and Domain Monetization products.
End-to-end ownership of design, development and maintenance of OLAP cubes to facilitate reporting for business.
Was responsible for architecture, design, execution and management of a large and complex platform that records and analyzes large volume of data.
Set up various automations for calculation of different metrics and business reporting.
Taken care of DBA activities.

Data PipelinesBusiness IntelligenceData AnalyticsExtract, Transform, Load (ETL)Data ModelingDatabases+5

Infosys

Senior Systems Engineer

Oct 2009 – Jun 2012 · 2 yrs 8 mos

Worked for leading US healthcare client viz. Aetna.
Involved in development of a comprehensive reporting system which provides information related to finance, HR operations, sales and medical cost measures which enables client take critical business decisions.
Worked on Microsoft Sql server 2005/2008/2008 R2 and Microsoft Business Intelligence technologies.

Data Modeling