Chandan Prakash

Director of Engineering

Bengaluru, Karnataka, India15 yrs 6 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

16 years of experience in Big Data and JVM ecosystem.
Led a team of 15-20 engineers at Walmart.
Delivered impactful AdTech solutions generating $500M+ revenue.

Stackforce AI infers this person is a Senior Engineering Manager in the AdTech industry with expertise in Data Engineering and Machine Learning.

Contact

Skills

Core Skills

Engineering LeadershipData Engineering

Other Skills

Engineering ManagementAgentic AI DevelopmentMachine LearningApache Sparkapache hiveApache KafkaSpark StreamingRocksDBApache Spark StreamingReal Time AnalyticsApache StormApache MesosBig DataHadoopMapReduce

About

With over 16 years of experience in Big Data Distributed systems and the JVM ecosystem, I currently serve as Senior Engineering Manager at Walmart Global Tech India, contributing to Walmart Connect's AdTech solutions. My work focuses on Engineering leadership and Data-Management-Platform (DMP) with a proven track record of building complex Audience Targeting solutions and ML-based data pipelines. At Walmart, I lead a high-performing 15-20 member Team to deliver impactful Targeting and Optimization initiatives, including Behavioral Targeting and Audience Insights. My expertise lies in data engineering for Batch and Streaming analytics, leveraging tools such as Apache Spark, Apache DataSketches to enable scalable and effective solutions for advertisers and the organization.

Experience

Walmart global tech india

2 roles

Senior Engineering Manager

Promoted

Mar 2020 – Present · 6 yrs

Scaled the Engineering team from 6 to 18 members with active role in hiring, mentoring senior engineers, performance management, OKR planning and activating participating in technical design reviews of the key deliverables
Leading complex Data-Management-Platform (DMP) projects of building Rule-based and Machine Learning based Audience Building solutions with impact of incremental $500M+/year AdSpend revenue and 2 times improvement in ROAS & Conversion in Behavioral Targeting. Few references: Lookalike, InMarket, BrandAffinity, Persona, External Audiences (Bring your own Audience)
Leading new initiative projects like Audience Insights, Audience Size estimates based on data-sketches which gives meaningful insights to advertisers, therefore increasing adoption and re-use of Audiences while also saving compute cost
Leading the platformization project to make our product available as a platform for multiple markets outside US and integrate with third party channel partners outside Walmart Connect
Strategized and executed the cloud cost optimization project to bring down compute and storage cost significantly by ~$4M+ $/year for Walmart
Collaborate efficiently with cross-geo and cross-functional teams, product management, and stakeholders to design and implement products for Display Behavioral advertising

Engineering LeadershipEngineering ManagementData EngineeringAgentic AI DevelopmentMachine Learning

Staff Software Engineer

Apr 2019 – Mar 2020 · 11 mos

Leading AdTech Targeting (Data-Engineering) team at Walmart India
Driving design and development of data-engineering and Machine Learning based solutions to target the right set of users/audiences for our customers/advertisers
Some of the key recent projects which I drove from inception -> design -> implementation -> production:
1. In-Market : https://www.linkedin.com/feed/update/urn:li:activity:6822477028848214016/
2. Brand-Affinity: https://www.walmartconnect.com/introducing-brand-affinity-targeting--a-new-targeting-tactic-to-
3. Propensity ML pipeline re-architecture and implementation
Tech Stack: Scala, Spark, Hive, Play

Apache Sparkapache hiveApache KafkaData Engineering

Qubole

MTS

Jan 2018 – Apr 2019 · 1 yr 3 mos · Bengaluru, Karnataka, India

Implemented RocksDB based State Store in Spark Structured Streaming of Qubole offered Spark in order to handle stateful stream processing at scale
Solved Eventual Consistency Issues of Spark Streaming while running on AWS, implemented a new Checkpoint mechanism called Direct Checkpoint feature in order to address issues with open source default Checkpoint mechanism
Implemented Log Rolling - Aggregation feature for long running Spark Streaming applications in Yarn-Client mode .
Debugged and solved all sort of pain points of running Streaming Applications reliably on cloud for Qubole Customers
Evaluated different streaming/ingestion technologies like Gobblin, KafkaConnect, Secor, Apache Beam in Qubole .
Tech Stack
○ Frameworks: Spark Structured Streaming, AWS, Kafka, Azure, Yarn, Qubole middleware
○ Languages: Scala, Java, Python

Apache SparkSpark StreamingApache KafkaRocksDBData Engineering

Applift

2 roles

Lead Software Engineer

Oct 2016 – Dec 2017 · 1 yr 2 mos · Bengaluru, Karnataka, India

Part of Data Engineering Platform Team at Applift, building solutions for our Data Processing Pipeline.
1. Designed and implemented Apache Spark Streaming and Batch processing pipelines build on Lambda Architecture for company's core product . Gives reporting insight of both realtime and historical data to customers regarding their campaigns performance.
2. Developed Spark Streaming solution processing Request and Events data coming at rate 20-30k events/sec for our Data Science team.
3. Worked on Memsql as Relational In-Memory and Columnar Disk database for persistently storing data processed by Spark Streaming and Spark Batch. Integrating with processing pipelines and troubleshooting performance issues.
4. Interface to business verticals for Data processing solution requirements and issues .
5. Tuned Spark Streaming from scratch ,published a post on the same on Applift Tech blog discussing the experiences and learnings :
https://techblog.applift.com/spark-streaming-for-real-time-analytics-at-applift
Tech Stack:
Processing Frameworks: Apache Spark Streaming, Apache Spark Batch, Apache Storm, Apache Kafka, Apache Drill, Apache Mesos, Apache Yarn
Database: Memsql (Relational and Columnar), Mysql (Relational)
Languages: Java, Scala, Python, Shell Scripting

Senior Software Engineer

Oct 2015 – Sep 2016 · 11 mos · Bengaluru, Karnataka, India

Part of Applift Data Engineering Team.
Building Realtime Streaming and Batch processing solutions for Big Data problems using Apache Spark Batch and Streaming,Apache Storm,Apache Kafka,Apache Drill,etc
1. Worked on Apache Storm project for Stream processing of events data for realtime campaign budget updates and performance insights.
2. Worked on Apache Drill to build a solution for converting and saving raw events data every hour to compact,structured and space efficient parquet format, which can be later be queried using Apache Drill queries for analysis.

Morgan stanley

Senior Software Engineer

Apr 2014 – Oct 2015 · 1 yr 6 mos · Greater Bengaluru Area

Worked as Senior Java Developer on Sapphire project managing Stock Options of Tier1 companies like Google , Amazon and Facebook.
Implemented new features, optimized code, supported stability issues as per business requirement
Tech Stack: Core Java, Multithreading, JSP