Rahul Singh

Director of Engineering

India23 yrs 8 mos experience

Highly Stable

Key Highlights

Led large-scale data platforms handling petabytes of data.
Expert in building secure and compliant data solutions.
Proven experience in both startups and large enterprises.

Stackforce AI infers this person is a Big Data and Cloud Computing expert with extensive experience in SaaS and Cybersecurity.

Contact

rahulks@gmail.com LinkedIn

Skills

Core Skills

Distributed SystemsArchitectureBig DataData WarehousingMachine LearningSoftware DevelopmentData GovernanceData EngineeringData Science

Other Skills

Ad ServingAd platform engineeringAmazon S3Amazon SQSAmazon Web Services (AWS)AnalyticsApache KafkaApache PigApache SparkApache Spark StreamingAsync Micro Services platformBilling systemCaching SystemsCapacity SchedulerCassandra

About

Experience in conceptualizing and building platforms and production-grade software for advertising, enterprise worlds, and finance. These are large-scale, web-based, multi-tenant distributed systems. They reside in both public cloud and on-premise and support millions of users and handle petabytes of data. Experience with working on Sensitive data and being Security and GDPR Driver for Big Data lake, ML, and other platforms in both Private and Public Cloud. Having worked for both startups and larger companies, I have experience of building platforms and also focussed solutions incorporating user and business requirements into cost-effective, secure and agile solutions architected for scalability and durability.

Experience

23 yrs 8 mos

Total Experience

2 yrs 3 mos

Average Tenure

8 mos

Current Experience

Uber

Director of Engineering

Oct 2025 – Present · 8 mos · Karnataka, India · On-site

Leading the following
Data Intelligence Platform .
Edge platform (Edge Computing , Notifications , Caching Systems, MCP Gateways)
Uber Fares and fulfilment Platform
Uber Mobility Reliability Platform

Data Intelligence PlatformEdge ComputingNotificationsCaching SystemsMCP GatewaysDistributed Systems+1

Rippling

Senior Director of Engineering (Platforms)

Jul 2024 – Sep 2025 · 1 yr 2 mos · Bangalore · On-site

Walmart labs

Senior Director of Engineering

Apr 2021 – May 2024 · 3 yrs 1 mo · On-site

Leading E2E Data platform for Walmart , this includes Data In Motion , ETL, Data Governance ,
Streaming platform(Event Streaming and Complex Event Processing) , Federated query platform(Presto) , data quality , data metadata,Data Storage (Object Store , Distributed File Systems) etc
Leading Databases as a Service(Postgres, MySQL) ,Cache as a Service(Redis and Memcache) , Nosql as a Service (Cassandra as a Service) for whole of Walmart

E2E Data platformData In MotionETLData GovernanceStreaming platformFederated query platform+5

Vmware carbon black

Senior Staff Engineer

Sep 2019 – Apr 2021 · 1 yr 7 mos · Palo Alto, California, United States · On-site

Lead and built complete end to end Data platform and Machine learning platform for Carbon Black Cloud.This was at Petabyte scale and served million requests per second
Lead and Built various aspects of a Carbon Black Cloud. Lead XDR(Extended Detection and Response) platform , MDR (Managed Detection and Response) platform.

Data platformMachine learning platformXDR platformMDR platformMachine LearningArchitecture

Apple

Sr Principal Engineer

Jul 2018 – Sep 2019 · 1 yr 2 mos · Cupertino

Ad platform engineering {Sponsored search} and Data platform. Building low latency Ad Serving with Distributed and large scale system which spans across 50+(eventually 100+) countries serving 100s of Millions of Users. Working on the following:
Ultra-low latency Ad Serving
Async Micro Services platform
Privacy enabled E2E Data Platform for Sponsored Search

Ad platform engineeringData platformLow latency Ad ServingAsync Micro Services platformSoftware DevelopmentArchitecture

Intuit

Distinguished Engineer(Director)

May 2014 – Jul 2018 · 4 yrs 2 mos · Mountain view, California

Lead following
Secure(Deals with highly sensitive data) and compliant(GDPR etc) Analytics and data lake platform on both On-Premise and on Public cloud
Data catalogue and metadata
Data Fabric Persistent service(Polyglot Entity Store, Common journal domain models).
Streaming Platform to democratize streaming data.
Replication system based on Change data capture from Inputs like RDBMS(Oracle, MYSQL, MSSQL) to destinations like Cassandra, Kafka, HDFS

Secure analyticsData lake platformData catalogueStreaming platformData GovernanceBig Data

Tried different start ups

Principal engineer/Lead Architect

Jul 2010 – Jun 2013 · 2 yrs 11 mos · Bengaluru Area, India

Built a unified event system for publishing, collection, and routing events supporting both batch and stream processing.
Designed, architected and implemented a Fast/interactive data warehouse, reporting and analytics platform which allows the product, marketing, sciences, and others to process data in their own ways.
Lead Architect for Analytics engine (https://technology.inmobi.com/projects/yoda). A scalable batch processing, reporting, and analytics platform that allows the product, marketing, and sciences teams to consume and process data in their own special ways. The platform pulled data from both production pipelines (raw unstructured) and legacy data stores(structured relational data), transformed, processed, serialized and summarized data into a Hadoop DFS data store that allowed for both Product and Sciences teams to query and consume the data.
Lead Architect for the Real-time analytics, Real-time event processing systems. This system allowed on the fly aggregation of data and logs to generate real-time analytics. Built a scalable Billing system which used the real-time aggregation.

Unified event systemFast/interactive data warehouseReal-time analyticsBilling systemData EngineeringArchitecture

Yahoo

Hadoop Tech Lead

Oct 2008 – Jul 2010 · 1 yr 9 mos

Implemented various features as part of Mapreduce.
Designed architected implemented various aspects of Capacity Scheduler.
Refer: http://hadoop.apache.org/docs/mapreduce/current/capacity_scheduler.html
Designed architected implemented various aspects of Gridmix.
Refer:https://hadoop.apache.org/docs/r1.2.1/gridmix.html.

MapReduceCapacity SchedulerGridmixBig Data

Sun microsystems

Member Technical Staff level 4

Jul 2006 – Oct 2008 · 2 yrs 3 mos

Designed architected and implemented large scale chat server based on XMPP protocol. Implemented complete IMPS specification etc.
for more information refer:
http://www.oracle.com/us/products/applications/communications/unified-communications/instant-messaging/overview/index.html

Chat server designXMPP protocolIMPS specificationSoftware Development

Ibm labs

Staff Engineer

Oct 2003 – Sep 2006 · 2 yrs 11 mos

Worked on the websphere application server, Developed various different aspects of the system management component and servlet engine.

WebSphere application serverSystem managementServlet engineSoftware Development

Strand life sciences

Associate

Jul 2001 – Sep 2003 · 2 yrs 2 mos

Worked on annotator engine for gene sequence. Worked on image analysis product. The product worked on images like BMP, JPEG and used SVM for classification

Gene sequence annotationImage analysisSVM classificationData Science