Gaurav Malhotra

CTO

Bengaluru, Karnataka, India9 yrs 8 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 40% improvement in Spark query planning.
  • Handled over 500k events/sec in fraud detection.
  • Expert in cloud-native architecture across multiple platforms.
Stackforce AI infers this person is a SaaS and Big Data expert with a focus on scalable distributed systems.

Contact

Skills

Core Skills

SparkCloud ArchitectureCloud MigrationContainerizationSoftware DevelopmentBig Data ProcessingReal-time Analytics

Other Skills

Data CloudAPI DevelopmentGCSAzureData ManagementAzure Kubernetes ServiceAutomationChrome V3Test SuiteTheta-SketchKafkaHBaseReal-time ProcessingBatch ProcessingC

About

I am a Senior Member of Technical Staff at Salesforce with 8+ years of experience building scalable distributed systems, big data pipelines, and cloud-native platforms. My work spans large-scale stream processing, Spark query optimization, high-throughput data ingestion, and cross-cloud integrations across Azure, GCP, and internal platforms. I’ve engineered impactful systems across industry leaders like Salesforce, Microsoft, and Flipkart—from optimizing Spark workloads (40% query planning improvement) to containerizing core Microsoft services on AKS to building real-time fraud detection pipelines handling 500k+ events/sec. I’m passionate about system performance, scalable architecture, and solving complex distributed engineering challenges. Tools I work with: Spark, Kafka, Azure, GCS, Java, Scala, Python, Spring, React, Docker, Kubernetes.

Experience

Salesforce

Senior Member of Technical Staff

Sep 2022Present · 3 yrs 6 mos · India · Hybrid

  • Designed and engineered the Rule Builder & Job Builder for Data Cloud Activations, reducing Spark query planning time by 40%.
  • Built and deployed the CRUD Connect API for Data Streams, significantly improving metadata and data management workflows.
  • Architected the Egress Workflow for Default Activation, enabling high-throughput direct data pushes to GCS and Azure Buckets.
SparkData CloudAPI DevelopmentGCSAzureCloud Architecture

Microsoft

Software Development Engineer 2

Nov 2019Aug 2022 · 2 yrs 9 mos · Noida, Uttar Pradesh, India

  • Led containerization and cloud migration of the SkypeAAD service using Azure Kubernetes Service, improving scalability and deployment efficiency.
  • Automated Azure Cloud Services artifact generation, reducing deployment time from 2 hours to 15 minutes.
  • Built interactive Chrome V3 features for Microsoft Whiteboard and contributed to the comprehensive test suite for Whiteboard Android.
Azure Kubernetes ServiceCloud MigrationAutomationChrome V3Test SuiteContainerization

Flipkart

2 roles

Software Development Engineer 2

Promoted

Jan 2019Aug 2019 · 7 mos

  • Built near-real-time analytics for FDP Dashboard using Theta-Sketch algorithms, handling 500k+ events/s with drastically reduced latency.
  • Implemented the Feature Loader for model pipelines used in fraud detection systems.
  • Created an end-to-end Reseller Fraud Detection pipeline, integrating real-time + batch processing with Kafka and HBase.
Theta-SketchKafkaHBaseReal-time ProcessingBatch ProcessingBig Data Processing+1

Software Development Engineer

Dec 2016Dec 2018 · 2 yrs

Samsung software engineering lab, noida

Engineer

Jul 2013May 2014 · 10 mos

Education

Indian Institute of Technology, Madras

Master of Technology - MTech — Computer Science

Jan 2014Jan 2016

YMCA University of Science & Technology

Bachelor of Technology (B.Tech.) — Computer Science

Jan 2010Jan 2014

Stackforce found 100+ more professionals with Spark & Cloud Architecture

Explore similar profiles based on matching skills and experience