R

Rakesh Kumar

Software Engineer

Canada8 yrs 6 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Led Spark rearchitecture at Meta.
  • Improved policy management efficiency by 90% at Google.
  • Built Swiggy's Data Platform from scratch.
Stackforce AI infers this person is a Backend-heavy Fullstack Engineer with expertise in SaaS and Cloud Computing.

Contact

Skills

Core Skills

Apache SparkJavaCloud SqlDistributed SystemsPolicy ManagementApisData AnalyticsHadoopApache Storm

Other Skills

API DevelopmentAgile MethodologiesAlgorithmsAmazon Web Services (AWS)Apache KafkaApache ZooKeeperArchitectureBatch ProcessingCC++Connection LayerContinuous IntegrationCore JavaDBMSData Structures

About

Leading efforts to rearchitect and modernize the Spark compute engine at Meta. Prior to Spark, I worked on scaling and improving the reliability of Meta's Graph processing engine. Before that, I spent most of my time building batch and real-time data processing infrastructure.

Experience

8 yrs 6 mos
Total Experience
2 yrs 1 mo
Average Tenure
4 yrs 1 mo
Current Experience

Meta

Staff Software Engineer

May 2022Present · 4 yrs 1 mo

  • Spark Redesign.
  • Leading efforts on rearchitecting Spark and integrating with the meta's infrastructure in a decoupled and extensible manner.
Apache SparkJavaAPI Development

Google

Technical Lead

Sep 2016Aug 2022 · 5 yrs 11 mos · Toronto, Ontario, Canada

  • Cloud SQL - Databases on Anthos (GCP)
  • Currently working on building a platform that offers a suite of services that enables users to manage the full lifecycle of their databases (e.g. Oracle, Postgres, etc.) in GCP, other public and private clouds.
  • Policy Enforcement and Decision System
  • Designed a highly scalable, consistent, and reliable distributed workflow engine for policies applied by Enterprise customers.
  • Led a team of eight engineers in the multi-quarter effort to develop this infrastructure.
  • Reduced the average policy fan out time by 74% for Large Enterprise customers.
  • The system handles 40K QPS and around 2B entities per day.
  • Policy And Config Management System (GSuite)
  • Technical Lead for Policy Management and Enforcement System of G-Suite core. The system powers Gmail, Chat, Google Docs, etc.
  • Re-architected the legacy Policy Management to achieve strong consistency, extensibility, and performance enhancements.
  • Designed and developed robust transactional semantics for APIs of Policy Management.
  • Redesigned the Policy Storage layer and Spanner Storage Data Model in order to handle emerging use-cases.
  • Improved the overall latency of various Policy APIs by 90%.
  • Defined processes and metrics to improve the Operational Excellence of the team. This helped reduce time to triage and time to resolve customer issues.
Cloud SQLGCPDistributed SystemsPolicy Management

Swiggy

Staff Software Engineer

Jul 2015Aug 2016 · 1 yr 1 mo · Bengaluru Area, India

  • Tech Lead Manager for the Data Analytics team.
  • Built the Data Platform for Swiggy from scratch including setting up the infrastructure, developing various backend features, Android app, Web dashboard, and leading the team.
  • Developed a horizontally scalable, highly available HTTP service to send data generated by various teams to the Data Platform.
  • Built a Recommendation system for Swiggy's restaurant listings. The service took into account a restaurant's popularity and was personalized for every user.
  • Built the ingestion, processing, and reporting layer for Swiggy to enable easy data analysis and help businesses make quick and well-informed decisions. This led to a revenue increase of up to 15%.
  • Built a real-time service for all critical business metrics and reported them via a web dashboard as well as an Android app. The service operated on the max freshness of 1 minute.
  • Set up the big data infrastructure (e.g. Hadoop, Kafka, Vertica, S3 integration, Zookeeper) for the Data Platform.
Data AnalyticsHadoopKafkaVertica

Flipkart.com

Senior Software Engineer

May 2014Jul 2015 · 1 yr 2 mos · Bangalore

  • Designed and implemented a generic engine for writing batch processing pipelines, i.e.
  • (Ingestion, Processing, Reports) on top of Hadoop which separates business logic from the core
  • Map/Reduce functionality. And lets one write business logic in the form of YAML config files.
  • Built a Framework for Real-time processing on top of Apache Storm, which lets clients write topologies in YAML-based config files which can be run on Storm. It supports various
  • Functionalities like Filter, Multiplex, Validation, Join, Lookups, De-duplication, etc. A topology can read from various Data Stores like Kafka, HDFS, etc. in various data formats and write the outputs to various data stores like Elasticsearch, Druid, Vertica, etc.
  • Built an Anomaly Detection system using Skyline for finding anomalies on various business metrics.
  • Optimized and performance-tuned Elasticsearch, Storm for our needs.
HadoopApache StormElasticsearch

Directi

Software Engineer

Jun 2011May 2014 · 2 yrs 11 mos · Gurgaon, India

  • Designed and implemented the complete connection layer architecture for communication with the Server.
  • Reduced time to search a buddy in the user's buddy list by 30%.
  • Deployed the continuous integration Server for over nightly builds and tests.
  • Wrote a reporting tool for logs with the backend as the trio of Fluentd, Elasticsearch, and Kibana.
Continuous IntegrationReporting Tools

Symantec

Software Developer Intern

Jan 2011May 2011 · 4 mos

  • I created a tool to convert SCAP Benchmarks to SM standard which is Symantec's own standard for CSM product

Education

Indian Institute of Technology, Roorkee

Master's degree

Stackforce found 100+ more professionals with Apache Spark & Java

Explore similar profiles based on matching skills and experience