Shubham Gupta

Senior Software Engineer

Kanpur Nagar, Uttar Pradesh, India9 yrs 2 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in building scalable fraud detection systems.
  • Proficient in data engineering and machine learning platforms.
  • Strong background in service design and automation.
Stackforce AI infers this person is a Data Engineering and Machine Learning specialist in the SaaS industry.

Contact

Skills

Core Skills

Fraud DetectionData EngineeringMachine LearningService Architecture

Other Skills

CassandraService MigrationAutomationFeatureStoreSparkAerospikeData PropagationService DesignC++CJavaPHPMySQLAlgorithm DesignData Structures

About

Software Developer with knowledge and experience in Distributed Systems and Data Structures and Algorithms.

Experience

9 yrs 2 mos
Total Experience
3 yrs
Average Tenure
4 yrs 5 mos
Current Experience

Microsoft

2 roles

Senior Software Engineer

Sep 2023Present · 2 yrs 8 mos

Software Engineer 2

Nov 2021Aug 2023 · 1 yr 9 mos

Flipkart

2 roles

Software Development Engineer 2

Feb 2021Oct 2021 · 8 mos

  • Trust & Safety Team (Fraud Detection)
  • 1. Working on enhancing fraud detection services in the team
  • 2. Drove multiple service migrations across the team.
  • 3. Working on easing and automating Cassandra maintenance operations
CassandraFraud DetectionService MigrationAutomationData Engineering

Software Development Engineer

Apr 2019Feb 2021 · 1 yr 10 mos

  • Trust & Safety Team (Fraud Detection)
  • 1. FeatureStore
  • Part of the team responsible for building a highly scalable multi-tenant platform called FeatureStore that manages thousands of features for training and online serving of machine learning models and rules engine for fraud detection.
  • Designed the catalog service which maintains all meta information for the features and is the central piece of the platform. Worked on cli and flask powered UI for easier client interactions with featurestore, wrote a SDK which any client can integrate to ingest features into featurestore
  • Worked on the serving and ingestion layers for the store.
  • Wrote spark powered pipeline for batch feature ingestion into the store. Around 80 batch jobs on a daily basis ingest cumulatively billions of features in the store.
  • Worked cross team to integrate stream (real-time) feature ingestion into the store
  • Worked closely with Aerospike NoSQL database to establish storage contracts and optimizations for the store.
  • The system ingests around 30 billion feature values on a daily basis and serves a million features per second during flash sale
  • Ownership of the platform. All code changes, new feature asks etc. go through me
  • 2. CDC (Change Delta Capture)
  • Part of the team responsible that worked on a service called CDC which comprises of generator, commit manager and consumer components
  • It integrates with internal teams' to read data from the sources and propagates only the changed data from the last execution effectively bringing down the data volume. Clients can consume this data and define their processing logic on top of this.
  • Designed commit manager component end to end
  • Worked on the consumer component
  • For one of clients which used to ingest 200M records on a daily basis, this service brought down the number of records to 10M
FeatureStoreMachine LearningSparkAerospikeData Engineering

Hackerearth

2 roles

Problem Curator

Promoted

Jun 2017Mar 2019 · 1 yr 9 mos · Bengaluru Area, India

  • The work involves two major roles:
  • 1. Contributing towards the Code Evaluation Engine used by HackerEarth.
  • 2. Managing the challenges conducted on HackerEarth which involves problem creation and
  • problem testing as the main parts of the process.

Problem Curator Intern

Jun 2016Dec 2016 · 6 mos · Bangalore

  • My responsibilities include:
  • 1. Making good quality content for the HackerEarth website. I set and test algorithmic problems for challenges conducted on HackerEarth.
  • 2. Writing tutorials on various algorithms and data structures used in competitive programming.

Education

Indian Institute of Information Technology, Design and Manufacturing, Jabalpur

Bachelor’s Degree — Computer Science and Engineering

Jan 2013Jan 2017

N.L.K.Inter College, Vishnupuri, Kanpur

Intermediate

Stackforce found 100+ more professionals with Fraud Detection & Data Engineering

Explore similar profiles based on matching skills and experience