Saurabh Yadav

Senior Software Engineer

Bengaluru, Karnataka, India3 yrs 11 mos experience

Key Highlights

Designed a rate limiting library for major services.
Optimized ElasticSearch indexing, reducing shard count by 90%.
Streamlined large message processing, cutting time by 30x.

Stackforce AI infers this person is a Backend-heavy SaaS Engineer with expertise in distributed systems.

Contact

Skills

Core Skills

DynamodbElasticsearchSpring Boot

Other Skills

SQLProblem SolvingAWS S3Parallel ProcessingSQSMockitoTroubleshootingTechnical EngineeringGitBack-End Web DevelopmentSoftware DevelopmentIntegration TestingObject-oriented LanguagesDatabasesLow-Level Design

About

I am a Senior Software Engineer currently working at Confluent, building scalable systems and solving challenging distributed systems problems. Prior to this, I worked at Amazon where I was part of a core team handling the creation and ingestion of invoices for Amazon Shipping and third-party carriers. At Amazon, I led multiple initiatives, including designing a granular rate-limiting library adopted across five major services, optimising ElasticSearch cluster indexing reducing shard count by 90% and data nodes by 50%, and architecting a secure multilingual scripting platform for production use. I engineered DynamoDB solutions for managing oversized payloads using AWS S3, improved large messages processing times by 30x, and streamlined peak traffic handling for major sale events like Prime Day and Black Friday. Beyond backend system design and operational excellence, I have experience working with AWS technologies (DynamoDB, S3, Lambda, ECS, Step Functions), Spring Boot, ElasticSearch, and large-scale distributed systems. I am passionate about building reliable, performant systems and continuously learning to improve architecture, scalability, and developer productivity.

Experience

3 yrs 11 mos

Total Experience

2 yrs 10 mos

Average Tenure

1 yr 1 mo

Current Experience

Confluent

Senior Software Engineer

Apr 2025 – Present · 1 yr 1 mo · Bengaluru, Karnataka, India · Remote

Amazon

2 roles

SDE

Promoted

Jun 2022 – Apr 2025 · 2 yrs 10 mos · Hyderabad, Telangana, India · Hybrid

Designed granular rate limiting library consumed by 5+ major services to separate rate limiters for downstream calls in different flows as well as for different clients to solve noisy neighbor problem without creating separate resource stacks
Spearheaded redesign of ES cluster indexing strategy to achieve optimal shard size and improve cluster health, JVM pressure, search latency and reduce shard count by 90% and data nodes by 50%+ and drove implementation by mentoring an intern
Designed internal solution for DynamoDB for storing items exceeding 400 KB size limit constraint by utilizing AWS S3 as blob storage for attributes with larger size which helped solve processing failure backlog for 100K+ billed invoices
Spearheaded the initiative to streamline processing of large payload messages, reducing processing time from 5-6 hours to less than 10 minutes by leveraging parallel processing, tweaking rate limiters, cache implementation and improved failure visibility
Enhanced retry mechanisms by implementing jitter and exponential back-off during retry for DynamoDB interactions to solve processing failures due to recurring throttling issues caused by hot partitions causing 100K+ failures in DDB writes monthly
Pinpointed and rectified processing failures happening in all 20+ SQS consumers for in-flight requests during every deployment in ingestion service resulting in 1K+ invoice processing failures monthly that required manual intervention for resolution
Eliminated failures in local and dry run builds by identifying race condition with Mockito argument captors in multi-threaded
scenarios and fixed by switching to synchronized data structures to increase success rate from around 1 out of 3 runs to 100%
Optimized the build time of major service with 3600+ Unit Tests from 10 minutes+ to less than 3 minutes

SQLProblem SolvingDynamoDBElasticSearch

SDE

May 2021 – Jul 2021 · 2 mos · India · Remote

Worked on a project that enabled accounting automation for transportation carriers by deriving
accounting automation status
Designed and built the service layer for the required carrier service and completed its API integration
Configured package-level configuration and implemented logic to fetch the decisive fields for
determining automation status

SQLProblem Solving