Yogesh Kothari

Senior Software Engineer

Bengaluru, Karnataka, India6 yrs 9 mos experience

Most Likely To Switch

Key Highlights

Expert in Big Data and Distributed Systems.
Proven track record in optimizing cloud migrations.
Strong leadership in cross-functional team initiatives.

Stackforce AI infers this person is a Big Data and Cloud Migration expert with a strong software development background.

Contact

Skills

Core Skills

Big DataDistributed SystemsCloudSoftware Development

Other Skills

.NET Core.NET FrameworkAPIAPI DesignASP.NET Web APIAWSAWS Boto3AgileAgile MethodologiesAlgorithmsAndroidAndroid DevelopmentAngularApache KafkaBack-End Web Development

About

I’m a Senior Software Engineer with 6 years of experience specializing in Big Data, Distributed Systems, and Cloud Migrations. My expertise includes Java, Hadoop, Spark, and building high-availability systems. Currently at Uber, where I ensure disaster readiness for a 400+ PetaBytes Hive data lake with data consistency and minimal replication lag. I’ve contributed to cloud migrations, batch-replication architecture redesigns, optimizing performance, improving scalability and reducing costs. Key Skills: - Languages: Java, Python, C# - Big Data: Hadoop, Spark, Kafka - Cloud: AWS, GCS, Kubernetes, Docker - Databases: MySQL, DynamoDB, Hive, Mongo I’m actively exploring senior engineering roles where I can leverage my experience in Big Data and distributed systems to solve complex problems at scale. Let’s connect!

Experience

Uber

SDE-II

May 2023 – Present · 2 yrs 10 mos · Bengaluru, Karnataka, India · Hybrid

Contributing to Uber's Batch Data Replication for ~300K Hive tables, ensuring 100% consistency across 370 Petabytes data. Orchestrating critical features, supporting daily 3 PB data replication within a 4-hour SLA, and ensuring seamless failover for uninterrupted operations.
Boosted data-replication speed to 350+ GB/min from initial 18 GB/min enabling ML team to train their models on Cloud GPUs
Achieved a 30% load reduction on Uber's Active Name-Node by efficiently redirecting over 20 Billion read requests/hour to Observer Name-Node. Demonstrating problem-solving skills in tackling challenging 'jar hell' issues and collaborating effectively with the HDFS team.
Redesigned Uber's batch Data Replication architecture, reducing server count from 12 to 2, enhancing scalability. This strategic shift will lead to a significant cost reduction, estimated saving $59k annually, equating to a 65% decrease in server expenses.
Partnered with YARN teams to develop a custom Docker image with Hadoop 3, enabling newer features in the Hive-Sync codebase supported Erasure Coding tests and Image Caching.
Supported Cloud Migration to GCS and OCI by establishing robust Cloud Monitoring dashboards and alerts, embracing new cloud technologies to support the Hybrid Cloud Architecture.
Contributed to code clean-up efforts, boosting test coverage from 60% to 80% and reducing technical debt.
Automated the junk file deletion process at Uber, ensuring 100% data consistency. Reduced the SLA from 8 hours to 2 hours and increased deletion efficiency by 1,400% leveraging multithreading.
Developed Piper pipeline to cleanup 10+ TB cold MYSQL data weekly using table-partitioning
Managed on-call operations by effectively resolving and documenting major incidents to runbook.
Enriching team wiki and runbooks with onboarding resources and system architecture diagrams.

JavaHadoopSparkCloud MigrationDockerKubernetes+3

Amazon

SDE-II

May 2022 – May 2023 · 1 yr · Bengaluru, Karnataka, India · On-site

Led a high-profile Anti-Piracy initiative, orchestrating collaboration across 5+ teams to streamline API contracts and design approaches. Developed services and workflows for watermarking videos, empowering dynamic watermark generation for over 150 million Amazon Prime Video customers.
Enhanced Video Quality score for watermarked titles from 92% to 98% at Amazon by analyzing 1200+ parameter combinations with data visualization tools (Python, Pandas, Matplotlib), optimizing user experience. Documented the results for stakeholder review.
Achieved successful integration of 300+ new watermarked titles and automated backfill for 2500+ titles in Q1-2023, employing Agile practices and AWS Boto3 Python SDK.
Mentored an intern and 3 junior developers; led code reviews and design validation, contributing to architectural understanding and team skill enhancement.
Enhanced expertise in Video on Demand (VOD) streaming protocols, OTT encoding flow, and content delivery technologies (CDN) using AWS services.
Managed on-call responsibilities, resolving 60+ high-severity incidents, conducting bug-bash sessions, and updating operational documentation to ensure continuous production stability.

PythonAWSAgileVideo on DemandData VisualizationCloud+1

Barclays

2 roles

Senior Software Developer

Promoted

Jun 2021 – May 2022 · 11 mos · Pune, Maharashtra, India

Orchestrated end-to-end development of a scalable Dashboard Application, supporting 10K users. Implemented extensible design patterns for easy feature additions and customized dashboard. (C#, .Net Core, MVC, MicroStrategy, REST API, SQL, Solace).
Promoted from BA3 to BA4 in May 2021 for exceptional performance and leadership.
Optimized database performance, achieving a 20-30% reduction in server load and successfully resolving critical Database Deadlocks, thereby enhancing system reliability and efficiency.
Enhanced Task-tracker process efficiency by 60% through Entity Framework and SQL code optimization, cutting operational time from 8 hours to 2.5 hours.
Developed a Python tool to facilitate production releases, minimizing manual RTB team efforts.
Recognized for "Excellence" in FY 2020-21 for server optimization and automation solutions.

C#.NET CoreSQLREST APIEntity FrameworkSoftware Development

Software Developer

Jul 2019 – Jun 2021 · 1 yr 11 mos · Pune, Maharashtra, India

Full-stack .Net Developer (C#, SQL, Entity Framework, REST API, Solace)

C#SQLEntity FrameworkSoftware Development

Sabertooth technologies

Software Developer

Feb 2018 – Jul 2018 · 5 mos · Nagpur, Maharashtra, India

Developed Dashboard to monitor price/volume trends for 500+ stocks, enabling user-configured alerts based on technical indicators (Python, Django, RabbitMQ, Multi-threading, API).
Performed Data Processing and Statistical Analysis on Nifty 50 financial dataset, correlating it to
news for event-driven stock market predictions (Pandas, Plotly, Web-scraping).

PythonDjangoAPISoftware Development