Shivam Sharma

Engineering Manager

Bengaluru, Karnataka, India10 yrs 8 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in Big Data and Distributed Computing.
Proven track record in building scalable data solutions.
Strong background in real-time data processing and automation.

Stackforce AI infers this person is a Big Data and Distributed Computing expert in the SaaS industry.

Contact

Skills

Core Skills

Big DataData EngineeringDistributed Computing

Other Skills

AlgorithmsApache FlinkApache KafkaApache MesosBashCContinuous DeliveryContinuous IntegrationData ScienceDatabasesDockerDynamoDBEclipseHTMLHbase

About

Area of interest: Big Data, Distributed Computing, Large Scale Machine learning SKILLS: Computer Languages : Java, Python, Scala Big Data Technologies :- Zookeeper, Kafka, Spark, Hadoop, Docker Data Center Management(Hands On Experience): Mesos, Kubernetes Automation: Jenkins, Ansible JVM Profiling

Experience

10 yrs 8 mos

Total Experience

3 yrs 6 mos

Average Tenure

7 yrs 5 mos

Current Experience

Uber

4 roles

Engineering Manager II

Promoted

Apr 2025 – Present · 1 yr 2 mos

Staff Software Engineer

Mar 2024 – Apr 2025 · 1 yr 1 mo

Senior Software Engineer

Promoted

Jul 2021 – Mar 2024 · 2 yrs 8 mos

Software Engineer II

Dec 2018 – Jun 2021 · 2 yrs 6 mos

Goibibo

2 roles

Senior Data Engineer

Promoted

Apr 2018 – Nov 2018 · 7 mos · Bengaluru Area, India

Data Engineer

Aug 2016 – Apr 2018 · 1 yr 8 mos · Bengaluru Area, India

Created financial data pipeline for Goibibo, which is realtime and fault tolerant with reporting tool. It automated whole financial accounting, reporting and payouts for hotel which were handled manually. Technology used: Spark, Kafka, Hbase.
Created a Persuasion data store for GoIbibo Hotels. It supports queries like how many people are looking at this hotel right now and more like this. Single store is able to serve multiple use cases with >> 10K request per second. Technology used: Apache Flink, Redis & Kafka.
Created user activity store which is having all data of user in a single place which can serve queries around user as an Entity. Goibibo Chat bot & User Personalization are being powered by this. Technology used: Spark, Kafka(Kafka Streams + Kafka Connect), DynamoDB.
Improved Flight search experience using past bookings. Reduce the number of flights on Goibibo Search Page which increased speed and enabled Goibibo mobile app for 2G customers.
SQL Shift(explained in projects category)
Designed & Implemented scalable data warehouse for GoIbibo Hotels.

SparkKafkaZookeeperDockerMesosBig Data+1

Cognitree

Software Engineer

Jun 2015 – Jun 2016 · 1 yr · Bengaluru Area, India

Worked on Distributed Computing and Big Data Analytics. Following technologies are used for processing large data processing:
Spark (large scale data processing)
Kafka (distributed messaging system)
Zookeeper (distributed configuration management system)
Docker
Mesos (Operating system for data center)
Worked on real time data processing engine demonstrating credit card fraud detection.
Created Test Automation Driver for Middleware application which validates data flowing from all exposed interfaces of the system.
Profiling java applications with various tools like yourkit, jmap.
Responsible for setting up Continuous Integration using Jenkins for middleware and real time data
processing application.