Varun sharma

Software Engineer

Amsterdam, North Holland, Netherlands12 yrs 6 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in building high-throughput, fault-tolerant pipelines.
  • Proven track record in real-time stream processing.
  • Passionate about mentoring and driving team growth.
Stackforce AI infers this person is a Backend-heavy Fullstack engineer specializing in SaaS and real-time data processing.

Contact

Skills

Core Skills

Distributed SystemsApache KafkaReal-time Processing

Other Skills

AlertingAlgorithmsApache SparkCassandraComputer ScienceCore JavaData StructuresElasticSearchElasticsearchFault-Tolerant SystemsJavaJavaScriptKafkaMonitoringProgramming

About

Software engineer with expertise in distributed systems and real-time stream processing. Experienced in building high-throughput, fault-tolerant pipelines, scalable data platforms, and real-time insights systems. Proven track record of building with an observability-first mindset, ensuring robust monitoring and alerting, and designing highly available, resilient services. Passionate about tackling complex challenges, mentoring teams, and driving continuous learning and growth.

Experience

Databricks

Software Engineer

Apr 2019Present · 6 yrs 11 mos · Amsterdam Area, Netherlands · On-site

  • Billing Platform.
  • Execution Gateways.

Booking.com

Software Engineer

Sep 2016Mar 2019 · 2 yrs 6 mos · Amsterdam Area, Netherlands

  • Built a scalable, fault-tolerant events and logs pipeline handling 700K+ events/sec and 1M+ logs/sec.
  • Introduced Apache Kafka as the transport layer, enabling adoption across multiple teams and clusters.
  • Designed and implemented a highly available, lightweight Go-based proxy/router (40K+ instances) to relay events and logs ensuring reliability and visibility.
  • Migrated large-scale events pipelines from in-house systems to Kafka, reducing event delivery latency from 13s to 4s.
  • Enhanced log pipeline stability by replacing Rsyslog relays with Kafka + Logstash.
  • Defined and implemented SLIs/SLOs, with robust monitoring and alerting.
  • Contributed to team growth through mentorship, onboarding, interviews, and trainings.
Apache KafkaScalable SystemsFault-Tolerant SystemsMonitoringAlertingDistributed Systems

Flipkart

Software Engineer

Aug 2014Aug 2016 · 2 yrs · Bengaluru Area, India

  • Worked on building the Geo Platform for the Supply Chain arm, enabling real-time, fault-tolerant event processing and insights.
  • Developed batch and streaming pipelines using Apache Spark, Cassandra, Kafka, and Zookeeper, delivering key insights at scale.
  • Built application for Hub managers to track and visualise their fleet.
  • Contributed to address understanding and geocoding algorithms leveraging OpenStreetMaps and the location data ingested.
  • Built the Insights Platform for real-time events (e.g., shipment state changes, SLA breaches) using Kafka, Spark, Redis, Elasticsearch, and Kibana.
Apache SparkCassandraKafkaZookeeperRedisElasticsearch+2

Walmart labs

Software Engineer

Jul 2013Aug 2014 · 1 yr 1 mo · Bengaluru Area, India

  • Developed and enhanced the Customer Service Center Application on the ATG framework with end-to-end ownership of multiple projects.
  • Led key initiatives including ATG upgrade, REST integrations, unauthorized activity automation.
  • Collaborated with customer service agents in Cape Town, gathering feedback and integrating enhancements into the application.

Cisco systems

Software Engineer Intern

Jun 2012Jul 2012 · 1 mo · Bengaluru Area, India

  • Contributed to alpha testing of Cisco GSS (Global Site Selector) to improve DNS responsiveness and ensure data center availability, including features like NS/SOA and Keepalives. Automated testing workflows using Expect scripts.

Education

Netaji Subhas Institute of Technology

Bachelor of Engineering (B.E.) — Computer Science

Jan 2009Jan 2013

Shanti Gyan Niketan

AISSCE — Science

May 2007May 2009

Stackforce found 100+ more professionals with Distributed Systems & Apache Kafka

Explore similar profiles based on matching skills and experience