Subham Singhal

Senior Software Engineer

Bengaluru, Karnataka, India7 yrs 8 mos experience

Highly Stable

Key Highlights

Expert in building resilient data pipelines for ML training.
Significant cost savings achieved through platform redesign.
Strong open source contributions to Spark and Airflow.

Stackforce AI infers this person is a SaaS and IoT-focused software engineer with expertise in data engineering and cloud technologies.

Contact

Skills

Core Skills

Apache SparkDatabricksData AnalysisDockerVoip

Other Skills

AlgorithmsAmazon Web Services (AWS)Apache KafkaApache Spark StreamingAsteriskAutoscalerC++Call diagnosticsComputer NetworkingData StructureData ingestionData pipelinesDatabrickDelta LakeDesign Patterns

About

Software Engineer with several years of experience working in web technologies like Java, React, Reactive programming, quarkus, vertx, micro service architecture. Have strong understanding of data structures and algorithms and design patterns. Open source contribution in airflow and spark

Experience

Apple

Senior Software Engineer

Sep 2025 – Present · 6 mos · Bengaluru, Karnataka, India · Hybrid

Sharechat

2 roles

Software engineer III

Promoted

Sep 2023 – Sep 2025 · 2 yrs · Bengaluru, Karnataka, India

Building data pipelines to capture user click events and ingest in delta lake databricks which enables ML training and recommendations
Redesigned events platform with focus on resiliency and cost.Achieved cost saving of 2cr INR/month. Improved p99 response time of client facing service from 30sec to 1sec
Designed and developed spark based data ingestion system from scratch. Currently our system is handling around 400+TBs per day
Designed event reconciliation service to monitor and analyze hourly drop rates across dimensions including event type, client platform, and app version, improving visibility into system reliability and user experience.
Presented sharechat's data ingestion architecture at Databricks DI day talk 2024.
Developed an in-house autoscaler for Spark Structured Streaming, optimizing compute resource usage under varying load.
Contributed improvements and bug fixes to Spark and airflow-databricks-provider opensource library for managing streaming pipeline.

Data pipelinesDelta LakeDatabricksSparkEvent reconciliationAutoscaler+2

Software engineer II

Sep 2021 – Sep 2023 · 2 yrs · Bengaluru, Karnataka, India

Cisco

2 roles

Software Engineer III

Jun 2021 – Sep 2021 · 3 mos

Software Engineer II

Jul 2019 – Jun 2021 · 1 yr 11 mos

Software Engineer at Cisco IOx Fogdirector (An IOT solution to Fog computing).
IOx enables hosting of application and services developed by Cisco in the network edge devices in a seamless fashion across diverse and disparate hardware platforms.
Dockerised IOx fogdirector.
Implemented healthcheck and performance metrics in fogdirector.
Implemented push notification service which delivers device and its installed app status in real time.
Mentored intern in designing telemetry dashboard which visualises cisco's trending apps, devices and members count over a period of time

DockerHealthcheck implementationPerformance metricsMentoring

Zemoso technologies

Associate Software Developer

Aug 2018 – Jul 2019 · 11 mos · Hyderabad Area, India

Worked on development of web dialer using sip protocol for voice communication.
Load balanced voip server using kamailio.
Implemented fallback machanism to redirect calls through Twillio if asterisk server cannot handle calls or unreachable.
Involved in sip load testing.
Developed call diagnostic page which check if any port is blocked, asterisk server is reachable or not and check if audio buffers are coming from server by making a call.

SIP protocolVoIPLoad balancingCall diagnostics