Shubham Joshi

Senior Software Engineer

Bengaluru, Karnataka, India9 yrs 9 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Architected real-time marketing pipelines at Walmart.
  • Designed scalable ETL pipelines for diverse data sources.
  • Automated software license delivery, reducing turnaround time significantly.
Stackforce AI infers this person is a Backend Engineer specializing in MarTech and Fintech with expertise in data processing and microservices.

Contact

Skills

Core Skills

KafkaPysparkSpring BootApi DevelopmentAutomation

Other Skills

AI-based toolsAngularApache AirflowApache KafkaApache SparkAsset ManagementBigQueryCascading Style Sheets (CSS)CassandraETL pipelinesEhCacheGCP DataprocGoogle BigQueryGradleHTML5

About

Backend engineer passionate about building high-performance systems, scalable data platforms, and clean service architectures. At Walmart, I architected real-time marketing pipelines with Kafka, modernized core services, and introduced AI-powered tools that accelerated development across teams. At ADP, I designed backend platforms that powered 90%+ of tax/payroll workflows—building reliable services for metadata caching, auth, and orchestration. At TCS, I automated Ericsson’s global license delivery, reducing turnaround from days to seconds, and optimized telecom asset management. I bring deep experience with distributed systems, microservices, Kafka, Spring Boot, PySpark, and cloud platforms like GCP. I thrive in fast-paced environments where backend engineering drives product impact at scale.

Experience

Walmart global tech india

2 roles

Senior Software Engineer

Promoted

May 2023Present · 2 yrs 10 mos

  • Developed and integrated new campaign rules for send-time and open-time personalization, including email webhook and image rendering enhancements.
  • Boosted development efficiency by introducing AI-based PR review agents across all repositories.
  • Designed and implemented a centralized master service using Kafka Streams to synchronize data points, events, and subscriptions with third-party email triggering platforms.
  • Developed a reusable and configurable Kafka consumer framework, allowing dynamic API calls, JOLT transformations, and Kafka source/sink setups—significantly reducing development time for new consumers.
  • Designed scalable ETL pipelines using PySpark, GCP Dataproc, and Apache Airflow to process data from diverse sources like Kafka, MySQL, Cassandra, and Hive, and sync it to Hive, BigQuery, and other destinations—especially focusing on user interactions and marketing preferences.
KafkaAI-based toolsETL pipelinesPySparkGCP DataprocApache Airflow+4

Software Engineer III

Sep 2021May 2023 · 1 yr 8 mos

  • Architected and built an end-to-end Walmart+ marketing data pipeline using Apache Kafka, enabling seamless synchronization of marketing data points to support targeted Walmart+ campaigns.
  • Modernized legacy systems by migrating the preference-center service from Scala + Play Framework to a Java Spring Boot microservice, improving maintainability and performance.
Apache KafkaJavaSpring BootScalaPlay FrameworkKafka

Adp

Senior Member Technical

Nov 2019Sep 2021 · 1 yr 10 mos · Hyderabad, Telangana, India

  • Worked on ADP’s Tax/Payroll Compliance products to enable validations and add new compliance mechanisms as per respective tax agencies and US tax laws(for ex : Covid Relief act), to provide seamless client experience.
  • Worked on Client On boarding orchestration platform for creating/updating/fetching client tax profiles and syncing said changes across required products. Almost 90% of the tax/payroll subscription was routed by this platform.
  • Worked on centralized metadata caching microservice (used in memory cache: springboot + EhCache) that minimized frequent DB calls and improved metadata call performance for caller apps by 60 to 80% (it’s been adopted by 10+ apps internally).
  • Worked on API Auth Gateway (using spring cloud gateway as base) for authorizing caller apps (using Oauth 2.0) and provided scope for corresponding product access.
  • Worked on Standalone microservice for invoking parallel bulk REST calls, which gave users the flexibility to delegate parallel call invocation to this component by passing multiple REST calls in a single payload and receive combined response (adopted by 3 apps internally).
Spring BootEhCacheOAuth 2.0REST APIsAPI Development

Tata consultancy services

System Engineer

Jul 2016Nov 2019 · 3 yrs 4 mos · Hyderabad, Telangana, India

  • Worked on Ericsson’s Software delivery platform for online software packaging (upload), management and delivery (download) to Ericsson client groups across the globe.
  • Worked as primary engineer for automating Ericsson’s Software License key file generation, packaging/assignment and delivery to end systems. This reduced license generation and delivery timelines from couple of days (in some cases) to couple of seconds.
  • Worked on Ericsson’s Asset management system for allocating telecom assets across Ericsson landscape.
AutomationSoftware PackagingAsset Management

Education

SRM IST Chennai

Bachelor of Technology - BTech

Jan 2012Jan 2016

Stackforce found 100+ more professionals with Kafka & Pyspark

Explore similar profiles based on matching skills and experience