Dipanshu Pandey

Software Engineer

Bengaluru, Karnataka, India3 yrs 2 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Expert in backend engineering and big data solutions.
  • Proven track record in optimizing data pipelines.
  • Strong experience in ad-tech and anti-fraud systems.
Stackforce AI infers this person is a Backend Engineer specializing in Big Data solutions within the Ad-Tech industry.

Contact

Skills

Core Skills

Backend EngineeringBig Data

Other Skills

AlgorithmsAnthropic ClaudeApache AirflowApache KafkaApache SparkArtificial Intelligence (AI)CClient-HintsCompetitive ProgrammingComputer ScienceData MiningData ModelingData ProcessingData QualityData Structures

About

I am a Software Engineer with experience in building scalable, high-throughput backend and data systems across domains like ad-tech, anti-spam, and large-scale consumer platforms. Currently at Uber, I work on backend and data pipelines for Uber Eats, focusing on Spark SQL, distributed systems, and large-scale data processing. I enjoy solving complex problems in distributed systems, backend engineering, and data-intensive applications. I thrive in environments where system performance, scalability, and reliability are critical. I am also proficient with modern AI coding assistants and productivity tools, including Cursor, Claude, OpenAI, and Gemini, which I actively leverage to accelerate development and improve engineering workflows. Technical Skills Languages: Java, C++, Python, Scala Frameworks/Tools: Spark (SQL/Streaming), Hadoop, FastAPI Areas: Distributed Systems, Backend Engineering, Big Data, Microservices, System Design

Experience

Uber

Software Engineer

Jun 2024Present · 1 yr 9 mos · Bengaluru, Karnataka, India · On-site

  • Working with web data team, Developed and integrated enrichment layers into existing ETL workflows to enhance data quality and ensure that downstream analytics teams receive accurate, actionable information. Improved end-to-end data pipeline performance by implementing advanced Spark optimizations and refined execution plans, achieving a 50% reduction in processing time while reliably handling over 6 TB of daily event data.
Spark SQLDistributed SystemsData ProcessingETL WorkflowsBackend EngineeringBig Data

Media.net

2 roles

Software Engineer

Jan 2023Jun 2024 · 1 yr 5 mos · Bengaluru, Karnataka, India · Remote

  • I worked on large-scale anti-fraud and identity systems, mining 2 TB/day of clickstream data in PySpark to build a fingerprinting model that attributes >90% of traffic without cookies. I developed a Go-based fraud replay service using WebGL, processing 1K events/sec to generate session videos that cut investigation time from hours to minutes. I also designed a UA-spoof detection pipeline leveraging Client-Hints vs. legacy User-Agent mismatches, improving spoofed-agent catch by 15% and protecting 2M impressions daily. As an intern, I enhanced the Pixel Verification System by building a Selenium framework and deploying a scalable FastAPI microservice with Docker.
PySparkGoWebGLFastAPISeleniumBackend Engineering+1

Software Engineer Intern

May 2022Jul 2022 · 2 mos · India

  • Collaborated with the Spam Detection team to optimize the data collection process for the verification system. Compiled a comprehensive list of over 20 distinct user engagement activities for the framework’s
  • configuration. Created an automated framework utilizing Selenium to replicate user activities.
Selenium

Coding ninjas

Problem Setting

Dec 2021May 2022 · 5 mos · Remote

  • Created data structure and algorithm problems and drafted well-structured editorials for problems, explained various approaches for problems along with their time and space complexity.
Data StructuresAlgorithms

Education

Graphic Era Deemed to be University

Bachelor of Technology - BTech — Computer Science and Engineering

May 2019Jun 2023

Stackforce found 100+ more professionals with Backend Engineering & Big Data

Explore similar profiles based on matching skills and experience