Anuj Verma

Senior Software Engineer

Ghaziabad, Uttar Pradesh, India9 yrs 7 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 9+ years of experience in data-intensive backend development
  • Expertise in building scalable data pipelines and systems
  • Proficient in multiple programming languages and frameworks
Stackforce AI infers this person is a Backend-heavy Data Engineer specializing in AdTech and SaaS solutions.

Contact

Skills

Core Skills

Apache SparkData EngineeringData PrivacyReal-time Data ProcessingBackend DevelopmentFull-stack Development

Other Skills

SnowflakeCassandraElasticsearchKafkaBigQueryAzure SQLApache Spark StreamingJavaPostgreSQLApache AirflowHiveApache KafkaRubySpring BootHibernate

About

Senior Software Developer with 9+ years of experience building data-intensive backends and distributed systems. Skilled in Spark, Scala, Python, Java, and TypeScript, with hands-on exposure to ML workflows and large-scale data platforms. Pragmatic engineer focused on reliability, performance, and cost efficiency.

Experience

9 yrs 7 mos
Total Experience
1 yr 11 mos
Average Tenure
3 yrs 3 mos
Current Experience

Walmart global tech

Senior Software Engineer

Mar 2023Present · 3 yrs 3 mos · Bengaluru · On-site

  • 𝗦𝗽𝗼𝗻𝘀𝗼𝗿𝗲𝗱 𝗔𝗱𝘀 𝗣𝗹𝗮𝘁𝗳𝗼𝗿𝗺
  • Built and maintained large-scale data pipelines powering Walmart’s Sponsored Ads platform, processing
  • billions of records daily across catalog ingestion, adserving, and attribution systems.
  • Designed and migrated Spark SQL workflows from a legacy Ruby orchestration layer to a modern PySpark-based framework running on Dataproc, improving scalability and maintainability.
  • Developed ingestion pipelines that aggregate product catalog and campaign data from Hive and write
  • outputs to Cassandra, Elasticsearch, Azure SQL, and BigQuery for downstream adserving and analytics.
  • Implemented event-driven attribution jobs consuming data from Kafka to compute last-click conversions and publish reports for advertisers to BigQuery and Azure SQL.
  • Developed housekeeping and validation jobs to monitor data consistency and pipeline health across multiple storage systems.
  • 𝗗𝗮𝘁𝗮 𝗖𝗹𝗲𝗮𝗻 𝗥𝗼𝗼𝗺 (𝗗𝗖𝗥)
  • Designed and implemented an in-house Data Clean Room (DCR) platform integrating with multiple providers
  • (in-house DCR, Snowflake DCR, BigQuery DCR, Habu) to enable privacy-preserving data collaboration between Walmart and external partners.
  • Built guided workflows for key AdTech metrics (conversion rate, overlap analysis, ad attribution) to streamline advertiser insights and measurement consistency across platforms.
  • Automated partner onboarding and data orchestration, reducing setup effort and ensuring reproducible
  • metric computation across DCR providers.
Apache SparkSnowflakeData Engineering

Delhivery

Senior Data Engineer

Feb 2022Mar 2023 · 1 yr 1 mo · Noida · On-site

  • Designed and optimized real-time data marts serving analytics and operational dashboards, processing
  • millions of logistics events daily.
  • Led migration from Postgres to TiDB (MySQL-compatible HTAP), improving scalability and reducing infrastructure costs by ∼40% ($65K annually).
  • Re-architected Spark Structured Streaming pipelines for logistics data, cutting compute usage to ∼20%
  • of previous levels while maintaining SLAs.
  • Built a periodic data-quality monitoring platform using Amazon Deequ with Grafana-based reporting,
  • improving observability across pipelines.
Apache Spark StreamingApache SparkData EngineeringReal-time Data Processing

Apple

Software Engineer

Jun 2019Feb 2022 · 2 yrs 8 mos · Greater Hyderabad Area

  • Developed large-scale Spark pipelines for Apple Maps data validation, processing billions of geospatial
  • records to detect inconsistencies and suggest automated fixes using graph theory and geometric algorithms.
  • Built internal backend services in Scala (Play Framework) and TypeScript to expose validation and analytics APIs for internal teams.
  • Practiced test-driven development (TDD) and collaborated with global teams (US, Sweden) in agile sprints.
Data EngineeringBackend Development

Ebizon

Software Developer

Mar 2017May 2019 · 2 yrs 2 mos · Noida

  • Built PushFlew (pushflew.com) — a SaaS platform enabling websites to engage users via push notifications
  • and email campaigns. Developed backend in Scala (Play Framework) and frontend in Angular.
  • Redeveloped AppifyCart (appifycart.com) — a SaaS solution for creating mobile apps for Magento stores,
  • using React and Redux for a modern, responsive UI.
Full-Stack DevelopmentBackend Development

Webkul software pvt ltd

Trainee Software Engineer

Oct 2016Mar 2017 · 5 mos · Noida Area, India

  • Worked as a Full Stack Developer using Wordpress(PHP) for backend and HTML, CSS, JS in Frontend.
  • Create, Update and Maintain several Wordpress websites.

Education

Dr. A.P.J. Abdul Kalam Technical University

B. Tech. — Electronics and Communications Engineering

Jan 2012Jan 2016

Stackforce found 100+ more professionals with Apache Spark & Data Engineering

Explore similar profiles based on matching skills and experience