Neeraj Sharma

Software Engineer

Patna, Bihar, India6 yrs 9 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Reduced costs by 64% at Walmart.
Delivered scalable data solutions for Apple Maps.
Engineered ETL pipelines enhancing AdTech analytics.

Stackforce AI infers this person is a Data Engineering expert in Retail and AdTech industries.

Contact

Skills

Core Skills

Data EngineeringBig Data

Other Skills

AWSAndroid DevelopmentApache SparkCC++ConcordCore JavaDatabase Management System (DBMS)FlaskGCSGitOpsHTMLHTML5Java 11Leadership

About

Experienced Data Engineer with a proven track record in designing and scaling high-performance data platforms across enterprise environments like Walmart, Apple, and Sigmoid Analytics. At Walmart, led the migration of the Commerce Platform metrics pipeline—reducing annual costs by 64% (from $1.03M/year to $0.38M/year) and cutting client onboarding time by 50%. Delivered the Self-Serve RUM Platform end-to-end, automated via Concord and GCS, and drove modernization initiatives including GitOps 2.0, OpenObserve, and Java 11 upgrades, improving platform scalability and reliability. At Apple, built and deployed robust data pipelines for the Signal Exchange Platform, leveraging Apache Spark, PostgreSQL, and AWS to support large-scale ingestion and processing for the Apple Maps team. At Sigmoid Analytics, engineered scalable ETL and data ingestion pipelines using Spark, Scala, Python (Flask), and AWS, driving AdTech analytics and enhancing client onboarding. Designed key product features like BulkFilter and Unlimited Report Download, improving performance and user experience. Skilled in:- Big Data & Distributed Systems: Apache Spark, Scala, Hadoop, HDFS, Hive, Airflow, PySpark, RDD, BigQuery Programming & Frameworks: Python, Java, C/C++, Flask Databases: MySQL, PostgreSQL, MongoDB, Firestore Cloud & DevOps: AWS, Google Cloud (GCS), Azure, Git, Bitbucket, Unix Data Engineering: ETL Pipelines, Data Modeling, Data Cleansing, Streaming & Batch Processing, Automation Workflows Other Skills: Algorithms, Data Structures, Problem Solving, System Optimization

Experience

Topmate.io

Mentor

Mar 2024 – Present · 2 yrs 1 mo · Remote

Walmart global tech india

Software Engineer III

Nov 2022 – Present · 3 yrs 5 mos · Bengaluru

Led Walmart Commerce Platform metrics pipeline migration, achieving 64% cost reduction (from $1.03M/year to $0.38M/year) and cutting client onboarding time by 50%. Recognized by leadership for delivering a scalable, efficient pipeline solution.
Delivered end-to-end implementation of the Self-Serve RUM Platform, including PostgreSQL setup, schema design, YAML-based configuration generation (Cardinality, Metric, GroupBy, Dimension), and full automation using Concord workflows and GCS integration.
Led multiple migration and modernization efforts, including GitOps 2.0, OpenObserve (from Splunk), Looper Pro, platform-web-teflon, and Java 11 upgrades—improving observability, reliability, and platform consistency.
Introduced Spark profiling and cardinality reduction to optimize performance and reduce infrastructure costs.

Apache SparkPostgreSQLGCSGitOpsJava 11Data Engineering+1

Apple

Software Development Engineer

Jul 2021 – Oct 2022 · 1 yr 3 mos · Hyderabad

Developed and deployed end-to-end data pipelines for the Signal Exchange Platform using Apache Spark, PostgreSQL, and AWS, including a complex ingestion pipeline for the Apple Maps team to enable scalable and efficient data processing.

Apache SparkPostgreSQLAWSData Engineering

Sigmoid

3 roles

SDE-I

Promoted

Jan 2021 – Jul 2021 · 6 mos

Implemented key product features including BulkFilter and Unlimited Report Download, significantly enhancing data accessibility and report generation efficiency for end users.
Architected and deployed scalable data ingestion solutions capable of handling large volumes of real-time and historical data from multiple heterogeneous sources.
Integrated and migrated multiple new clients onto the Sigview platform, ensuring seamless onboarding and data consistency across diverse data pipelines.
Developed backend services using Python (Flask framework) to support new functionalities, streamline data workflows, and enable robust API-driven integrations.

SparkScalaPythonFlaskData Engineering

Associate Software Development Engineer

May 2019 – Dec 2020 · 1 yr 7 mos

Implemented an end-to-end ETL pipeline to process large-scale AdTech datasets using Spark, Scala, and AWS. Involved in comprehensive data understanding, cleaning, and transformation to derive actionable insights.

SparkScalaAWSData Engineering