Vipul Pandey

Senior Software Engineer

Greater Vancouver, Canada9 yrs 7 mos experience

Highly Stable

Key Highlights

Expert in Big Data technologies like Spark and Hadoop.
Proven experience in data engineering and analytics.
Strong background in developing scalable data solutions.

Stackforce AI infers this person is a Big Data and Data Engineering specialist in the SaaS industry.

Contact

Skills

Core Skills

Big DataData Engineering

Other Skills

AdvertisingAndroid DevelopmentApache AirflowCC++CSSComputer HardwareData StructuresDatabasesElasticsearchGrafanaHTMLHiveJavaJavaScript

About

Experienced Software Engineer with a demonstrated history of working in the computer software industry. Skilled in Scala, Java, Python, Apache Spark, Hive, Hadoop, Apache Airflow, Databases and Big Data Analytics. Strong engineering professional with a Bachelor’s Degree focused in Information Technology from Indian Institute of Information Technology (IIIT), Allahabad.

Experience

9 yrs 7 mos

Total Experience

4 yrs 9 mos

Average Tenure

Current Experience

Amazon

2 roles

Senior Software Development Engineer

Oct 2025 – Present · 7 mos

Software Development Engineer II

Feb 2020 – Oct 2025 · 5 yrs 8 mos

Walmart global tech

3 roles

Software Development Engineer III

Aug 2018 – Feb 2020 · 1 yr 6 mos

Customer Data for Walmart
Worked on generating generalized data for website, app and subsidiaries. The data included the interactions of a customer in any possible way like the browsing data.
Tools/Languages – Spark, Grafana
Segmenting 500 million users into customer defined segments
Worked on generating data required to segment user in buckets based on specific demographics so as to retarget them efficiently and effectively.
Tools/Languages – Spark, Hive, Python

SparkGrafanaHivePythonBig DataData Engineering

Software Development Engineer II

Aug 2016 – Jul 2018 · 1 yr 11 mos

Building Airflow as a platform for scheduling and monitoring Pipelines
Worked on creating a platform to schedule, monitor and author workflows. This platform replaced the traditional cronjobs and helped in dependency management, fault tolerances and parallelism.
Tools/Languages – Apache Airflow, MySQL
Recommendation Generation and uploading for Display Advertising
Worked on setting up and developing a system to extract, process, transform, generate and upload recommendations and bids data for Display Advertising.

Apache AirflowMySQLData Engineering

Software Developer Intern

Jan 2016 – Jul 2016 · 6 mos

Heatmap backend showing daily orders of Walmart.com US city wise -
Worked on creating an ETL pipeline for daily data population with details of online orders where color ranges from dark to light according to number of orders from a particular location.
Tools/Languages – Hive, MySQL, Java, Shell
Attribution Analysis
Analyzing and comparing various attribution models like Last Touch, First Touch, Linear and time decay and suggesting Walmart’s marketing team about which method will be most appropriate to incorporate.
Tools/Languages – Hive

HiveMySQLJavaShellData Engineering

Citi

Software Engineer Intern

May 2015 – Jun 2015 · 1 mo · Pune, Maharashtra, India

Centralized data and log monitoring/search platform(CDLMS) -
This project aimed at creating a centralized search platform that gathered log and data from various locations and send it to a centralized system for the purpose of analysis and searching graphically using an interface.
Tools Used: Logstash, Elasticsearch and Kibana.
Extension: The project was further extended to the existing search UI of the company. I created a Java based API that instead of searching in their database was now retrieving the indexed data from elasticsearch and hence assisted in faster searching.
Languages Used: Logstash Scripting Language and Java

LogstashElasticsearchKibanaJava