Deepak Kumar

Data Engineer

Bengaluru, Karnataka, India6 yrs 11 mos experience

Most Likely To Switch

Key Highlights

Expert in building scalable data pipelines.
Reduced costs by 30% through optimized data processes.
Strong background in AdTech and finance.

Stackforce AI infers this person is a Data Engineer specializing in AdTech and Fintech with expertise in Big Data solutions.

Contact

+912244231226 LinkedIn

Skills

Core Skills

Data EngineeringBig DataMachine Learning

Other Skills

AirflowApache KafkaApache SparkAzure DataBricksAzure DatabricksCNNDeep LearningETLExtract, Transform, Load (ETL)GrafanaJavaKafkaMicrosoft AzureOpenCVPrometheus

About

I am a seasoned data engineer with expertise in building scalable data pipelines, driving business growth through data-driven insights. Currently, as a Data Engineer III at Walmart, I develop innovative solutions to match demand and supply for targeted advertisements, leveraging Airflow, PySpark, Scala, Prometheus, Grafana and Kafka. I graduated from Birla Institute of Technology and Science, Pilani in 2019 with a Bachelor's degree in Electronics and Instrumentation. Since then I have extensively worked on designing and optimizing data architectures, gaining a strong background in AdTech, finance, and spend management. Outside of work, I enjoy exploring the intersection of technology and creativity through 3D printing. Let's connect and explore opportunities to harness the power of data for business success!"

Experience

Walmart global tech india

Data Engineer III

Jan 2023 – Present · 3 yrs 2 mos · Bengaluru, Karnataka, India · On-site

Working in AdTech team on inventory management system to match demand(advertisers) and supply(ad view) for targeted advertisement.
Creating data pipelines using Airflow to sample from TBs of supply(ad view) data for forecasting.
Optimized supply data pipelines, reducing costs by 30%.
Created a DQ framework for Grafana dashboards to monitor system health.
Developed an evaluation framework to compare forecast and actual data for targeted advertisements.

Python (Programming Language)GrafanaApache SparkPrometheusAirflowScala+2

Bankbazaar

2 roles

Senior Data Engineer

Promoted

Jul 2022 – Dec 2022 · 5 mos

Developed a framework for executing data pipelines using PySpark with json configuration.
Created Kafka stream processors using Spring Boot to process real-time data streams exceeding 100 million records daily.
Created and maintained spring boot REST APIs for customer related data.

JavaApache KafkaPython (Programming Language)Apache SparkAirflowScala+2

Data Engineer

Jul 2021 – Jun 2022 · 11 mos

Gep worldwide

Data Engineer

Jul 2019 – Jun 2021 · 1 yr 11 mos · Navi Mumbai, Maharashtra, India

Developing ETL pipeline using Azure DataBricks to process Spend Data of diverse and large number of clients.
Creating Automation suite to test ETL pipelines in Azure DataBricks.
Handling 100GB+ of Spend Data at monthly level.

Python (Programming Language)Apache SparkScalaData EngineeringBig Data

Ust global

Machine Learning Intern

Jul 2018 – Dec 2018 · 5 mos · Thiruvananthapuram Area, India

Designed and implemented end to end system for Real Time ID Card Verification. U-Net architecture was used to detect ID Cards, Morphological operations were used for skew and color correction, MSER was used to detect text regions and OCR Model was used to extract relevant information.
Created OCR Model using OpenCV to segment text and CNN to classify characters.
Developed Barcode Reading Model using OpenCV to detect and pyzbar to decode barcodes.
Implemented Fruit Detection Model using R-CNN on Fruits 360 dataset. Achieved an accuracy of above 90% for 75 classes.