Shweta Dubey

Data Engineer

Bengaluru, Karnataka, India7 yrs 7 mos experience

Highly Stable

Key Highlights

Over 6 years of experience in data engineering.
Expert in building Python-based data validation frameworks.
Proficient in managing Azure Data Factory pipelines.

Stackforce AI infers this person is a Data Engineering expert in the Automotive sector.

Contact

Skills

Core Skills

Data EngineeringPythonBig DataSoftware DevelopmentData Analysis

Other Skills

Data Quality ChecksTelemetry DataAzure Data FactoryHadoopApache SparkJavaSplunkIBM CognosMachine LearningPySparkSparkAzure DatabricksSQLScala in SparkSqoop

About

I have over 6 years of overall experience, including 4 years of focused experience in data engineering, currently working with a leading automobile client. My role primarily focuses on building and maintaining a Python-based data validation framework and implementing end-to-end data quality checks on large-scale telemetry data collected from test-drive vehicles. As part of a team that developed a custom Converter tool, I help transform raw MDF files into readable formats like Parquet and ORC for further processing. I’ve also designed and managed Azure Data Factory (ADF) pipelines to support two distinct data streams, ensuring smooth orchestration, schema alignment, and integration of new features. I’m passionate about the data engineering side of projects and actively take ownership of tasks involving PySpark, performance optimization, and complex transformation logic.

Experience

7 yrs 7 mos

Total Experience

5 yrs

Average Tenure

2 yrs 7 mos

Current Experience

Fractal

2 roles

Senior Data Engineer

Promoted

Oct 2025 – Present · 6 mos · Bengaluru, Karnataka, India

PythonData EngineeringData Quality ChecksTelemetry DataAzure Data Factory

Data Engineer

Aug 2023 – Sep 2025 · 2 yrs 1 mo · Bengaluru, Karnataka, India

Accenture

3 roles

Application Development Senior Analyst

Promoted

Nov 2021 – Aug 2023 · 1 yr 9 mos

HadoopApache SparkBig DataData Engineering

Application Development Analyst

Promoted

Jun 2020 – Nov 2021 · 1 yr 5 mos

Associate Software Engineer

Aug 2018 – Jun 2020 · 1 yr 10 mos

Studied the basics of Java, HTML, Software Development Fundamentals (SDF) and JS during the training that happened after the on boarding.
Got trained in IBM Cognos (a reporting tool) which deals with creating custom dashboards.
Was the representative during the training conducted.
Joined a project that works with Splunk (a reporting tool) for various international clients.
Executed few Python scripts for monitoring purpose (integrated Python with Splunk).
One of the key memebers of the team that is working with ATR (Automated Ticket Resolution) which is an application that deals with automating the tickets that are created through various platforms like ServiceNow, Jira and Remedy. The automation is done by calling python scripts/shell scripts and Machine Learning is also used to train the models.

JavaPythonSplunkIBM CognosMachine LearningSoftware Development+1

Powergrid corporation of india ltd

Summer Internship

May 2016 – Jul 2016 · 2 mos · Nagpur Area, India

Visited various substations (Wardha and Bhadrawati) across Western region and learnt about the working of 765KV stations.
Gave a presentation to the Executive Director of the Western region of Powergrid about the things learnt during internship.