Deepak Chaudhary

Data Engineer

Delhi, India5 yrs 1 mo experience

Highly Stable

Key Highlights

Over 5 years of experience in Data Engineering.
Expert in designing scalable data pipelines.
Strong background in financial data analytics.

Stackforce AI infers this person is a Data Engineering expert in the Fintech industry.

Contact

dpkchaudhary24@gmail.com 8882020899 LinkedIn

Skills

Core Skills

Data EngineeringData AnalyticsData Quality Assurance

Other Skills

Analytical SkillsAzure CloudAzure Data FactoryAzure DatabricksBusiness InsightsBusiness RequirementsCritical ThinkingData AnalysisData LakesData ModelingData QualityData ReconciliationData StructuresData ValidationDataStage

About

I love #Data Engineering and every day I am learning to apply the principles of Data Engineering , #Analytics & #Business Intelligence in solving problems for #financial and non-financial data of Telecom and banking domain. I have been working in the fields of Data analytics of finance department in Telecommunication ,airline and banking domin for 5+ years . where I learned analysis data and developed and maintained #data pipelines using latest trending technology like : #Pyspark, #spark SQL, #Databricks, #azure data factory, #Python, #SQL, #Bigdata, #cloud, #Azure cloud I played an integral part of the development and operations team to complete all the tasks within the time limit. I completed B. Tech (CSE) with the first div from G. L. Bajaj I. T. M. (Greater Noida) affiliated with Dr. A.P.J. Abdul Kalam Technical University, Lucknow ,U.P., India where I learned all technical and management skills . I love to read the latest trends in the fields of Data Science, Analytics and how businesses are using the same to become better and more efficient. When I am not reading nor researching Data Science and Tele-communication , airlines and banking. I like cooking, travelling, meeting new people, reading, and writing . Here I would love to connect with industry professionals and experts in the fields of Data Science, Analytics, financial services and banking domain

Experience

5 yrs 1 mo

Total Experience

1 yr 9 mos

Average Tenure

1 yr 7 mos

Current Experience

Ey

2 roles

Senior GCP Data Engineer

Promoted

Feb 2025 – Present · 1 yr 3 mos · Gurugram, Haryana, India

Designed and optimized scalable data pipelines on GCP for financial reporting and analytics.
Developed data models and ETL workflows using BigQuery, Dataflow, and PySpark.
Ensured data quality through validation, transformation, and orchestration with Cloud Composer.
Collaborated with stakeholders to deliver high-impact, reliable financial data solutions.
Skills: GCP (BigQuery, Dataflow, Composer), PySpark, SQL, Python, Data Modeling

GCP (BigQuery, Dataflow, Composer)PySparkSQLPythonData ModelingData Engineering+1

Senior Azure Data Engineer

Sep 2024 – Jan 2025 · 4 mos · Gurugram, Haryana, India

Partnered with Air India’s financial team to design, maintain, and optimize data solutions for financial reporting and analytics.
Developed conceptual and logical information models in alignment with enterprise and business unit architecture.
Translated complex business requirements into scalable technical specifications and data solutions.
Performed data modeling to support financial dashboards and KPIs, ensuring accuracy and consistency in reporting.
Designed and developed data pipelines using PySpark and Azure Databricks for processing large volumes of airline financial data.
Created and optimized Databricks notebooks with a focus on performance, modularity, and reusability.
Led efforts to enhance query performance, reduce processing time, and optimize cloud resource utilization.
Implemented robust data integration workflows using Azure Data Factory and Spark SQL.
Architected secure and cost-efficient data storage strategies leveraging Azure cloud services.
Executed monthly ETL operations and quality checks, supporting data integrity and operational continuity.
Skills: Azure Databricks, Azure Data Factory, PySpark, Spark SQL, Azure Cloud, Python, Pandas, PL/SQL, Excel

Azure DatabricksAzure Data FactoryPySparkSpark SQLAzure CloudPython+5

Tata consultancy services

3 roles

Azure data engineer

Promoted

May 2023 – Sep 2024 · 1 yr 4 mos · Pune, Maharashtra, India

Developing conceptual and logical information models within the context of the Entreprise and line of business information architecture.
To analyse and translate business requirements into technical specification and deliver productive solutions.
Perform data modelling to support data to dashboards and then design data pipelines for the same .
Integration of data from various sources using Pyspark, Databricks, azure Databricks and sql.
Performing monthly ETL activities to run processes as an operations team part.
skills- Azure Databricks, Azure data factory, Pyspark , Spark - SQL ,Azure cloud, python , panada, ,pl sql, Excel

Azure DatabricksAzure Data FactoryPySparkSpark SQLAzure CloudPython+5

Data Engineer

May 2022 – Apr 2023 · 11 mos · Pune, Maharashtra, India

Developing conceptual and logical information models within the context of the Entreprise and line of business information architecture.
To analyse and translate business requirements into technical specification and deliver productive solutions.
Perform data modelling to support data to dashboards and then design data pipelines for the same .
Integration of data from various sources using spark and sql.
Performing monthly ETL activities to run processes as an operations team part.
skills- python , spark ,pl sql, Excel

PythonSparkPL/SQLExcelData Engineering

Pyspark Developer

May 2021 – Apr 2022 · 11 mos · Pune, Maharashtra, India

Migration of ETL jobs from SAP BODS to spark.
Automated ETL process across millions of rows of data which reduces manual workload by 40 % monthly.
Re-structured schema with 100+ tables to enhance data integrity.
optimized multiple data ingestion jobs .
Skills - python , spark ,pl sql , Excel.

PythonSparkPL/SQLExcelData Engineering

Qa infotech - your software testing partner

Software Test Engineer(ETL tester)

Dec 2020 – Apr 2021 · 4 mos · Noida, Uttar Pradesh, India · On-site

Skilled in ETL testing, data validation, and data reconciliation
🔹 Strong proficiency in SQL, data profiling, and debugging large datasets
🔹 Hands-on experience with tools like Informatica, Talend, SSIS, DataStage, or Azure Data Factory
🔹 Expertise in writing test plans, test cases, and executing functional, regression & UAT tests
🔹 Deep understanding of data warehousing concepts, dimensional modeling, and staging-layer validations
🔹 Familiar with Agile/Scrum methodologies and CI/CD practices in data testing environments

SQLETL TestingData ValidationData ReconciliationInformaticaTalend+4