basant dwivedi

Data Engineer

Noida, Uttar Pradesh, India5 yrs 1 mo experience

Key Highlights

Expert in designing scalable data pipelines.
Proficient in Azure Data Factory and Databricks.
Strong background in ETL solutions and data engineering.

Stackforce AI infers this person is a Data Engineering expert in SaaS environments.

Contact

basantdwivedi1@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringEtl SolutionsSql Development

Other Skills

PySparkAzure DatabricksDatabricksAzure Data FactoryData ModelingSQLProject ManagementProject PlanningMicrosoft FabricMilestonesScrumCommunicationTeam LeadershipSoftware Development Life Cycle (SDLC)Computer Science

About

I believe that true fulfillment comes from loving what you do. Guided by the philosophy that "If you love your work, you won’t have to work a single day," I bring passion, dedication, and a growth mindset to everything I take on. With a strong foundation in data engineering.I consistently seek opportunities that align with my interests and strengths, allowing me to deliver meaningful impact while enjoying the journey. For me, work isn’t just a responsibility—it’s a pursuit of purpose and continuous learning.

Experience

5 yrs 1 mo

Total Experience

1 yr 2 mos

Average Tenure

3 mos

Current Experience

Ibm

Data Engineer

Feb 2026 – Present · 3 mos · Noida, Uttar Pradesh, India · Hybrid

As a Data Engineer at IBM, my key responsibilities include designing and maintaining scalable data pipelines, extracting BlackLine data via APIs, ingesting into ADLS, implementing Medallion architecture (Bronze, Silver, Gold layers), ensuring data quality and governance, optimizing transformations, automating workflows, monitoring performance, handling incremental loads, and delivering business-ready datasets.

PySparkAzure DatabricksData EngineeringETL Solutions

Neudesic, an ibm company

Data Engineer

Jun 2025 – Jan 2026 · 7 mos · Hyderabad, Telangana, India · Hybrid

DatabricksAzure Data FactoryData EngineeringETL Solutions

Polestar solutions & services

Data Engineer

Oct 2024 – May 2025 · 7 mos · Noida, Uttar Pradesh, India · On-site

I have successfully designed and implemented robust ETL pipelines using Azure Data Factory, automating data ingestion from various sources into data lakes. Using PySpark in Databricks, I transformed large volumes of structured and semi-structured data efficiently, ensuring high performance and scalability. I have written complex SQL queries for data validation, cleansing, and reporting purposes. My work involved optimizing workflows for faster execution, managing incremental loads, and ensuring data accuracy across stages. By integrating ADF, PySpark, SQL, and Databricks seamlessly, I enabled real-time analytics and supported business intelligence initiatives with clean, reliable, and timely data delivery.

Data ModelingAzure Data FactoryData EngineeringETL Solutions