Rahul Rastogi

Data Engineer

Begusarai, Bihar, India7 yrs 4 mos experience

Key Highlights

Expert in building and maintaining data pipelines.
Proficient in Azure Databricks and SQL for data migration.
Strong background in ETL processes and data analysis.

Stackforce AI infers this person is a Data Engineer specializing in Cloud Computing and Data Engineering.

Contact

Skills

Core Skills

Azure DatabricksSqlEtl

Other Skills

Azure Data FactoryDatabricksPySparkAirflowADFHadoopMongoDBJavaPL/SQLPower BIDatabase TestingDatabase QAData Build Tool (DBT)SnowflakeELT

About

Data engineer having total work Exp. 4 yrs with hands on experience in building/maintaining data pipelines using big data technologies like SQL, Python, Hadoop, PySpark, Azure data factory, ADB,Hive, Airflow, PL-SQL . Strong consulting professional graduated from Haldia Institute of Technology 103.

Experience

7 yrs 4 mos

Total Experience

2 yrs 4 mos

Average Tenure

3 mos

Current Experience

Ibm

Application Developer

Feb 2026 – Present · 3 mos · Noida, Uttar Pradesh, India · Hybrid

Neudesic, an ibm company

Consultant II

Aug 2024 – Jan 2026 · 1 yr 5 mos · Hyderabad, Telangana, India · On-site

> Worked on Migration project where we migrated the code base from Cloudera to Azure Databricks utilising the skills of Databricks, pyspark, SQL, ADF and Airflow.
> Working in Migration of oracle tables from on-premise to Azure cloud environment using Databricks as ETL platform.
>Handled end-to-end development lifecycle – ingestion to business layer with CI/CD deployment.

SQLAzure Data FactoryDatabricksPySparkAirflowAzure Databricks

Career break

Personal goal pursuit

Aug 2021 – Jul 2024 · 2 yrs 11 mos

UPSC and stuffs

Atos syntel

Associate Consultant

Oct 2018 – Jul 2021 · 2 yrs 9 mos · Greater Chennai Area

Worked as a data engineer in one of the migration projects. Day to day work involves creating ETL pipeline on an in-house ETL framework, orchestrate those ETL pipelines using Airflow.
Have worked in resolving data and platform issues reported in ESP( a ETL data warehouse tool of StateStreet) analyzing the complex data flow through complex code.
Experience in Java , SQL, PL/SQL, Power BI, Unix cloud box, performing DML operations in Oracle DB, migration of objects and analyzing the performance of Database objects.

HadoopMongoDBJavaSQLPL/SQLPower BI+1