Gaurav Rathi

Data Engineer

Pune, Maharashtra, India2 yrs 10 mos experience

Highly Stable

Key Highlights

Expert in building scalable data solutions on Azure.
Proven track record in BFSI sector data engineering.
Certified in Databricks with strong ETL architecture skills.

Stackforce AI infers this person is a Data Engineer specializing in Fintech with expertise in Azure-based data solutions.

Contact

Skills

Core Skills

Data EngineeringEtl ArchitecturePerformance OptimizationData Pipeline OptimizationData Pipeline Development

Other Skills

Azure Data FactoryDatabricksPythonETLData LakeMicrosoft FabricAzure SynapseSSISSQLData ValidationPower AutomateData ModelingExtract, Transform, Load (ETL)Data ProcessingData Architecture

About

Certified Data Engineer with about 3 years of hands-on experience in Python, SQL, PySpark, and Databricks, actively building scalable, high-performance data solutions leveraging Azure’s big data ecosystem including Azure Data Factory, Azure Synapse Analytics, Azure Data LakeGen2,AzureDatabricks and MicrosoftFabric. Proven track record in the BFSI sector delivering robust, end-to-end data engineering pipelines that optimize data workflows, enable real-time analytics, and drive data-driven decision-making to fuel business growth.

Experience

2 yrs 10 mos

Total Experience

2 yrs 10 mos

Average Tenure

2 yrs 10 mos

Current Experience

Bajaj finserv

3 roles

Senior Data Engineer

Promoted

Jan 2025 – Present · 1 yr 4 mos · Pune, Maharashtra, India · On-site

Spearheaded the development of the ONE-ETL Framework using Azure Data Factory, Databricks, and Python — automating complex data workflows and enhancing pipeline efficiency.
Designed a unified ETL architecture across platforms, reducing manual intervention and improving data flow by 30%.
Directed the migration from Azure Synapse to Data Lake & Microsoft Fabric, achieving up to 15x performance improvement.
Implemented Unity Catalog and SQL Endpoints to strengthen governance, streamline data discovery, and enforce access controls.
Migrated legacy SQL workflows to PySpark, reducing operational costs by 10x through efficient DataFrame transformations.
Led cross-functional teams to deliver scalable, production-grade ETL solutions supporting enterprise-level analytics.
Integrated diverse data sources: Azure Blob Storage, AWS S3, SQL Server, Oracle, PostgreSQL, MongoDB, SFDC, and SFTP.

Azure Data FactoryDatabricksPythonETLData LakeMicrosoft Fabric+2

Data Engineer

Promoted

Jul 2023 – Jan 2025 · 1 yr 6 mos · Pune, Maharashtra, India · On-site

Developed and optimized data pipelines using Azure Data Factory and SSIS, streamlining data ingestion and transformation.
Improved SQL performance through advanced query optimization and tuning, enhancing reporting speed and accuracy.
Built robust data validation and quality checks to ensure accuracy, consistency, and reliability of critical data.
Implemented Power Automate workflows for real-time alerts via Microsoft Teams, boosting operational responsiveness.
Handled multiple data formats — JSON, Parquet, CSV, Avro — ensuring seamless compatibility with ETL pipelines.

Azure Data FactorySSISSQLData ValidationPower AutomateData Engineering+1

Data Engineer

Jan 2023 – Jun 2023 · 5 mos · Pune, Maharashtra, India · On-site

Developed and optimized data pipelines using Azure Data Factory (ADF) and SSIS to automate data ingestion and transformation workflows.
Enhanced database performance through SQL query optimization and tuning, improving reporting speed and efficiency.
Implemented data validation and quality checks to ensure accuracy, consistency, and reliability of business-critical data.

Azure Data FactorySSISSQLData EngineeringData Pipeline Development