Rajat Singh Parihar

CEO

New Delhi, Delhi, India5 yrs 4 mos experience

Key Highlights

Over 3 years of experience in Azure Data Engineering.
Expert in orchestrating complex ETL workflows and data transformations.
Proficient in optimizing data solutions for performance and cost.

Stackforce AI infers this person is a Data Engineering expert in SaaS environments, specializing in Azure technologies.

Contact

Skills

Core Skills

Data EngineeringAzure

Other Skills

Azure Data FactoryAzure DatabricksETLADLSData LakeData SecurityPySparkSQLParquetCI/CDData LoadingPythonSparkSnowflakeSnowflake Cloud

About

Data Engineer | Azure | ETL | Pyspark | Azure Databricks Experienced Azure Data Engineer with over 3 years of hands-on expertise in Azure Data Factory, Azure Databricks, and Azure SQL, delivering robust data solutions across complex business environments. Proficient in ETL operations, data warehousing, and integrating diverse data sources with a focus on performance and scalability. My strengths lie in data modeling, implementing efficient Azure database solutions, and collaborating effectively within cross-functional teams to ensure timely and high-quality project deliveries. I’m passionate about solving intricate data challenges, generating actionable data-driven insights, and driving business success in today’s data-centric landscape. Adept at optimizing long-running jobs, automating manual tasks, and working closely with stakeholders to define business requirements and implement user-focused data workflows. 🎓 Education: B.Tech: Electronics and Communications Engineering, Guru Gobind Singh Indraprastha University, 2020 🔧 Technical Skills: Azure Data Factory | ETL | SCD | Azure Data Bricks | ADLS | Spark Architecture | Azure SQL | Pyspark | Integration Runtime | Python | Machine Learning | Data Analysis | EDA | Data Preprocessing | Jupyter Notebook | Jenkins (Deployment) | Azure | My SQL 📧 If my profile aligns with your hiring needs, connect at parihar.rajat60@gmail.com.

Experience

5 yrs 4 mos

Total Experience

1 yr 8 mos

Average Tenure

2 mos

Current Experience

Tech mahindra

Technical Lead

Feb 2026 – Present · 2 mos

Azure Data FactoryAzure DatabricksETLData EngineeringAzure

Exl

Senior Data Engineer

Mar 2024 – Feb 2026 · 1 yr 11 mos · Gurugram, Haryana, India · Hybrid

🔹 Orchestrated complex ETL workflows using Azure Databricks Workflows, enabling real-time processing of CSV, XML, JSON, and Excel file formats and loading into Delta tables for analytical reporting.
🔹 Utilized Azure Data Factory (ADF), REST APIs, and Azure Data Lake Storage (ADLS) to extract data from external sources into the Bronze layer. Structured the data with Unity Catalog and distributed it across teams like Business Analytics and Accelerator.
🔹 Engineered Parquet-based storage solutions, leveraging columnar storage to boost query performance by 30% and reduce storage costs.
🔹 Tuned Apache Spark configurations—partitioning, caching, and join strategies—to improve pipeline performance, achieving a 25% reduction in execution time.
🔹 Designed and deployed 15+ ADF pipelines using Linked Services, Datasets, and Triggers to orchestrate end-to-end ETL workflows.
🔹 Enabled secure and governed data access with Databricks Delta Sharing, supporting audit trails and fine-grained access controls.
🔹 Enforced data security using Azure RBAC and Unity Catalog ACLs across storage, catalogs, schemas, and tables. Conducted access reviews and implemented least-privilege policies.
🔹 Implemented a custom data vacuuming solution, reducing storage expenses by 40% and improving query performance by 60%, optimizing the data lake environment.
🔹 Developed PySpark and SQL-based transformation logic for data cleansing, enrichment, and historical tracking. Implemented deduplication and SCD Types 1 & 2. Standardized data with the Common Data Model (CDM) for enterprise analytics.
🔹 Built scalable pipelines using PySpark, Hive, and Azure Databricks to transform raw data into structured datasets in Delta Lake.
🔹 Created ADF triggers and automated pipelines to streamline data processing and enhance workflow efficiency.
🔹 Optimized Databricks cluster configurations and implemented workload migration to job clusters, significantly reducing compute costs.

ETLAzure DatabricksAzure Data FactoryADLSData LakeData Security+4

Tata consultancy services

Azure Data Engineer

Apr 2021 – Mar 2024 · 2 yrs 11 mos · Gurugram, Haryana, India · Hybrid

3 years of experience in IT industry.
Currently working as a Azure Data Engineer on Azure Data factory, Azure Databricks ,Pyspark. Have good experience in creating self-hosted IR, linked services,datasets, pipelines and parameters in Azure Datafactory. Configured the Git Repository setup for datafactory and created CI/CD pipeline for deployment.
Experienced as a DevOps Engineer and experienced in creating CI/CD pipelines.

Azure Data FactoryAzure DatabricksPySparkCI/CDData EngineeringAzure

Finoit inc

ETL Developer

Dec 2020 – Apr 2021 · 4 mos · Noida, Uttar Pradesh, India · On-site

Orchestrated complex data transformations and integrations using Azure Data Factory, enhancing data reliability and facilitating informed decision-making processes.
Designed pipelines capable of handling both full and incremental data loads, aligning with specific business requirements for optimal efficiency.
Implemented best practices for data governance and compliance within Azure Data Factory environments, ensuring regulatory standards and policies were met.
Ingested and stored multi-source data into Azure Data Lake Storage (ADLS)Gen2.
Experience in handling Python and spark context when writing Pyspark programs for ETL.

Azure Data FactoryData LoadingData EngineeringPythonSparkAzure