Murugan Chakkarapani

Product Manager

Dubai, Dubai, United Arab Emirates13 yrs 5 mos experience

Key Highlights

Over 13 years of experience in data engineering.
Expertise in Azure cloud technologies and big data solutions.
Proven track record in building scalable data pipelines.

Stackforce AI infers this person is a Data Engineering expert in cloud and big data solutions.

Contact

Skills

Core Skills

Azure Data FactoryAzure DatabricksAzure Data LakeData Engineering

Other Skills

deltaADLSPySparkSQLSSISPOWERBISQL Server Reporting Services (SSRS)Python (Programming Language)HiveLinuxExtract, Transform, Load (ETL)GitHubbigdata developerData AnalyticsBig Data Analytics

About

I am a Lead Data Engineer with 13+ years of experience designing, building, and optimizing data solutions across on-premises and cloud environments. I specialize in end-to-end data engineering on Microsoft Azure, leveraging Azure Databricks, Data Factory (ADF), Data Lake, and Delta Lake to deliver scalable, efficient, and high-performance data pipelines. Currently, I am part of Dubai Holding (Jumeirah Group), where I work on large-scale cloud and big data projects, implementing ETL/ELT pipelines, real-time integrations, and modern data architectures to drive actionable business insights. Earlier in my career, I gained 7+ years of experience in database development and data warehousing using SQL Server, MySQL, and Oracle PL/SQL, building a strong foundation in data modeling, query optimization, and performance tuning. I am passionate about building reliable, secure, and cost-optimized data ecosystems and continuously enhancing data-driven decision-making for organizations. Core Skills & Tools: Azure Cloud: Databricks, Data Factory (ADF), Synapse, ADLS, Azure SQL, Event Hub, AIS, Delta Lake, Fabric Big Data: Hadoop, Spark, PySpark, Hive, Sqoop Programming: Python, PySpark, FastAPI Databases: SQL Server, MySQL, Oracle, PL/SQL Version Control: GitHub Certifications: Azure Data Engineer Associate (DP-203) Fabric Data Engineer Associate (DP-700) Azure AI Fundamentals (AI-900) Career Interest: Actively exploring Data Engineering opportunities in Dubai/UAE, with a focus on scalable, high-performance, and cloud-based data platforms.

Experience

13 yrs 5 mos

Total Experience

2 yrs 7 mos

Average Tenure

2 mos

Current Experience

Dubai holding

Data Team Lead

Mar 2026 – Present · 2 mos · Dubai, United Arab Emirates · On-site

1.Designing and managing end-to-end data pipelines for hotel operations, customer analytics, and business reporting using Azure Data Factory, Databricks, PySpark, and SQL.
2.Implementing data governance and security policies in line with enterprise standards.
3.Integrating real-time and batch data from multiple sources into centralized data lake architecture.
4.Collaborating with business teams to deliver data-driven insights for operational efficiency and revenue growth.
5.Working within the Jumeirah Group IT ecosystem under Dubai Holding, contributing to large-scale enterprise projects.

Azure Data FactoryAzure DatabricksdeltaADLSPySparkSQL+3

Hcltech

Technical Architect

Dec 2023 – Jun 2025 · 1 yr 6 mos · Chennai, Tamil Nadu, India · Hybrid

1.Demonstrated the data migration of various system from on-prem to Azure Storage.
2.Developed an end-to-end data pipeline in ADF, ingesting data from multiple sources like RestAPI and CSV, JSON and Parquet files into the ADLS containers and further to the downstream.
3.Worked in developing spark applications using Pyspark in data bricks for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data to data lake (ADLS Gen2).
4.Processed, joined multiple tables data using data bricks (Pyspark, Spark SQL) and final aggregated data stored into consumption layer (ADLS Gen2).
5.Worked in tuning and debugging Spark applications using Spark optimization techniques.
6.Deployment pipelines are managed using Azure DevOps CI/CD to automate the build, testing, and release processes.
7.Experience in working with version control systems like GitLab and GitHub.

SQLAzure DatabricksPython (Programming Language)Azure Data LakeHiveLinux+15

Capgemini

Lead Data Engineer

Jul 2021 – Jul 2023 · 2 yrs · Chennai, Tamil Nadu, India

1.Created analytics pipeline using Big Data, Spark,RDBMS & Python and related technologies.
2.Experience in migrating the data from on-premises to Azure(ADLs) using ADF
3.Responsible for data extraction and data integration from different data sources into
Azure Data Lake by creating ETL pipelines Using Azure Databricks, Spark and Azure Data factory.
4.Implemented Spark using Python in Databricks utilizing Data Frames and Spark-SQL API for faster
Processing of data.
5.Developed managed and external Hive tables with appropriate partitions & buckets.
6.Creating daily based trigger to schedule the pipeline.
Certifications: Microsoft Certified - Azure Data Engineer Associate