Mohanraj S R

Data Engineer

Bengaluru, Karnataka, India7 yrs 11 mos experience
AI ML PractitionerAI Enabled

Key Highlights

  • Expert in end-to-end data migration to Azure Cloud.
  • Proficient in building scalable ETL pipelines with Databricks.
  • Strong background in data quality and analytics.
Stackforce AI infers this person is a Data Engineering expert specializing in cloud migration and ETL processes.

Contact

Skills

Core Skills

Etl/elt Pipeline DevelopmentOrchestration Using Azure Data Factory & Databricks WorkflowsData EngineeringEnd-to-end Data MigrationData AnalysisData Visualization

Other Skills

PySparkDatabricksData Quality FrameworkSpark StreamingBatch ETLDatabricks GenieGenerative AIAzure DatabricksData FactoryData Lake StorageSpark SQLBI toolsKPI DashboardsAd-hoc Data AnalysisTerraform

About

Azure and Databricks Certified Data Engineer with hands-on expertise in designing and delivering complex, end-to-end ETL pipelines and data migration solutions. I specialize in modernizing data infrastructure — migrating on-premise workloads to the cloud and building scalable ingestion frameworks using Azure Databricks, Azure Data Factory, and Databricks Workflows. My work spans the full data lifecycle, from raw source ingestion across diverse cloud and on-prem systems to transformed, analytics-ready datasets. Core expertise includes: • End-to-end data migration (on-premise to cloud) • Multi-source data ingestion in cloud environments • ETL/ELT pipeline development with Azure Databricks • Orchestration using Azure Data Factory & Databricks Workflows • Azure ecosystem (ADLS, ADF, Databricks, Synapse) Passionate about building reliable, maintainable data platforms that enable teams to trust their data and move faster.

Experience

7 yrs 11 mos
Total Experience
2 yrs 8 mos
Average Tenure
2 yrs 7 mos
Current Experience

Publicis sapient

Senior Associate Data Engineering

Nov 2023Present · 2 yrs 7 mos · Bengaluru

  • Designed and implemented a scalable Data Quality Framework using PySpark, enabling automated validation and monitoring of large-scale datasets across distributed pipelines.
  • Architected modular, reusable code frameworks in Databricks Notebooks, improving maintainability and accelerating development velocity across data engineering teams.
  • Built end-to-end Spark Streaming and Batch ETL pipelines to ingest, transform, and deliver high-volume data, ensuring low-latency processing and pipeline reliability.
  • Developed a Generative AI tool leveraging Databricks Genie integrated into a Single Page Application (SPA), enabling natural language-driven data exploration for business users.
  • Led the adoption of distributed computing best practices using Apache Spark and Databricks, optimizing pipeline performance and reducing data processing time at enterprise scale.
PySparkDatabricksData Quality FrameworkSpark StreamingBatch ETLETL/ELT pipeline development+1

Tredence inc.

Consultant

Nov 2021Nov 2023 · 2 yrs · Bengaluru

  • Led end-to-end Data Migration to Azure Cloud, successfully transitioning large-scale on-premise datasets to a modern cloud architecture using Azure Databricks, Data Factory, and Data Lake Storage.
  • Engineered robust ETL pipelines from scratch — covering extraction, transformation, and loading — leveraging Azure Databricks and ADF to ensure seamless and scalable data movement across systems.
  • Conducted in-depth Root Cause Analysis on complex data transformation failures using Spark SQL and PySpark, diagnosing pipeline issues and implementing fixes to maintain data integrity.
  • Designed and delivered Data Reconciliation Reports to validate consistency between source and target systems, ensuring accuracy and completeness post-migration.
  • Monitored and maintained Azure Data Factory pipelines in production, proactively identifying bottlenecks and failures to ensure high availability and SLA compliance for critical data workflows.
Azure DatabricksData FactoryData Lake StorageSpark SQLPySparkEnd-to-end data migration+1

Ecoenergy insights

Data Analyst

Jun 2018Oct 2021 · 3 yrs 4 mos · bangalore

  • Developed interactive KPI Dashboards and Reports using BI tools, delivering actionable business insights to stakeholders and enabling data-driven decision-making across the organization.
  • Conducted Ad-hoc Data Analysis to evaluate process improvements and measure the effectiveness of newly implemented business logic, translating findings into clear, actionable recommendations.
  • Designed and delivered compelling Data Visualizations that simplified complex datasets into intuitive visual narratives, enabling non-technical stakeholders to consume and act on insights efficiently.
  • Drove end-to-end Analytics workflows — from raw data exploration to final reporting — supporting business teams with timely and accurate performance metrics.
  • Collaborated with cross-functional teams to define and track key business KPIs, ensuring dashboards reflected real-time operational performance and aligned with strategic goals.
BI toolsData VisualizationKPI DashboardsAd-hoc Data AnalysisData Analysis

Education

Coimbatore Institute of Technology

Bachelor of Engineering — Mechanical Engineering

Jan 2014Jan 2018

Stackforce found 100+ more professionals with Etl/elt Pipeline Development & Orchestration Using Azure Data Factory & Databricks Workflows

Explore similar profiles based on matching skills and experience