Dharun T

Data Engineer

Salem, Tamil Nadu, India4 yrs 9 mos experience
Highly Stable

Key Highlights

  • Led a 4TB SQL MI migration to Databricks.
  • Refactored pipelines using Python OOP principles.
  • Established enterprise-grade security with Unity Catalog.
Stackforce AI infers this person is a Senior Data Engineer specializing in scalable data architectures for Fintech and SaaS industries.

Contact

Skills

Core Skills

Etl/elt ArchitectureData ModelingData Warehousing

Other Skills

Python (Programming Language)Azure DatabricksMicrosoft AzureDjangoData Build Tool (DBT)dbtSnowflakeDatabasesData AnalysisDatabase Management System (DBMS)Azure Data FactoryAzure DevOps ServicesApache SparkPL/SQLLinux

About

I’m a Senior Data Engineer who thrives on transforming messy, complex data into high-performance pipelines that move the needle for businesses. With over 4 years of experience, I specialize in building scalable architectures—from traditional warehouses to modern Lakehouses—that empower teams to make data-driven decisions in real-time. ​I’m particularly passionate about modernizing legacy systems. Whether it’s refactoring pipelines with OOP principles or migrating massive on-prem environments to the cloud, my goal is always the same: make it faster, make it cleaner, and make it scalable. ​🚀 Professional Highlights ​Logistics | Massive Scale Migration: Led a migration of a 4TB SQL MI data warehouse to Databricks. I orchestrated the move of 1,400+ tables from 43+ diverse source systems (XML, JSON, XLSX, etc.), optimizing code to slash job runtimes from 8 hours down to just 40 minutes. ​Finance | Modern Data Stack: Managed a full-scale transition from Matillion to dbt. I redesigned legacy data models into a modern Snowflake-based architecture, collaborating with reporting teams to ensure seamless analytics. ​Supply Chain | Advanced Engineering: Refactored ingestion pipelines using a Python OOP framework and multi-threading mechanisms. Integrated a data quality framework for row-level validation and business metric checks against source/target systems. ​Fintech | Real-Time Analytics: Implemented Change Data Capture (CDC) for Oracle databases in Databricks using Fivetran to enable real-time financial insights. ​Data Governance: Established enterprise-grade security using Unity Catalog and Role-Based Access Control (RBAC). ​🛠 Technical Arsenal ​Platforms: Azure Databricks, Snowflake, Azure Data Factory, AWS ​Languages: Python (PySpark), SQL (PL/SQL) ​Tools: dbt, Fivetran, Azure DevOps, Matillion ​Core Skills: ETL/ELT Architecture, Data Modeling, Unity Catalog, OOP Frameworks ​I’m a firm believer in "working smarter," which is why I lean heavily into automation and metadata-driven approaches. Beyond the technical stack, I enjoy mentoring my peers and keeping up with the latest in Generative AI

Experience

4 yrs 9 mos
Total Experience
4 yrs 9 mos
Average Tenure
4 yrs 9 mos
Current Experience

Zeb

3 roles

Senior Data Engineer

Promoted

Aug 2023Present · 2 yrs 9 mos · Chennai · On-site

Python (Programming Language)Azure DatabricksETL/ELT ArchitectureData Modeling

Data Engineer

Aug 2021Aug 2023 · 2 yrs · Chennai · On-site

Microsoft AzureAzure DatabricksETL/ELT ArchitectureData Warehousing

Trainee Engineer

Aug 2021Oct 2021 · 2 mos · Chennai · On-site

Microsoft AzureDjango

Education

DHIRAJLAL GANDHI COLLEGE OF TECHNOLOGY, SALEM

Bachelor of Engineering - BE — Computer Science

Jan 2018Jan 2022

Sri Sarada Balamandir Boys Matric Hr.Sec School

Jun 2015Jul 2018

Stackforce found 100+ more professionals with Etl/elt Architecture & Data Modeling

Explore similar profiles based on matching skills and experience