Dharun T — Data Engineer
I’m a Senior Data Engineer who thrives on transforming messy, complex data into high-performance pipelines that move the needle for businesses. With over 4 years of experience, I specialize in building scalable architectures—from traditional warehouses to modern Lakehouses—that empower teams to make data-driven decisions in real-time. I’m particularly passionate about modernizing legacy systems. Whether it’s refactoring pipelines with OOP principles or migrating massive on-prem environments to the cloud, my goal is always the same: make it faster, make it cleaner, and make it scalable. 🚀 Professional Highlights Logistics | Massive Scale Migration: Led a migration of a 4TB SQL MI data warehouse to Databricks. I orchestrated the move of 1,400+ tables from 43+ diverse source systems (XML, JSON, XLSX, etc.), optimizing code to slash job runtimes from 8 hours down to just 40 minutes. Finance | Modern Data Stack: Managed a full-scale transition from Matillion to dbt. I redesigned legacy data models into a modern Snowflake-based architecture, collaborating with reporting teams to ensure seamless analytics. Supply Chain | Advanced Engineering: Refactored ingestion pipelines using a Python OOP framework and multi-threading mechanisms. Integrated a data quality framework for row-level validation and business metric checks against source/target systems. Fintech | Real-Time Analytics: Implemented Change Data Capture (CDC) for Oracle databases in Databricks using Fivetran to enable real-time financial insights. Data Governance: Established enterprise-grade security using Unity Catalog and Role-Based Access Control (RBAC). 🛠 Technical Arsenal Platforms: Azure Databricks, Snowflake, Azure Data Factory, AWS Languages: Python (PySpark), SQL (PL/SQL) Tools: dbt, Fivetran, Azure DevOps, Matillion Core Skills: ETL/ELT Architecture, Data Modeling, Unity Catalog, OOP Frameworks I’m a firm believer in "working smarter," which is why I lean heavily into automation and metadata-driven approaches. Beyond the technical stack, I enjoy mentoring my peers and keeping up with the latest in Generative AI
Stackforce AI infers this person is a Senior Data Engineer specializing in scalable data architectures for Fintech and SaaS industries.
Location: Salem, Tamil Nadu, India
Experience: 4 yrs 9 mos
Skills
- Etl/elt Architecture
- Data Modeling
- Data Warehousing
Career Highlights
- Led a 4TB SQL MI migration to Databricks.
- Refactored pipelines using Python OOP principles.
- Established enterprise-grade security with Unity Catalog.
Work Experience
zeb
Senior Data Engineer (2 yrs 9 mos)
Data Engineer (2 yrs)
Trainee Engineer (2 mos)
Education
Bachelor of Engineering - BE at DHIRAJLAL GANDHI COLLEGE OF TECHNOLOGY, SALEM
at Sri Sarada Balamandir Boys Matric Hr.Sec School