Ashwini H G

Data Engineer

Bengaluru, Karnataka, India5 yrs 3 mos experience
AI ML PractitionerAI Enabled

Key Highlights

  • 7.6+ years of experience in data engineering.
  • Expert in building scalable data platforms.
  • Mentors professionals in modern data engineering practices.
Stackforce AI infers this person is a Data Engineer specializing in Big Data and Cloud solutions for enterprise environments.

Contact

Skills

Core Skills

Azure Data FactoryDatabricksAws GluePythonSpark

Other Skills

Azure SynapseETLELTPySparkAPIsSQL ServerPostgreSQLAzure BlobS3Azure Event HubsSpark Structured StreamingRedshiftKafkaSQLBig Data Analytics

About

I’m a Data Engineer with 7.6+ years of hands-on experience building real-world data platforms I’ve worked extensively with Python, SQL, Apache Spark, and Databricks, designing end-to-end data pipelines that handle real enterprise data at scale. My day-to-day work includes batch and streaming pipelines, complex data transformations, data migrations, and analytics use cases across cloud environments. On the cloud side, I’ve built and supported production systems using Azure Data Factory, Azure Synapse, Azure SQL, and AWS services. I’ve worked closely with business teams, analysts, and architects to make sure the data is not only processed, but actually trusted and usable. Alongside my professional work, I actively train and mentor professionals in Azure SQL, Databricks, PySpark, and modern data engineering practices. My training is practical and project-driven , focused on how things really work in production, interviews, and client environments. I strongly believe data engineering is not about tools alone . it’s about understanding data, business context, and making systems reliable enough that people can confidently take decisions from them. If you’re a data professional looking to grow, or an organization looking for someone who understands both implementation and real-world challenges, let’s connect.

Experience

5 yrs 3 mos
Total Experience
2 yrs 7 mos
Average Tenure
--
Current Experience

Independent consultant

Senior Data Engineer

Dec 2023Present · 2 yrs 4 mos · Remote

  • Design and implement end-to-end data pipelines on Azure Data Factory, Azure Synapse, and Databricks for multiple clients.
  • Build and maintain ETL/ELT workflows for structured, semi-structured, and unstructured data.
  • Optimize big data processing using Spark and PySpark, reducing runtime and cloud costs.
  • Integrate data sources from APIs, relational databases (SQL Server, PostgreSQL), and cloud storage (Azure Blob, S3).
  • Develop real-time streaming pipelines using Azure Event Hubs and Spark Structured Streaming.
  • Implement data security and governance, ensuring compliance with client-specific policies.
  • Collaborate with stakeholders to deliver business intelligence dashboards and analytics solutions.
Azure Data FactoryAzure SynapseDatabricksETLELTSpark+8

Optum

Data Engineer (Contract)

Dec 2021Nov 2023 · 1 yr 11 mos · Remote

  • Developed data pipelines for healthcare data (claims, patient, provider).
  • Worked on AWS Glue, S3, Redshift, and Databricks.
  • Built streaming solutions using Kafka + Spark Structured Streaming.
  • Ensured HIPAA-compliant data processing and security.
AWS GlueS3RedshiftDatabricksKafkaSpark Structured Streaming

Tata consultancy services

Data Engineer

Jul 2018Nov 2021 · 3 yrs 4 mos · Bengaluru, Karnataka, India · On-site

  • Built ETL pipelines with Python, SQL, and Spark for enterprise clients.
  • Migrated on-premise workloads to Azure Data Factory + Azure Synapse.
  • Automated ingestion from relational databases and flat files into cloud data lake.
  • Optimized Spark jobs, improving runtime efficiency by 30%.
PythonSQLSparkAzure Data FactoryAzure Synapse

Education

Ramaiah Institute Of Technology

Bachelor of Technology (B.Tech) — Computer Science and Engineering (CSE)

Stackforce found 100+ more professionals with Azure Data Factory & Databricks

Explore similar profiles based on matching skills and experience