Vignesh Ravi

CEO

Chennai, Tamil Nadu, India9 yrs experience

Key Highlights

Expert in Azure Data Engineering and Cloud Solutions.
Proven track record in managing large-scale data projects.
Strong leadership skills with a focus on team development.

Stackforce AI infers this person is a Data Engineering expert in SaaS environments with strong leadership capabilities.

Contact

Skills

Core Skills

Azure Data EngineeringProject ManagementData EngineeringTeam LeadershipCloud Infrastructure Management

Other Skills

Azure SQLAzure Data FactoryAzure DatabricksADLSDelta LakeSQL WarehouseIT Business AnalysisDatabricksData LakeCoachingCommunicationPySparkSpark SQLData QualityProblem Solving

About

An experienced team leader with excellent client and project management skills. Action-oriented with strong ability to communicate effectively with technology, executive and business audiences.

Experience

9 yrs

Total Experience

2 yrs 8 mos

Average Tenure

10 mos

Current Experience

Capgemini

Lead

Jul 2025 – Present · 10 mos · Chennai, Tamil Nadu, India · On-site

Hands-on experience processing large-scale datasets (TB-level) using Azure SQL, Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, and SQL Warehouse, supporting both batch and near–real-time workloads.
Designed and developed end-to-end data ingestion pipelines in ADF, orchestrating Spark-based transformations in Databricks for data sourced from on-premises systems, cloud storage, REST APIs, and event-driven sources.
Implemented Apache Spark transformations (PySpark & Spark SQL) with a strong focus on Spark optimization techniques including partitioning, caching, broadcast joins, and shuffle minimization to improve pipeline performance.
Integrated Databricks Workflows with ADF for dependency-driven execution, parameterized job runs, retries, and failure handling across complex ETL/ELT pipelines.
Configured and managed Databricks Job Clusters with cluster autoscaling policies, optimizing resource utilization and reducing compute costs for high-volume processing jobs.
Built and maintained Delta Lake–based Lakehouse architectures, leveraging schema enforcement, schema evolution, and ACID transactions to ensure reliable and scalable data processing.
Implemented Delta Live Tables (DLT) pipelines to standardize Bronze–Silver–Gold transformations, enforce data quality rules, and automate pipeline monitoring and recovery.
Applied data quality checks (null validation, schema validation, duplicate detection, referential integrity).
Performed advanced Spark performance troubleshooting
Conducted root cause analysis (RCA) on pipeline failures and performance degradation, implementing corrective actions that improved throughput, stability, and SLA adherence.
Integrated Logic Apps with ADF and Databricks pipelines to automate alerts, notifications, and operational workflows (email alerts, incident ticket creation).
Implemented CI/CD pipelines using Azure DevOps for Databricks notebooks

Azure SQLAzure Data FactoryAzure DatabricksADLSDelta LakeSQL Warehouse+3

Teleperformance

Lead

May 2024 – Jun 2025 · 1 yr 1 mo · India · On-site

Hands on experience with handling large amounts of data using Azure SQL, Azure Data Factory, Data Lake, Delta Lake, and SQL Warehouse.
Designed and developed end-to-end pipelines in ADF for data ingestion from diverse sources (on-premises, cloud, APIs) into Azure data platforms.
Leveraged Azure Integration Runtime and Self-Hosted Integration Runtime for secure connectivity to on-premises data stores, ensuring minimal latency and compliance with security policies.
Implemented control flow activities (lookup, conditional, foreach, until) to orchestrate and sequence complex ETL tasks.
Integrated Databricks notebook activities within ADF pipelines for advanced data transformations (Spark-based), ensuring smooth data flow and dependency management.

Azure SQLAzure Data FactoryData LakeDelta LakeSQL WarehouseCoaching+3

Amazon

Lead

May 2022 – Apr 2024 · 1 yr 11 mos · Chennai · Hybrid

Designed and implemented end-to-end Lakehouse architectures using Databricks, Delta Lake, and cloud object storage, enabling scalable analytics and AI workloads across multiple business domains.
Built and optimized Bronze–Silver–Gold (Medallion) pipelines for batch and streaming data, ensuring data quality, schema enforcement, and reliable incremental processing.
Developed high-performance PySpark and Spark SQL transformations, tuning joins, partitioning, caching, and file layouts to reduce job execution time and infrastructure cost.
Implemented Auto Loader and Structured Streaming pipelines to ingest data from APIs, event streams, and cloud storage with exactly-once processing guarantees.
Managed Delta Lake operations including OPTIMIZE, Z-ORDER, VACUUM, time travel, and schema evolution to support analytical workloads and historical data recovery.
Implemented Unity Catalog–based governance, configuring catalogs, schemas, fine-grained access controls, and data lineage to meet enterprise security and compliance standards.
Performed advanced Spark performance troubleshooting using Spark UI, cluster metrics, and execution plans to resolve data skew, shuffle bottlenecks, and memory issues.

DatabricksDelta LakePySparkSpark SQLData QualityProblem Solving+3

Sutherland global service limited

Team Lead

Mar 2017 – May 2022 · 5 yrs 2 mos · Chennai, Tamil Nadu, India

Administered and maintained Azure Cloud environments hosting over 1000+ virtual machines for multiple enterprise applications.
Strong technical background in Identity and Access Management with Azure Entra ID, Azure Policies, MFA, AAD, RBAC, NSGs, ASGs, Private/Service Endpoints, and Key Vault, ensuring compliance and security best practices.
Worked with Azure Resource Manager (ARM) deployment model to provision and manage cloud infrastructure services (IaaS).
Provisioned and administered Azure Virtual Machines (VMs) using ARM templates and Azure Portal, ensuring configuration consistency and scalability.
Managed Azure resources, including Storage Accounts, VMs, and App Services, applying Role-Based Access Control (RBAC) to enforce secure access.

Azure CloudIdentity and Access ManagementAzure PoliciesRBACProblem SolvingTeam Leadership+1