Vidavaluru Vishnu Sai

Data Engineer

Bengaluru, Karnataka, India3 yrs 6 mos experience

Most Likely To Switch

Key Highlights

Expert in building scalable ETL/ELT pipelines.
Proficient in Azure Data Factory and Databricks.
Strong background in data transformation and processing.

Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and ETL processes.

Contact

Skills

Core Skills

Azure Data FactoryDatabricksInformatica Powercenter

Other Skills

PySparkSQLPower AutomateMySQLDatabase DesignAzure Data LakeApache SparkExtractTransformLoad (ETL)Transact-SQL (T-SQL)Microsoft Power AppsMicrosoft Power AutomateGitData Manipulation

About

Data Engineer with 3+ years of experience at IBM, building and maintaining production-grade ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. Experienced in Delta Lake architecture, SQL Server, Power Automate workflow automation, and distributed data processing with Apache Spark and Python. I specialize in designing scalable data pipelines, transforming large datasets across cloud environments, and enabling reliable data delivery for analytics and reporting teams. ✒️ Core Skills: Azure Data Factory | Databricks | PySpark | Python | SQL | Delta Lake | Power Automate | Apache Spark | ETL Pipelines

Experience

3 yrs 6 mos

Total Experience

1 yr 9 mos

Average Tenure

2 yrs 5 mos

Current Experience

Ibm

Application Developer | Data Engineering

Jan 2024 – Present · 2 yrs 5 mos · Hybrid

Designed and developed end-to-end ETL/ELT pipelines using Azure Data Factory, integrating data from multiple on-premise and cloud sources into centralized data lakes
Built and maintained Databricks notebooks using PySpark for large-scale data transformation and processing on Delta Lake
Migrated legacy Scala transformation codebase to PySpark, improving maintainability and enabling cross-team reusability
Optimized existing T-SQL queries for data analysis, reporting, and stored procedure development
Managed incremental data loads and maintained data lineage across pipeline stages
Maintained version-controlled deployment of SQL scripts and Databricks notebooks via Git/GitHub
Automated business processes using Microsoft Power Automate, reducing manual intervention significantly
Collaborated with cross-functional teams to validate pipeline outputs and support analytical reporting

Azure Data FactoryDatabricksPySparkSQLPower Automate

Cognizant

2 roles

Programmer Analyst Trainee

Jul 2021 – Aug 2022 · 1 yr 1 mo

Developed and maintained ETL pipelines using Informatica PowerCenter, handling data extraction, transformation, and loading across source and target systems
Designed and executed complex SQL queries for data validation, reconciliation, and testing of warehouse loads
Performed end-to-end ETL testing including unit testing, integration testing, and regression testing for data warehouse modules
Validated data accuracy and completeness across pipeline stages by comparing source-to-target row counts and business rule compliance
Collaborated with data architects and business analysts to understand data requirements and translate them into ETL mappings
Documented test cases, defect logs, and ETL mapping specifications as part of the project delivery lifecycle

Informatica PowerCenterSQLMySQLDatabase Design

Internship Trainee

Jan 2021 – Jun 2021 · 5 mos

Gained hands-on exposure to Data Warehousing concepts including dimensional modelling, fact and dimension tables, and ETL fundamentals
Assisted in writing SQL queries for data extraction and basic reporting tasks under senior team guidance
Supported testing activities for data pipeline modules during the internship training period

SQL