Rahul Raj

Data Engineer

Pune, Maharashtra, India3 yrs 2 mos experience

AI ML PractitionerAI Enabled

Key Highlights

Expert in building cloud-native data pipelines.
Proficient in real-time analytics solutions.
Certified Azure and Databricks Data Engineer.

Stackforce AI infers this person is a SaaS Data Engineer specializing in cloud-native data solutions and real-time analytics.

Contact

Skills

Core Skills

Data EngineeringCloud Computing

Other Skills

GitAmazon Web Services (AWS)PySparkDatabricksAzure Data LakeDelta LakeETLAWSPerformance TuningAutomationData ValidationShell ScriptingPython (Programming Language)SnowflakeAzure Data Factory

About

Data Engineer with 3+ years of experience designing and building cloud-native data pipelines, real-time analytics solutions, and lakehouse architectures using AWS, Azure, Snowflake, and Apache Spark. Proficient in ETL automation, workflow optimization, and delivering analytics-ready data for enterprise and real-time reporting. Skilled in data modeling, data integration, performance tuning, and scalable pipeline design.

Experience

3 yrs 2 mos

Total Experience

3 yrs 2 mos

Average Tenure

3 yrs 2 mos

Current Experience

Cognizant

2 roles

Data Engineer

Apr 2023 – Present · 3 yrs 2 mos · Pune

Migrated enterprise data warehouse from Oracle Exadata to Azure Data Lake, enabling near real-time analytics and enhanced data performance.
Built scalable PySpark ETL pipelines in Databricks for diverse formats (Parquet, CSV, XML), ensuring data ingestion, transformation, and schema consistency.
Optimized Delta Lake pipelines using Liquid Clustering, VACUUM, and key-based partitioning, improving query performance by ~30% and reducing latency.
Developed automation framework for data validation, test scenario generation, and QA automation, reducing manual effort by ~80% and accelerating release cycles.
Migrated and productionized Oracle Load Plans, optimizing workload scheduling, ensuring data availability, reliability, and analytics-ready datasets.
Implemented data engineering best practices including data pipeline orchestration, error handling, logging, and monitoring to support enterprise-grade analytics.

GitAmazon Web Services (AWS)PySparkDatabricksAzure Data LakeDelta Lake+3

Data Engineer Intern

Mar 2022 – Oct 2022 · 7 mos · Mumbai, Maharashtra, India

Built and managed a Snowflake-based data platform with staging, curated, and data mart layers to deliver trusted analytics-ready
data.
Developed batch and streaming pipelines in Azure Data Factory to ingest data into Azure Data Lake and Snowflake.
Designed optimized Snowflake schemas with clustering keys, partitioning, and materialized views to boost query performance
and cut costs.
Automated ELT transformations in Snowflake using SQL and dbt for clean, consistent datasets.
Implemented RBAC, auditing, and cost controls to ensure platform security and efficiency.

Shell ScriptingPython (Programming Language)SnowflakeAzure Data FactoryData EngineeringCloud Computing