Shivanshi Shahi

Data Engineer

Bengaluru, Karnataka, India4 yrs 2 mos experience

Highly Stable

Key Highlights

3+ years of experience in data engineering.
Expert in building scalable data pipelines using AWS.
Recognized for mentoring new team members.

Stackforce AI infers this person is a Data Engineer specializing in AWS-based data solutions.

Contact

shivanshishahi01@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringEtl Tools

Other Skills

AWS GlueAWS LambdaAmazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)AnalyticsApache SparkApache Spark StreamingAthenaBig DataContinuous Delivery (CD)Continuous Integration (CI)Data AnalyticsData ArchitectureData Ingestion

About

Data Engineer with 3+ years of experience in building scalable, event-driven data pipelines using AWS Glue, PySpark, and other AWS services. Skilled in ETL development, automation, and DevOps practices. Recognized for delivering robust solutions and mentoring new team members. Always eager to learn and solve complex data challenges.

Experience

Tata consultancy services

System Engineer

Jun 2025 – Present · 9 mos · Kolkata, West Bengal, India · Remote

Cognizant

3 roles

Associate

Jan 2024 – May 2025 · 1 yr 4 mos · Bengaluru, Karnataka, India · Hybrid

Programming Analyst

Oct 2022 – Dec 2023 · 1 yr 2 mos · Bengaluru, Karnataka, India · Hybrid

Programmer Analyst Trainee

Oct 2021 – Sep 2022 · 11 mos · Bengaluru, Karnataka, India · Hybrid

Worked on building event driven datalake ingestion framework that would help ingest all types of files from different source system ,go through different transformations using pyspark, cataloging using aws glue, data validation in Athena, getting data available in aws S3 for further analytics and dashboard building activities.
AWS Lambda to do audits and ingest into Dynambo DB Splunk Dashboard.
ETL and Validation scripts in Athena.
Fixed SonarQube issues for the existing codes.
Written Robust ETL jobs in AWS GLUE to handle tenants requirements.
Code Enchancements for new use cases
Unit Test Cases for the data ingestion framework
Functional & Integration Testing for the data ingestion framework
XML file ingestion
Automated Dynamo DB configuration migration to higher environment
Automated Cross Domain Jobs
Prod Support