Avinash S.

Data Engineer

Pune, Maharashtra, India6 yrs 6 mos experience

Most Likely To Switch

Key Highlights

Over five years of experience in cloud data engineering.
Mentored 50+ individuals in data engineering career transitions.
Expertise in Snowflake and AWS technologies.

Stackforce AI infers this person is a Cloud Data Engineer with expertise in Fintech and Healthcare data solutions.

Contact

Skills

Core Skills

Aws GlueSnowflakeData MigrationEtl/eltData Engineering

Other Skills

PySparkStreamlitLLaMA 3MySQLYugabyte PostgresRedshiftAthenaLambdaStep FunctionsEventBridgeCloudFormationData PipelinesData ReconciliationSQLTeradata

About

Hello there! My name is Avinash Sharma, and I am an experienced cloud data engineer with a keen interest in transitioning to a cloud data solutions architect role. With over five years of experience, I have worked in various domains, including investment banking, business, and personal insurance. Throughout my career, I have consistently leveraged my expertise in Snowflake, SQL, Python, GitHub/GitLab, Azure Repos, Stream Sets, AWS S3, AWS IAM, CI/CD pipelines, and data/code migration to deliver impactful, business-driven solutions. Currently, I am expanding my knowledge in AWS Solutions Architecture, modern data pipeline design, and Data Build Management. In 2025, I have had the privilege of helping and mentoring 50+ individuals from diverse career backgrounds pivot to data engineering, which has been incredibly rewarding. I am passionate about connecting with, learning from, and teaching like-minded individuals who share my enthusiasm for this field. If you are on a similar journey or looking to explore the world of data engineering, please don't hesitate to reach out and connect with me on LinkedIn! Cloud Data Engineer. Key Skills: Snowflake Data Warehouse | SQL | Python | Data Modeling | Data Vault 2.0 | dbt | dbtvault | AWS S3 | AWS IAM Roles & Policies | AWS Glue | AWS Lambda | AWS Redshift | AWS Athena | AWS Step Functions | EventBridge | CI/CD Pipeline (Liquibase, Jenkins, GitHub Actions, Azure Repos) | StreamSets | Teradata | Azure Data Factory | Data Migration

Experience

6 yrs 6 mos

Total Experience

2 yrs 2 mos

Average Tenure

2 yrs 4 mos

Current Experience

Confidential company

Senior Data Engineer

Jan 2024 – Present · 2 yrs 4 mos · Pune, Maharashtra, India · On-site

Project 3: NBFC Banking Migration
Designed and developed end-to-end migration of banking data from MySQL to Yugabyte Postgres Data Warehouse (both on EC2) using AWS Glue (Python/Java), leading a team of 3 developers.
Developed complex SQL queries to extract loan disbursement, repayment, overdue, and other loan-related data, improving reporting accuracy and speed.
Built a Streamlit-based Gen AI application leveraging LLaMA 3 to analyze user queries, enhancing business insights and accessibility.
Project 2: PMCG Vendor Data Pipelines
Managed and built AWS Glue pipelines to ingest vendor/seller data from MySQL and REST APIs, transforming it with PySpark DataFrames.
Developed reconciliation reports for multiple sources (Oracle ERP, MySQL) using AWS Glue, improving data accuracy and process efficiency.
Automated infrastructure and code deployment using AWS CloudFormation, including Lambda functions, Glue jobs, Step Functions, and Secrets management.
Project 1: Healthcare Data Pipelines
Built and managed AWS data pipelines to load data into Redshift using Athena, Lambda, Step Functions, and EventBridge.
Reverse-engineered Snowflake schema changes with Python to extract table DDLs and automatically save to a local repository, reducing manual tracking effort.
Developed a Streamlit admin application to manage Snowflake users, streamlining account management and access control.
Skills:
AWS Glue · PySpark · Streamlit · LLaMA 3 · MySQL · Yugabyte Postgres · Redshift · Athena · Lambda · Step Functions · EventBridge · Snowflake · CloudFormation · ETL/ELT · Data Migration · Data Pipelines · Data Reconciliation

AWS GluePySparkStreamlitLLaMA 3MySQLYugabyte Postgres+11

Accenture

Cloud Data Engineer

Apr 2022 – Jan 2024 · 1 yr 9 mos · Pune, Maharashtra, India

Project 2: Personal Insurance – Teradata to Snowflake Migration
Contributed to migrating Teradata data to Snowflake, completing 25% of migration tasks, improving platform scalability and performance.
Collaborated with internal and external teams to implement and optimize queries in Snowflake, enhancing reporting efficiency.
Facilitated code migration for DDL/DML using GitHub, Liquibase, and Jenkins CI/CD pipelines, streamlining deployment processes.
Built ETL jobs using Snowflake SIP for table-to-table data ingestion, reducing manual intervention and errors.
Project 1: Personal Insurance – Snowflake DBA & Data Engineering
Implemented hundreds of Snowflake objects: databases, schemas, tables, views, stages, and storage integrations, ensuring robust environment setup.
Managed users, roles, and role hierarchies, maintaining proper access control and governance.
Developed ETL/ELT pipelines using dbt, leveraging cloning and time travel for efficient data transformations.
Created Snowflake warehouses, external stages, and tables for various workloads, optimizing resource usage.
Worked on Snowflake cost optimization scenarios and basic Airflow workflows, improving query efficiency and reducing cloud costs.
Hands-on experience with SnowSQL, SnowPipe, and utilities for automated ingestion and monitoring.

SnowflakeTeradataGitHubLiquibaseJenkinsETL+2

Cognizant

Senior Engineer (Data)

Nov 2019 – Apr 2022 · 2 yrs 5 mos · India · Remote

Built end-to-end data pipelines from API endpoints using StreamSets and ETL jobs to load data into AWS S3, improving data ingestion efficiency. Automated bulk loading from AWS S3 to Snowflake using Tasks and Stored Procedures, reducing manual effort by 60%.
Configured Azure Data Factory and Blob Storage to automate data ingestion from JSON, XML, and CSV files. Implemented dedicated warehouses and optimized queries, reducing cloud costs by 25% and improving reporting speed.

StreamSetsAWS S3Azure Data FactoryBlob StorageData EngineeringData Migration