Jul 2022 – May 2024 · 1 yr 10 mos

• Experienced Senior Data Engineer | Cloud & Data Migration Specialist
• Pharmaceutical Industry Snowflake Migration:
• Successfully orchestrated a seamless transition from on-premises systems to the Snowflake cloud platform.
• Utilized Python and Pandas with AWS boto3 for data ingestion, ensuring robust error-handling and data quality.
• Collaborated on Snowflake SQL & Python Stored Procedures, enabling efficient data transfers with historical and Change Data Capture (CDC) capabilities.
• Developed Python scripts for Salesforce CRM Postgres & Source File based data validation.
• Managed complex cloud data migration and data modeling projects within Snowflake's data warehousing system.
• Fortune 100 Insurance Company Data Analytics (Western Europe):
• Led a large-scale cloud migration initiative for a Fortune 100 Insurance Company.
• Conducted technical analysis for legacy systems hosted across diverse platforms.
• Implemented data models across critical domains like Policy, Quotes, Pricing, Finance, Billing, and Claims.
• Spearheaded the development of ETL pipelines using Step function, Athena , Redshift ,Glue, IICS, Python, and SQL, ensuring a seamless data migration.
• Managed key aspects of the project, including effort estimation, agile project management, and provided mentorship to team members.
• Fortune 100 Retail Company Data Migration (USA):
• I contributed the data migration from Legacy Source and Redshift to Snowflake. This involved converting Redshift stored procedures to Snowflake SQL and developing new stored procedures to implement business logic within the Snowflake environment.
• I built CDC pipelines to ingest data from S3 Parquet files into Snowflake’s ODS layer using JavaScript-based stored procedures. Dimension and Fact procedures were restructured to align with Snowflake standards. I performed extensive unit and blank testing across development and upper environments, resolved bugs, and validated data accuracy between source and target systems.

Sep 2020 – Jun 2022 · 1 yr 9 mos

• Worked as a Framework Data Engineer in Western Europe region for a Fortune 100 Insuarance & Financial company for its Data Analytics project:
• Worked in different use-cases of Pricing,Rating,Policy,Quotes,Billing & Claims domain
• Contribute in developing a global data lake platform soultion on AWS cloud
• Design ETL flow for the data being ingested in the data platform using Glue & Python .
• Design Data Model and deploy on Redshift data warehousing system
• Develop the ETL based on business logic as per use cases and populate the DWH
• Involved in preparing unit test cases and execution.
• Analyzing the day to day Datalake production defects/bugs.
• Fix the problem and test the Solution with all the required functionality.
• Preparing and reviewing the documents related to the project
• Created design documents - Data Flow Diagram, Data Model creation and Data Mapping Sheet
• Insurance Company Data Migaration (USA)
• Client is a global leader in risk management solutions, aimed to optimize complex SQL stored procedures that previously took 5–10 hours to execute in Azure/SQL Server. The objective of this project was to re-engineer and enhance query performance within the Snowflake environment.
• I led the optimization efforts by rewriting and tuning the SQL logic for Snowflake, significantly reducing execution time. To support secure data transfer, I worked extensively with AWS services including SFTP, S3, EC2, and IAM to move gzip files from the client’s location into our environment and then into Snowflake.
• Additionally, I developed Python scripts using the Snowflake Python connector to perform various operations (SELECT, UPDATE, DELETE) within Snowflake. I also integrated R Studio with Snowflake via the R connector, enabling seamless data extraction and pushing results back into Snowflake for further analysis.

Jan 2020 – Aug 2020 · 7 mos

• Google Cloud EDW DWH Modernaization :-
• This project was focused on migration of data from various sources like Redshift, Teradata, Oracle, SQL Server, Netteza and many others .
• ● Worked on the Setting up the source from scratch and populating with data of various sizes .
• ● Deploying scripts the automated migration of data to bigquery by the following approaches : GCP'S Cloud Data Fusion GCP'S DataFlow GCP'S DataProc