SUBHAM MUKHERJEE

Data Engineer

Kolkata, West Bengal, India5 yrs 7 mos experience

AI Enabled

Key Highlights

Expert in ETL development and data migration.
Proficient in integrating complex data systems.
Awarded for technical expertise and collaboration.

Stackforce AI infers this person is a Data Engineering expert specializing in ETL and data integration within cloud environments.

Contact

Skills

Core Skills

Data EngineeringEtl

Other Skills

API & Application IntegrationAzure Data LakeData Build Tool (DBT)Data CleansingData MigrationData ModelingData Quality ChecksData StandardizationData Warehouse ArchitectureDbtGenerative AIIICSInformatica FunctionsInformatica PowerCenterLakehouse

About

Skilled Senior Data Engineer with extensive experience in ETL development, data warehousing, and data migration. Proficient in IDMC, Informatica Cloud (IICS), Informatica PowerCenter, SQL, Python, and Snowflake. Expertise in integrating data from various external sources, including Oracle, MS SQL, Teradata, SAP , and Workday, as well as cloud platforms like AWS Azure and Snowflake. Demonstrated ability to leverage Web Service, and Hierarchical Transformation for seamless integration of complex systems REST, SOAP APIs, and XML files ensuring efficient data flow between systems. Has experience in various IICS transformations like Filter, Router, Expression, Normalizer, Rank, Union, Transaction Control, and Mapplet. Has a Good Understanding of Concepts like Parameterization, Push-Down Optimization (PDO), Partitioning, Indexing, and Errors Handling.Skilled in debugging and troubleshooting any performance, data issues, or errors in mappings. Awarded the "Above and Beyond" award for technical expertise and collaborative efforts with business teams and stakeholders, driving impactful outcomes.

Experience

Tiger analytics

Data Engineer

Dec 2024 – Present · 1 yr 3 mos · Pune, Maharashtra, India · Hybrid

Pwc india

2 roles

Senior Data Engineer ( Senior Associate )

Apr 2024 – Dec 2024 · 8 mos · Kolkata, West Bengal, India

Data Engineer at PwC (Associate)

Mar 2022 – May 2024 · 2 yrs 2 mos · Kolkata, West Bengal, India

Project 1: Data Migration to Workday Using IICS and SQL Server
Gathered and analyzed client requirements, demonstrating proof of concepts to meet their specific needs.
Worked as a developer, designing and implementing end-to-end ETL/ELT pipelines with IICS, resulting in a robust data architecture and high-quality results.
Designed and implemented data quality checks, data cleansing, and standardization processes for sales data at various stages of the ETL process using IICS transformations and SQL Stored Procedure
Assisted Data Analysts in modeling tables and generating meaningful insights, ensuring data quality, traceability, and preview for business users.
Collaborated with Workday Subject Matter Experts (SMEs), overseeing the migration of data to Workday and troubleshooting any issues with data and pipelines to ensure compliance with Workday validations.
Developed ethically sound data extraction pipelines from various SAP systems to meet business compliance requirements for data extraction.
Created reusable code, including SQL stored procedures and Informatica functions, to streamline project setup and reduce the need for excessive coding.
Project 2: Data Load of Transaction Data into Snowflake Data Warehouse using IICS
Created ETL/ELT pipelines to load transaction data from diverse sources (SAP, SQL Server, Oracle, ADLS, S3 bucket, API, File System) into the Snowflake data warehouse using IICS and Snowflake Stored Procedure
Designed and implemented data quality checks, data cleansing, and standardization processes for sales data at various stages of the ETL process using IICS transformations and Snowflake Stored Procedure
Migrated ETL jobs from lower environments to production, adhering to proper change request processes and ensuring a seamless handover to the scheduling team.

IICSSQL ServerETLData Quality ChecksData CleansingData Standardization+5

Cognizant

Programming Analyst

Aug 2020 – Mar 2022 · 1 yr 7 mos · Tamil Nadu, India

Project 1: Data Load of Transaction Data into Snowflake Data Warehouse using IICS
Created ETL/ELT pipelines to load transaction data from diverse sources (SAP, SQL Server, Oracle, ADLS, S3 bucket, API, File System) into the Snowflake data warehouse using IICS.
Designed and implemented data quality checks, data cleansing, and standardization processes for sales data at various stages of the ETL process using IICS transformations.
Provided support for failed ETL jobs built on Informatica PowerCenter and IICS, and conducted periodic maintenance to ensure smooth data flow.
Successfully migrated ETL jobs from lower environments to production, adhering to proper change request processes and ensuring a seamless handover to the scheduling team.
Conducted root cause analysis for job failures in the production environment and implemented corrective measures to resolve issues.
Implemented automation using Unix shell scripting, reducing manual intervention and increasing efficiency in the production environment.
Optimized the performance of ETL jobs to meet business Service Level Agreements (SLAs), ensuring timely and accurate data delivery.