SOMNATH CHATTERJEE

Data Engineer

Kolkata, West Bengal, India4 yrs 9 mos experience

Most Likely To Switch

Key Highlights

10X Data Engineer recognized for exceptional problem-solving skills.
Expert in Azure technologies with multiple Microsoft certifications.
Proven track record in delivering impactful data solutions.

Stackforce AI infers this person is a Data Engineering expert in Cloud Computing and Data Solutions.

Contact

Skills

Core Skills

Data EngineeringMachine LearningCloud Computing

Other Skills

ADBAirflowApache Spark MLAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevopsAzure Logic AppsAzure SynapseBI DashboardC++Cascading Style Sheets (CSS)Computer ScienceDWHData Bricks

About

I am a Data Engineer with a proven track record of delivering exceptional results. Recognized as a 10X Data Engineer, I excel as a problem solver and thrive in solution-oriented, self-driven environments. My impeccable temperament and team-oriented spirit further enhance my collaborative capabilities. My proficiency spans across a spectrum of skills, starting with a strong foundation in Data Structures and Algorithms. I possess an innate ability to grasp cutting-edge technologies swiftly, enabling me to tackle even the most challenging tasks. On the technical front, I have extensive experience working with Azure's technology stack, including Azure Data Factory, Data Bricks, and Data Lake. My expertise is backed by a series of Microsoft certifications, including the Associate level Data Engineer certificate (DP-203), DP-100, DP-900, AI-900, and AZ-900. In addition, I command a range of programming languages and tools, including PySpark, Scala, Hadoop, and Hive. My mastery extends to languages like Python, SQL, C++, and Java. This diverse skill set ensures that I possess both the technical breadth as well as depth, longed in a successful Data Engineer. I am excited about the prospect of leveraging my expertise to drive impactful solutions and welcome the opportunity to take on new challenges in the ever-evolving field of DATA!

Experience

4 yrs 9 mos

Total Experience

1 yr 7 mos

Average Tenure

2 yrs

Current Experience

Epam systems

Software Engineer II - DATA

Jun 2024 – Present · 2 yrs · Gurugram, Haryana, India · Remote

Hso

Technical Consultant - Data Engineer

Jan 2024 – Jun 2024 · 5 mos · Noida, Uttar Pradesh, India · Remote

Delivered multiple POCs showcasing end to end data pipeline in Microsoft Fabric.
Implemented DE/DS/DA - all three activities in single platform.
Invoked & Executed multiple notebooks through single master notebook & handled notebook errors in Microsoft Fabric.
Applied regression based ML algorithms on batch data for predictive analysis.
Worked with SparkMLlib, Numpy, Pandas, Databricks.
Created semantic Data Model on star schema fashion & created BI dashboard in Fabric.

Microsoft FabricData PipelineRegression ML AlgorithmsSparkMLlibNumpyPandas+4

Cognizant

2 roles

Associate Data Engineer

Sep 2021 – Jan 2024 · 2 yrs 4 mos · Kolkata, West Bengal, India · Remote

Worked mainly with technologies like : ADF, ADB, ADLS, Azure Synapse, Pyspark, Snowflake, Python, SQL, and Excel.
Migrated the Data from on-premise system (SQL Server) to Cloud (Azure Data Lake) using ADF pipelines.
Transformed the loaded data using Data Bricks on top of ADLS implementing Medallion/Multi-Hop Lakehouse Architecture (Bronze > Silver > Gold).
Modified ShopperTrak Validation & reduced the duration from 30 mins to 5 mins i.e. 6X faster than previous.
Scheduled alerts on pipeline failures in Teams & implemented SCD's to capture the dimensional changes.
Played active role in implementation of CI/CD process in Azure Databricks using Azure DevOps
Created Stored Procedures on Synapse, done dimensional modeling (RAW> STAGE>ENTERPRISE) in Snowflake & created multiple dashboards on it, to ease out routine monitoring.

Azure Data FactoryAzure Data LakeAzure SynapsePysparkSnowflakePython+5