Subham Dey

Data Engineer

India7 yrs 8 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

7+ years of experience in data engineering.
Expert in Azure Cloud and ETL processes.
Proven track record in mentoring and team leadership.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech environments.

Contact

Skills

Core Skills

Azure Data FactoryData EngineeringPythonData ModelingSql OptimizationData Warehouse DesignData IntegrationNatural Language Processing

Other Skills

Agile MethodologiesAgile Project ManagementAlteryxAnalytical SkillsApacheApache SparkAttention to DetailAzure Data LakeAzure DatabricksAzure DevOps ServicesBig DataBusiness AcumenBusiness Intelligence (BI)Business ProcessBusiness Reporting

About

Data Engineer with 7+ years of experience in designing, implementing, and optimizing data solutions across domains like Banking,Telecom, Retail. Proficient in Azure Cloud, PySpark, SQL, and ETL processes, with hands-on expertise in tools like Azure Data Factory, Databricks, and Synapse Analytics. Known for bridging the gap between technical and non-technical teams, I excel in translating complex data into strategic decisions. My forward-thinking approach keeps me at the forefront of trends like AI and advanced analytics, and I take pride in mentoring junior team members to foster growth and build high-performing teams. My goal is to leverage my technical expertise and leadership skills to continue driving innovation in data engineering and enabling organizations to make data-driven decisions with confidence.

Experience

7 yrs 8 mos

Total Experience

3 yrs 11 mos

Average Tenure

3 yrs 10 mos

Current Experience

Pwc acceleration centers in india

2 roles

Senior Associate 3

Promoted

Jan 2024 – Present · 2 yrs 5 mos · India · Hybrid

Designed and implemented an Azure-powered data platform as a unified source of truth, enhancing data quality and enabling seamless use by cross-functional teams.
Led the migration of ETL processes from SSIS to Azure Data Factory, significantly reducing operational costs and improving efficiency.
Developed scalable data pipelines in Azure Databricks using Apache Spark to transform raw data into standardized formats for analytical use.
Automated manual workflows with Power Automate, minimizing operational overhead and ensuring data consistency.

Azure DevOps ServicesApacheAzure Data FactoryData Engineering

Senior Associate 2

Aug 2022 – Feb 2024 · 1 yr 6 mos · India · Hybrid

Trained and mentored junior developers in advanced Python, PySpark, and Azure techniques to foster team growth and scalability.
Revamped and documented data dictionaries to improve consistency and domain understanding across projects.
Collaborated with project stakeholders to design efficient data models, enabling better decision-making through improved reporting.
Managed code versioning and deployments using GitHub and Azure DevOps, streamlining collaboration and delivery timelines.

Azure DevOps ServicesApachePythonData Modeling

Capgemini

2 roles

Senior Analytics Engineer

Promoted

Dec 2020 – Sep 2022 · 1 yr 9 mos · On-site

Led efforts in optimizing SQL queries and database performance, reducing data retrieval times and storage costs by streamlining processes.
Contributed to the development of ELT packages for large datasets, improving the accessibility and efficiency of reporting systems.
Designed scalable data models and supported schema creation for robust data warehouse structures, enabling seamless reporting through Power BI.

ApachePandaSQL OptimizationData Warehouse Design

Analytics Engineer

Sep 2018 – Nov 2020 · 2 yrs 2 mos · On-site

Assisted in integrating and transforming raw data from multiple systems, including Salesforce and Pega, using Databricks and Azure Synapse Analytics.
Participated in data modeling and schema design, ensuring efficient storage and access across business teams.
Collaborated with senior engineers to maintain the reliability and consistency of data pipelines across diverse data sources.

ApacheAzure Data FactoryData IntegrationData Modeling

Iiit hyderabad

Summer Intern

Apr 2017 – Jun 2017 · 2 mos · Hyderabad, Telangana, India

Worked as a summer intern at IIIT-H Advanced Summer School on NLP (IASNLP-2017)
Project: Rule-based System for Formal Sentence Compression
Using NLTK library and Python, developed a rule-based system to compress Wikipedia paragraphs.