Anirban Dutta

Data Engineer

Kolkata, West Bengal, India6 yrs 7 mos experience

AI EnabledAI ML Practitioner

Key Highlights

5+ years of experience in data engineering.
Expertise in Azure Databricks and PySpark.
Proven track record in designing robust data solutions.

Stackforce AI infers this person is a Data Engineer specializing in SaaS solutions with a focus on data integration and analytics.

Contact

Skills

Core Skills

Data EngineeringSnowflakeDatabricksEtlAzure

Other Skills

AWSAmazon Web Services (AWS)Apache AirflowApache SparkAzure Data FactoryAzure ServicesAzure SynapseExtract, Transform, Load (ETL)GenAIHiveQLMicrosoft AzurePysparkPythonSQLTSQL

About

Experienced Data Engineer with more than 5+ years of expertise in Azure Databricks, PySpark, SQL, Python, and Data Lake technologies. Proven track record in designing and implementing robust data solutions. Passionate about leveraging data to drive business insights. Open to new opportunities in the dynamic field of data engineering. Lets connect and explore possibilities! #DataEngineer #Azure #PySpark #SQL #DataLake #Python #DataEngineering

Experience

Growtharc

Senior Data Engineer

Apr 2025 – Present · 11 mos · Remote

1) Building GenAI-powered data solutions using Snowflake Cortex, enabling natural language query generation, sentiment analysis, and insight extraction directly from Snowflake-hosted data.
2) Integrated Cortex functions into Streamlit apps and Slack bots to create interactive tools for sales and analytics teams, improving access to data-driven insights.
3) Developed internal POCs to demonstrate the value of LLM-based summarization and recommendations within the Snowflake Data Cloud ecosystem.
4) Collaborating with cross-functional stakeholders to operationalize GenAI use cases in the data pipeline, aligning engineering work with business outcomes.

SnowflakeGenAIPythonData Engineering

Genpact

Lead Consultant

Feb 2024 – Apr 2025 · 1 yr 2 mos · Kolkata, West Bengal, India · Hybrid

1) Created/Developed Orchestration framework using Airflow and Python to orchestrate Databricks workflows in a template driven approach.
2) Implemented multiple Python modules using different APIs to extract data, trigger jobs, refresh Tableau dashboards etc.
3) Worked on Databricks migration project to move Greenplum objects to Databricks.
4) Converted Postgres functions to corresponding Spark SQL Notebooks as part of Migration.
5) Migrated AWS Glue jobs, Step Functions to Databricks

Apache AirflowPythonDatabricksAWSData Engineering

Ibm

Application Developer Microsoft Cloud

Nov 2021 – Feb 2024 · 2 yrs 3 mos · Kolkata, West Bengal, India

1) Worked as a Data Engineer for one of the biggest client in US Telecom sector. Responsible to develop end to end ETL pipeline to load telecom survey data from Qualtrics into Snowflake using Pyspark, Databricks, SQL.
2) Implemented generic ETL/ELT jobs using pyspark and databricks which can accept parameters from json files to run different types of extraction, transformation based on user requirement.

PysparkDatabricksSQLData EngineeringETL

Tata consultancy services

2 roles

System Engineer

Promoted

Aug 2021 – Nov 2021 · 3 mos · Kolkata, West Bengal, India

1) Developed pipeline to load and transform data from Flatfiles into Azure Synapse using Talend, Pyspark & Azure Databricks, TSQL.
2) Implemented Fact Dimension model in Data
Warehousing Layer to reconcile and scale up down business metrics considering Cognos data as a source of truth using SQL Stored Procedure

TalendPysparkAzure SynapseSQLData EngineeringAzure

Assistant System Engineer

Jul 2019 – Jul 2021 · 2 yrs · Kolkata, West Bengal, India

1) Developed, implemented, supported and maintained data analytics protocols, standards and documentation. Built an End-to-End pipeline to extract data from source like SAP Hana, SQL Server to load into Azure Synapse Analytics using Talend, TSQL, Azure Services.
2) Collaborated with Development / QA team on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.

TalendTSQLAzure ServicesData EngineeringETL