Subhadeep Koley

Data Engineer

Kolkata, West Bengal, India7 yrs 7 mos experience

Key Highlights

  • 7 years of experience in Big Data technologies.
  • Expertise in end-to-end data engineering processes.
  • Strong communication skills supporting QA teams.
Stackforce AI infers this person is a Big Data Engineer with expertise in data pipeline development and cloud technologies.

Contact

Skills

Core Skills

Big DataData EngineeringBusiness IntelligenceData Analysis

Other Skills

Agile MethodologiesAnalyticsApache AirflowApache OozieApache SparkApache SqoopAzure Data FactoryAzure DatabricksBigQueryBusiness Intelligence (BI)Data AnalyticsDistcpGCPGoogle BigQueryGoogle Cloud Platform (GCP)

About

• Technical professional with 7 years of experience in area of programming in Big Data - Hadoop, PySpark, Spark SQL, Python, Hive, Sqoop, Apache Airflow, BigQuery, Oozie, Teradata, Unix, Azure Databricks, GCP. • End-to-end experience of a project from requirement analysis to system study, designing, coding, testing, debugging, documentation and implementation. • Good communication & interpersonal skills with the abilities in providing support to QA team skill set. • Delivering & implementing the projects as per scheduled milestones.

Experience

Bt group

Data Engineering Professional

Jun 2024Present · 1 yr 9 mos · Kolkata, West Bengal, India · On-site

Walmart global tech india

Data Engineer III

Oct 2021May 2024 · 2 yrs 7 mos · Bengaluru, Karnataka, India

  • Environment/Technologies used: PySpark, Spark SQL, Python, GCP, Apache Airflow, BigQuery, Hive, Oozie.
PySparkSpark SQLPythonGCPApache AirflowBigQuery+4

Ibm

Data Engineer

May 2021Oct 2021 · 5 mos · Kolkata, West Bengal, India

  • Environment/Technologies used: PySpark, Spark SQL, Python, Azure Data Factory, Azure Databricks, Power BI.
PySparkSpark SQLPythonAzure Data FactoryAzure DatabricksPower BI+2

Tata consultancy services

2 roles

Big Data Engineer

Sep 2018Apr 2021 · 2 yrs 7 mos

  • Environment/Technologies used: PySpark, Spark SQL, Sqoop, Python, Distcp, HDFS, Hive, Oozie, Unix Shell scripting, Teradata.
PySparkSpark SQLSqoopPythonDistcpHDFS+6

Assistant System Engineer Trainee

Jun 2018Sep 2018 · 3 mos

  • Domain Specialization: Business Intelligence
  • Environment/Technologies Used: SQL, PL/SQL, UNIX , Informatica, Tableau.
SQLPL/SQLUNIXInformaticaTableauBusiness Intelligence+1

Education

Institute of Engineering & Management (IEM)

Bachelor of Technology - BTech — Information Technology

Jan 2014Jan 2018

Stackforce found 100+ more professionals with Big Data & Data Engineering

Explore similar profiles based on matching skills and experience