Tanumoy Kolay

Data Engineer

Bengaluru, Karnataka, India7 yrs 7 mos experience

Most Likely To Switch

Key Highlights

Over 7 years of experience in Data Engineering.
Expert in designing scalable data pipelines.
Strong foundation in Agile methodologies.

Stackforce AI infers this person is a Data Engineer specializing in Big Data solutions for retail and cloud environments.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBig DataCloud Data WarehousingEtl Development

Other Skills

PythonTableauSnowflakePySparkScalaGCPDataprocBigQueryApache SparkHiveClouderaSparkDBTHadoopShell scripting

About

As a seasoned Data Engineer with over 7 years of experience, I specialize in transforming raw data into actionable insights that drive business decisions. My expertise lies in designing and implementing scalable and optimized data pipelines and solutions using cutting-edge technologies with a strong foundation in Agile Software methodologies. Throughout my career, I have demonstrated a strong ability to manage and optimize large-scale data processing systems, ensuring high performance and reliability. My hands-on experience with cloud platforms, particularly Google Cloud Platform (GCP), has enabled me to develop and deploy robust data architectures that meet the dynamic needs of modern enterprises. I am passionate about continuous learning and staying versed in industry trends to leverage new technologies and methodologies in my work. My goal is to contribute to innovative projects that harness the power of data to solve complex problems and drive strategic growth. • Skills: Apache Spark | Scala | Hive | Dataproc | Snowflake | Cloudera | Python | Agile | DBT | Oozie | MySQL | ETL | Data Pipelines | Shell Scripting | PySpark l GCP | Tableau

Experience

7 yrs 7 mos

Total Experience

1 yr 10 mos

Average Tenure

2 yrs 1 mo

Current Experience

Apple

Data Engineer

Apr 2024 – Present · 2 yrs 1 mo · Hyderabad, Telangana, India · Hybrid

Technologies worked on: Snowflake, Python, HANA, Tableau, AWS

PythonTableauSnowflakeData EngineeringCloud Computing

Walmart global tech india

Data Engineer lll

May 2022 – Apr 2024 · 1 yr 11 mos · Bengaluru, Karnataka, India

As a Data Engineer at Walmart, I played a pivotal role in developing and maintaining data infrastructure to support large-scale retail operations. Leveraging technologies such as Spark, Scala, Python, Hive, GCP and Tableau, I designed and implemented efficient data pipelines, optimized data processing workflows, and ensured seamless data integration across various platforms. My contributions helped drive data-driven decision-making and operational efficiency within one of the world's largest retail organizations.
Technologies worked on:
PySpark, Scala, GCP, Dataproc, BigQuery, Apache Spark, Hive, Cloudera, Presto, Automic, Shell scripting, Tableau

PySparkScalaGCPDataprocBigQueryApache Spark+5

Phdata

Data Engineer

Apr 2021 – May 2022 · 1 yr 1 mo · Bengaluru, Karnataka, India

As a Data Engineer, I worked on building data pipelines for a retail company where the raw data was read from S3 into a Snowflake Warehouse via a Snowpipe from which the data was read in DBT (Data Build Tool), and after transformations were applied the curated data was dumped back into Snowflake. Also, I did optimizations and tuning of existing big data infrastructure for a banking client using pySpark and Shell Scripting.
Technologies worked on:
PySpark, Snowflake, DBT, Hadoop, Apache Spark, Hive, Cloudera, Shell scripting

PySparkSnowflakeDBTHadoopApache SparkHive+4

Accenture

Big Data Engineer

Sep 2018 – Mar 2021 · 2 yrs 6 mos · Bangalore

As a Big Data developer, I was involved in building an ETL framework using Spark and Scala by extracting data from S3 and after business, logic transformation loading the large volume of data into HDFS and Redshift. Also scheduling the resultant jobs using Apache Oozie.
Technologies worked on:
Scala, Hadoop, Apache Spark, Hive, Hbase, Oozie, SQL, Cloudera

ScalaHadoopApache SparkHiveHbaseOozie+4