Tanumoy Kolay

Data Engineer

Bengaluru, Karnataka, India7 yrs 7 mos experience
Most Likely To Switch

Key Highlights

  • Over 7 years of experience in Data Engineering.
  • Expert in designing scalable data pipelines.
  • Strong foundation in Agile methodologies.
Stackforce AI infers this person is a Data Engineer specializing in Big Data solutions for retail and cloud environments.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBig DataCloud Data WarehousingEtl Development

Other Skills

PythonTableauSnowflakePySparkScalaGCPDataprocBigQueryApache SparkHiveClouderaSparkDBTHadoopShell scripting

About

As a seasoned Data Engineer with over 7 years of experience, I specialize in transforming raw data into actionable insights that drive business decisions. My expertise lies in designing and implementing scalable and optimized data pipelines and solutions using cutting-edge technologies with a strong foundation in Agile Software methodologies. Throughout my career, I have demonstrated a strong ability to manage and optimize large-scale data processing systems, ensuring high performance and reliability. My hands-on experience with cloud platforms, particularly Google Cloud Platform (GCP), has enabled me to develop and deploy robust data architectures that meet the dynamic needs of modern enterprises. I am passionate about continuous learning and staying versed in industry trends to leverage new technologies and methodologies in my work. My goal is to contribute to innovative projects that harness the power of data to solve complex problems and drive strategic growth. • Skills: Apache Spark | Scala | Hive | Dataproc | Snowflake | Cloudera | Python | Agile | DBT | Oozie | MySQL | ETL | Data Pipelines | Shell Scripting | PySpark l GCP | Tableau

Experience

7 yrs 7 mos
Total Experience
1 yr 10 mos
Average Tenure
2 yrs 1 mo
Current Experience

Apple

Data Engineer

Apr 2024Present · 2 yrs 1 mo · Hyderabad, Telangana, India · Hybrid

  • Technologies worked on: Snowflake, Python, HANA, Tableau, AWS
PythonTableauSnowflakeData EngineeringCloud Computing

Walmart global tech india

Data Engineer lll

May 2022Apr 2024 · 1 yr 11 mos · Bengaluru, Karnataka, India

  • As a Data Engineer at Walmart, I played a pivotal role in developing and maintaining data infrastructure to support large-scale retail operations. Leveraging technologies such as Spark, Scala, Python, Hive, GCP and Tableau, I designed and implemented efficient data pipelines, optimized data processing workflows, and ensured seamless data integration across various platforms. My contributions helped drive data-driven decision-making and operational efficiency within one of the world's largest retail organizations.
  • Technologies worked on:
  • PySpark, Scala, GCP, Dataproc, BigQuery, Apache Spark, Hive, Cloudera, Presto, Automic, Shell scripting, Tableau
PySparkScalaGCPDataprocBigQueryApache Spark+5

Phdata

Data Engineer

Apr 2021May 2022 · 1 yr 1 mo · Bengaluru, Karnataka, India

  • As a Data Engineer, I worked on building data pipelines for a retail company where the raw data was read from S3 into a Snowflake Warehouse via a Snowpipe from which the data was read in DBT (Data Build Tool), and after transformations were applied the curated data was dumped back into Snowflake. Also, I did optimizations and tuning of existing big data infrastructure for a banking client using pySpark and Shell Scripting.
  • Technologies worked on:
  • PySpark, Snowflake, DBT, Hadoop, Apache Spark, Hive, Cloudera, Shell scripting
PySparkSnowflakeDBTHadoopApache SparkHive+4

Accenture

Big Data Engineer

Sep 2018Mar 2021 · 2 yrs 6 mos · Bangalore

  • As a Big Data developer, I was involved in building an ETL framework using Spark and Scala by extracting data from S3 and after business, logic transformation loading the large volume of data into HDFS and Redshift. Also scheduling the resultant jobs using Apache Oozie.
  • Technologies worked on:
  • Scala, Hadoop, Apache Spark, Hive, Hbase, Oozie, SQL, Cloudera
ScalaHadoopApache SparkHiveHbaseOozie+4

National institute of technology, tiruchirappalli

Teaching Assistant

Jun 2017May 2018 · 11 mos · Tiruchirappalli, Tamil Nadu, India

Steel authority of india limited

Summer Intern

May 2014Jul 2014 · 2 mos · Bokaro Area, India

  • Received an insight into the various processes and the sequence of steps in the manufacture of steel and other products.

Education

National Institute of Technology, Tiruchirappalli

Master of Technology — Industrial Engineering and Management

Jan 2016Jan 2018

Haldia Institute of Technology

Bachelor of Technology - BTech — Production Engineering

Jan 2012Jan 2016

DAV Model School, IIT Kharagpur

12th

Jan 2011Jan 2012

St. Michael's School, Durgapur

10th

Jan 1999Jan 2010

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience