Shubham Goel

Software Engineer

Pune, Maharashtra, India5 yrs 3 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in building scalable data pipelines.
Strong background in data warehousing and modeling.
Proven ability to lead cross-functional data projects.

Stackforce AI infers this person is a Data Engineer specializing in SaaS data solutions and pipeline orchestration.

Contact

Skills

Core Skills

Data EngineeringData WarehousingData ScienceData Analysis

Other Skills

Data IngestionPython (Programming Language)StreamlitSnowflakePandasAirflowPagerduty APISQLMLThoughtspotPythonStored ProcedureAirflow OperatorsKubernetesOkta

About

Hello! I am Shubham Goel, completed my IT engineering from Pune University. I am a data enthusiast who love to work with data and build scalable data pipeline/application. My role as Data Engineer at Snowflake involves me to build scalable and reliable data platform and robust data pipeline which serve the needs for all the data team within Snowflake. I have good knowledge and experience in Data Warehousing, Data Modeling, SQL, Python, Snowflake, Airflow, Fivetran, DBT, Docker, Kubernetes, AWS S3 Storage, IAM, SQS, SNS Thoughtspot, Snowsight, Tableau. I like to challenge myself and force myself to get out of my comfort zone inorder to learn and grow. Feel free to connect with me on LinkedIn or reach out to me on shubhgoel1410@gmail.com

Experience

5 yrs 3 mos

Total Experience

2 yrs 7 mos

Average Tenure

3 yrs 4 mos

Current Experience

Confluent

2 roles

Senior Data Engineer

Feb 2026 – Present · 3 mos · Remote

Data Engineer II

Jan 2023 – Feb 2026 · 3 yrs 1 mo · Remote

As a Data Engineer II at Confluent, I work very closely with the Go to Market (GTM) and Field Ops business partners to build new end-to-end solutions through data pipelining, data modeling and data warehousing along with maintaining existing workflows
Independently lead communication and develop relationship with Business Partners and understand their requirements along with deep business context
Design optimized efficient end-to-end solutions
Data Modelling for requirements involving development of a full fledged data warehouse
Building pipelines using Apache Airflow
Create/Access new data sources for business partners using API methodologies or third party integrations
Gain expertise in business knowledge and context around the designed solutions for selected verticals

Data IngestionPython (Programming Language)Data EngineeringData Warehousing

Snowflake

Data Engineer I - Data Platform

Jan 2021 – Dec 2022 · 1 yr 11 mos · Pune, Maharashtra, India

Project : Snowflake File Upload Utility
Tech Used - Streamlit, Snowflake
Project : Airflow Dag Health Report
Tech Used : Pandas, Snowflake, Airflow
Project : Airflow DAGs Failure Alerting
Tech Used - Airflow, Pagerduty API
Project : Salesforce Opportunity Prediction
Tech Used - SQL, ML, Snowflake, Thoughtspot
Project : Orchestration Logging Framework
Keeping track of all data pipelines triggered via Airflow,Snowflake Task, Fivetran for tracking consistency in data curation.
Tech Used - Python,Stored Procedure, Airflow Operators, Kubernetes
Project : Airflow Okta integration
Tech Stack - Airflow, Okta
Project : Custom airflow backfill plug-in
Tech Stack - Flask, Bootstrap, Airflow.
Build airflow error classification dashboard.
Tech Stack - Snowflake, Thoughtspot.
Build the CICD pipeline to validate Airflow DAG files
Tech Stack - Github Action, Python, Airflow, Docker
Ingesting the production logs generated by Airflow DAG files.
Tech Stack - Snowflake, AWS, Python, Airflow, Docker
Building real time airflow dashboard for airflow health monitoring
Tech Stack - Wavefront, Snowflake, Airflow

Data IngestionPython (Programming Language)Data EngineeringData Warehousing

Kpmg

Data Analytics Virtual Internship

Jun 2020 – Jul 2020 · 1 mo

The aim was to find top 1000 potential customers for Sprocket Central. For this I used data wrangling and visualizing techniques to find the list of customers which would help the company to increase the sales.
Tech Stack - Python, Excel, Pandas, Matplotlib, Seaborn, Tableau.