Agam Gupta

Data Engineer

India5 yrs 11 mos experience

Most Likely To Switch

Key Highlights

Proven expertise in data engineering and ETL processes.
Strong background in optimizing data pipelines for efficiency.
Mentored junior engineers, fostering knowledge sharing.

Stackforce AI infers this person is a Data Engineering specialist with a focus on ETL processes and big data solutions.

Contact

agamgupta013@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringBig DataEtlData Modeling

Other Skills

ADFSADLSAirflowAlgorithmsApache AirflowApache SparkAzure DatabricksC (Programming Language)C++Cascading Style Sheets (CSS)Computer ScienceDWHData ArchitectsData Build Tool (DBT)Data Loading

About

Experienced Software Engineer with a demonstrated history of working in the information technology and services industry. Skilled in Microsoft Word, C++, HTML, JavaScript, and SQL. Strong engineering professional with a Master of Computer Applications - MCA focused in Computer Science from National Institute of Technology Jamshedpur.

Experience

Tide

Analytics Engineer

Aug 2024 – Present · 1 yr 7 mos · Remote

Tiger analytics

Data Engineer

Feb 2024 – Jul 2024 · 5 mos · Remote

PySparkSQLADLSAzure DatabricksBig DataData Engineering

Sigmoid

Data Engineer

Aug 2021 – Feb 2024 · 2 yrs 6 mos · Remote

Constructed a real-time framework for data ingestion, cleansing, and transformation to Snowflake, leveraging Pub/Sub, Python, Airflow, dbt, and GCS.
Enhanced data pipeline efficiency by 25% through the performance tuning and optimization of SQL queries in Snowflake.
Utilized Snowflake's Stages, Streams, and Change Data Capture (CDC) concept to establish a streamlined data pipeline.
Crafted and implemented the pipeline architecture for loading both historical and incremental data, adhering to the medallion architecture and accounting for backfill requirements on specific dates.
Guided junior data engineers through mentorship, facilitated knowledge-sharing sessions, and conducted code reviews to ensure adherence to coding principles, including OOPs, naming conventions, optimization, and addressing corner cases.
Restructured the database model into a star schema architecture.

Microsoft AzureADFSSQLAzure DatabricksADLSPySpark+20

Jio

Software Developer

Dec 2020 – Aug 2021 · 8 mos · Remote

Prepbytes

Mentor

Jun 2020 – Nov 2020 · 5 mos · Remote

Truminds software systems

Intern

Jan 2020 – May 2020 · 4 mos · On-site

Gained hands-on experience with PySpark by supporting and troubleshooting critical bugs in large-scale data processing workflows. Collaborated with the team to identify root causes, optimize code, and maintain high data pipeline availability and performance.
Collaborated with cross-functional teams to implement fixes and enhancements in data workflows, maintaining data quality and consistency.

PySpark