Gaurav Sati

Senior Software Engineer

Noida, Uttar Pradesh, India4 yrs 6 mos experience

Highly Stable

Key Highlights

Over 3.5 years of experience in data engineering.
Expertise in building scalable ETL pipelines.
Proficient in using Databricks and Snowflake for data solutions.

Stackforce AI infers this person is a Data Engineer specializing in SaaS solutions for large-scale data processing.

Contact

Skills

Core Skills

DatabricksEtlData Processing

Other Skills

AWS CloudFormationAWS GlueAWS LambdaAWS S3AWS athenaAirflowAlgorithmsAmazon DynamodbAmazon KinesisAmazon Kinesis FirehoseAmazon S3Amazon Web Services (AWS)AnalyticsApache AirflowApache Amabri

About

Spark | Python | SQL | Databricks | DBT | Snowflake | AWS | ETL Pipelines | Git | Data Modeling I’m a passionate Data Engineer with over 3.5 years of experience building scalable data pipelines, optimizing ETL/ELT workflows, and delivering reliable data solutions for large-scale clients in the Insurance and Telecom industries. I specialize in transforming raw data into meaningful insights using tools like Python, Spark, SQL, Databricks, and DBT. I’ve built dynamic data workflows and reusable frameworks that improve performance and data quality, while also automating deployments using Jenkins and Git. I’m always eager to learn new technologies, improve processes, and take on challenges that push me to grow. I believe in continuous learning and collaboration to drive impactful outcomes in data engineering.

Experience

4 yrs 6 mos

Total Experience

3 yrs 6 mos

Average Tenure

11 mos

Current Experience

Barclays

Senior Software Engineer

Jun 2025 – Present · 11 mos · Pune, Maharashtra, India · On-site

Accenture

2 roles

Software Engineer

Promoted

Oct 2023 – Jun 2025 · 1 yr 8 mos · Noida, Uttar Pradesh, India

Developed various modules in Datarbicks as part of the ETL pipeline using PySpark and SparkSQL for
processing various formations of data like JSON, XML, CSV, Parquet and ORC. The modules include
Dynamic JSON flattening, SCD TYPE 2, Row Compression, Proactive Data quality and Integrity checks.
Designed and implemented incremental data processing from raw files of various formats using
Databricks Autoloader.
Developed dynamic DBT models in Snowflake for reusable use cases like Row Compression,
SCD Type-1 & 2, and Audit & Logging, leveraging features like macros, snapshots, and ephemeral
models to optimize workflows.
Designed and scheduled DAGs in Apache Airflow to automate ETL pipelines, ensuring timely and
reliable data processing.
Applied Spark performance tuning techniques such as caching, parallelism, and broadcast joins to
optimize ETL jobs, resulting in a 20% reduction in processing time for pipelines handling over 2 million
daily records.

PySparkSparkSQLDatabricksDBTApache AirflowETL+2

Associate Software Engineer

Nov 2021 – Oct 2023 · 1 yr 11 mos · Noida, Uttar Pradesh, India

Developed, maintained, and scheduled Informatica BDM jobs by performing daily checks on jobs to
ensure successful data ingestion.
Monitored, debugged, and enhanced ETL workflows using Hive, SQL, and Informatica BDM, ensuring
100% customer satisfaction by resolving 20+ production issues monthly during SIT/UAT and
production support.
Created and managed data processing pipelines using AWS Lambda in Python for daily file
processing, ensuring efficient data storage in Amazon S3.
Developed and enhanced various UNIX and Python scripts for AWS and On-Premise applications.