Abhinav .

Data Engineer

India6 yrs 7 mos experience

Key Highlights

Over 5 years of experience in Data Engineering.
Expert in Azure technologies for ETL and data visualization.
Proficient in big data processing using PySpark and Spark.

Stackforce AI infers this person is a Data Engineering expert in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringAzureBig DataData Integration

Other Skills

AlertingAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon S3Apache AirflowApache FlumeApache KafkaApache SparkApache SqoopAzure Data FactoryAzure DatabricksAzure SQLAzure StorageAzure Synapse AnalyticsBash

About

A Data Engineer with over 5 years of experience, I specialize in utilizing Hadoop, Hive, Spark, Python, and Azure technologies, including Azure Databricks, Data Factory, Azure SQL Database, and Azure Synapse, for ETL processes and data visualization in the retail sector. I am proficient in moving data to HDFS and leveraging Hive and Azure for data processing and pipeline orchestration. I honed my expertise in PySpark, Hive, Databricks, and Data Factory at Fractal Analytics. This role significantly enhanced my skills in big data and cloud technologies. During my tenure at Gen Digital (formerly Norton LifeLock), I developed similar competencies, adding depth to my experience with PL/SQL, Oracle, Tableau, and Web Scraping across both positions. Holding a B.Tech in Computer Science from SRM University, with certifications in Azure, I am passionate about leveraging advanced technologies to address complex challenges. I thrive in environments that foster diversity and collaboration, bringing innovative solutions to the forefront of technology.

Experience

6 yrs 7 mos

Total Experience

1 yr 2 mos

Average Tenure

9 mos

Current Experience

Blackrock

Associate - Data Pipeline Engineer

Sep 2025 – Present · 9 mos · Gurugram, Haryana, India · On-site

Tredence inc.

Consultant - Data Engineering

Jul 2024 – Sep 2025 · 1 yr 2 mos · Gurugram, Haryana, India · Remote

Built and managed ETL pipelines in Azure using Azure Synapse Analytics and Azure Storage for efficient data integration.
Developed and optimized Delta Live Tables pipelines in Azure Databricks for processing batch data from various sources.

Azure Synapse AnalyticsAzure StorageETL pipelinesDelta Live TablesAzure DatabricksData Engineering+1

Publicis sapient

Senior Associate Data Engineer

Mar 2024 – Jul 2024 · 4 mos · Gurugram, Haryana, India · Remote

Spearheaded implementation of in-memory processing using Apache Spark in Azure Synapse Analytics, enhancing big data analytical app performance.
Managed ETL pipelines in Azure environment, leveraging Azure Synapse Analytics, Storage, and Spark pool for streamlined data processing.
Optimized Delta Live Tables pipeline in Azure Databricks for real-time analytics capabilities.

Apache SparkAzure Synapse AnalyticsETL pipelinesDelta Live TablesAzure DatabricksData Engineering+1

Career break

Personal goal pursuit

Sep 2023 – Feb 2024 · 5 mos · Basel, Switzerland

Pursued a Master's in Data Science at the University of Basel, but chose to exit after the first semester to focus on hands-on industry experience and real-world data engineering challenges.

Fractal

Data Engineer

Jun 2021 – Aug 2023 · 2 yrs 2 mos · Bengaluru, Karnataka, India · Remote

Designed and implemented PySpark scripts for efficient data processing and analysis.
Engineered robust ETL pipelines using PySpark for data extraction and transformation.
Conducted performance tuning of PySpark jobs, achieving significant reductions in data processing time.

PySparkETL pipelinesData EngineeringAzure DatabricksAmazon S3Big Data

Gen

2 roles

Associate Data Engineer

Aug 2019 – May 2021 · 1 yr 9 mos · Greater Chennai Area · On-site

Enhanced SQL development and Informatica workflows to streamline data processing and integration.
Played a key role in web scraping initiatives using Python for data extraction and integration.
Implemented rigorous data validation and quality checks to ensure data integrity and consistency.
Automated data workflows using Python and PySpark to drive operational efficiencies and reduce manual effort.

SQLInformaticaPythonWeb ScrapingData EngineeringData Integration

Data Engineering Intern

Jan 2019 – Jun 2019 · 5 mos · Greater Chennai Area · On-site

Extracted data from diverse sources to support analytical and business intelligence initiatives.
Developed dimensional modeling skills for efficient data organization and optimization.
Utilized Python and BeautifulSoup for web scraping, extracting data from web sources.

PythonBeautifulSoupData Engineering