H

HARSH SINGH

Data Engineer

New Delhi, Delhi, India3 yrs 9 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Improved data workflow performance by 14%
  • Reduced analytics pipeline processing time by 27%
  • Certified Databricks Data Engineer Associate
Stackforce AI infers this person is a Data Engineer specializing in scalable data solutions and real-time analytics.

Contact

Skills

Core Skills

Apache SparkAzure DatabricksBig Data

Other Skills

Apache KafkaAzure Data FactoryAzure DevOps ServicesC++Data GovernanceData StructuresDatabricksDelta LakeETL DesignJavaPrompt EngineeringPySparkSQLSQL Performance TuningScala

About

I am a Data Engineer with over 3 years of experience building scalable, high-performance data solutions. I specialize in Databricks Lakehouse, Delta Lake, Spark Structured Streaming, and Azure Data Services to design robust ETL pipelines, optimize workflows, and enable real-time analytics. At Infosys, I delivered measurable impact by improving data workflow performance by 14% through SQL tuning and script optimization, and reducing analytics pipeline processing time by 27% by implementing Delta Lake-based architectures. My expertise spans SQL performance optimization, data governance, metadata management, and dimensional modeling. I have hands-on experience with streaming data pipelines (Apache Kafka, Spark), AI-driven analytics solutions (LangChain, Streamlit), and cloud-based orchestration tools like Azure Data Factory and Azure DevOps. Certified Databricks Data Engineer Associate, I am passionate about designing modern data platforms and enabling businesses to make data-driven decisions. ✅ Key Skills: Databricks | Delta Lake | Spark SQL | Apache Kafka | PySpark | Azure Data Factory | Azure DevOps | ETL Design | Data Governance | Streaming Data | SQL Performance Tuning Open to global opportunities with visa sponsorship and relocation.

Experience

Infosys

2 roles

Specialist Programmer

Promoted

Jul 2023Present · 2 yrs 8 mos

ScalaSQLAzure DevOps ServicesSystems DesignC++Apache Spark+3

Digital Specialist Engineer

Oct 2022Jul 2023 · 9 mos

Big DataC++Apache SparkAzure DatabricksData Structures

Geekster

Mentor

May 2022Sep 2022 · 4 mos

JavaC++Data Structures

Cognizant

Intern

Feb 2022May 2022 · 3 mos · Noida, Uttar Pradesh, India

C++Data Structures

Education

Maharaja Agrasen Institute Of Technology, Delhi

B.Tech — Information Technology

Jan 2018Jan 2022

Stackforce found 100+ more professionals with Apache Spark & Azure Databricks

Explore similar profiles based on matching skills and experience