Hardik Singh

Data Engineer

Bengaluru, Karnataka, India3 yrs 9 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Over 3 years of experience in data engineering.
  • Expert in building scalable data pipelines with Spark and SQL.
  • Proven track record of improving data processing performance.
Stackforce AI infers this person is a Data Engineer with expertise in building scalable data solutions in the SaaS industry.

Contact

Skills

Core Skills

SparkSqlData GovernancePysparkPython

Other Skills

Hadoop HDFSHiveSSISData IngestionKafkaAirflowAzure DatabricksJavaAmazon Web Services (AWS)Amazon RedshiftAWS GlueGoogle BigQueryAzure Data LakeApache KafkaCritical Thinking

About

Hi, I am a Data Engineer with over 3 years of hands-on experience in building scalable data pipelines using Spark, SQL, Python, and cloud platforms like GCP and Azure. In my role, I have had the opportunity to work with clients such as Centrica, a leading UK-based energy and services company, where I designed and implemented robust data workflows to support high-volume data processing and analytics. I’ve worked closely with data scientists, analysts, and cross-functional teams to develop solutions that power AI-driven solution. Over time, I’ve grown comfortable tuning Spark and PySpark jobs for better performance and efficiency. Happy to connect!!

Experience

3 yrs 9 mos
Total Experience
3 yrs 3 mos
Average Tenure
3 yrs 9 mos
Current Experience

Cognizant

Data Engineer

Nov 2022Sep 2025 · 2 yrs 10 mos · Bengaluru, Karnataka, India · Hybrid

  • Built scalable data pipelines using Hadoop HDFS, Hive, and Spark to process large-scale customer data (gas usage, billing, queries), improving data availability for analytics and operational decision-making.
  • Improved Spark jobs handling over 6 billion records per month by tuning performance, which brought down runtime by 60% improving pipeline reliability and meeting SLAs.
  • Created reliable data ingestion pipelines to bring data from multiple systems into the Data Lake, with data masking and protection in place to ensure privacy and compliance.
  • Developed ETL workflows using SSIS and SQL that connected different databases and reduced processing time by 30%, helping teams send accurate bills and respond to customer
  • issues faster.
  • Migrated 8M+ row per day by refactoring legacy HQL into PySpark and tuning SQL procedures, resulting in a 45–50% boost in performance with zero downtime during go-live.
Hadoop HDFSHiveSparkSQLSSISData Ingestion+1

Metyis

Data Engineer

Sep 2022Present · 3 yrs 9 mos · Bengaluru, Karnataka, India · Hybrid

Cognizant

Data Intern

Feb 2022May 2022 · 3 mos

  • Received comprehensive training and hands-on experience with Big Data technologies such as SQL, Python, PySpark, Kafka, and Airflow.
  • Gained hands-on experience in Azure Databricks, applying key concepts to real-world data engineering scenarios.
SQLPythonPySparkKafkaAirflowAzure Databricks

Github

Extern

Oct 2021Dec 2021 · 2 mos · Remote

  • Engineered data ingestion pipelines from a blockchain indexer to PostgreSQL, ensuring reliable and efficient data storage
Data GovernanceJava

Education

Dayananda Sagar College of Engineering, BANGALORE

Bachelor's degree — Computer Science

Aug 2018Aug 2022

Stackforce found 100+ more professionals with Spark & Sql

Explore similar profiles based on matching skills and experience