Nirmal Singh

Data Engineer

Uttarakhand, India5 yrs 11 mos experience

Key Highlights

  • Expert in designing scalable ETL pipelines.
  • Strong background in data quality frameworks.
  • Proven experience in cloud data engineering.
Stackforce AI infers this person is a Data Engineering expert in Fintech and SaaS industries.

Contact

Skills

Core Skills

Data EngineeringEtl DevelopmentData Quality AssuranceCloud Data Engineering

Other Skills

AWSAWS (glue, lambda, athena, redshift)AWS EMRAWS GlueAWS LambdaAWS RedshiftAWS S3Amazon S3Apache SparkAzure Data FactoryAzure DatabricksData Build Tool (DBT)DatabricksGoogle BigQueryGreat Expectations

About

As a Senior Data Engineer at Incedo Inc., I collaborate with one of the top 5 US banks on data engineering and analytics initiatives. I oversee and manage data engineering and analytics tasks to support critical banking operations. I design and implement scalable ETL pipelines using PySpark,AWS, Hadoop, and SQL to process large-scale financial datasets. I also build a robust data quality framework leveraging Great Expectations (GX) and custom functions to ensure data accuracy, consistency, and integrity. I handle data integration and transformation processes utilizing Oracle databases. I have a strong background in computer science and hold certifications in Neo4j Graph Data Science and Neo4j Certified Professional. I am passionate about developing and optimizing data pipelines for efficient data processing and analysis.

Experience

Incedo inc.

Senior Data Engineer

Mar 2023May 2025 · 2 yrs 2 mos · Gurugram, Haryana, India

  • Project: Collaborating with one of the top 5 US bank on data engineering and analytics initiatives.
  • Responsibilities:
  • Overseeing and managing data engineering and analytics tasks to support critical banking operations.
  • Designing and implementing scalable ETL pipelines using PySpark,Airflow, AWS (glue ,lambda, Athena, redshift), and SQL to process large-scale financial datasets.
  • Building a robust data quality framework leveraging Great Expectations (GX) and custom functions to ensure data accuracy, consistency, and integrity.
  • Handling data integration and transformation processes utilizing Oracle databases.
  • Technical Skills:
  • Tools & Technologies: PySpark, SQL, Python, Oracle, AWS ( glue, lambda, athena and redshift).
  • Specialization: Development and optimization of data pipelines for large-scale financial data processing; implementation of data quality frameworks.
PySparkSQLPythonOracleAWS (glue, lambda, athena, redshift)Data Engineering+1

Cognizant

Data Engineer

Jan 2022Mar 2023 · 1 yr 2 mos · Noida, Uttar Pradesh, India

  • Migrated on-premise data pipelines to AWS Cloud at Charter Communications, leveraging services like S3, Glue, EMR, Lambda, and Redshift to improve scalability, performance, and cost-efficiency.
AWS S3AWS GlueAWS EMRAWS LambdaAWS RedshiftCloud Data Engineering

Tata consultancy services

System Engineer

Jun 2019Jan 2022 · 2 yrs 7 mos · Pune, Maharashtra, India

Education

Birla Institute of Applied Sciences

Computer — Computer Science

Jan 2015Jan 2019

Stackforce found 100+ more professionals with Data Engineering & Etl Development

Explore similar profiles based on matching skills and experience