N

Nishant Gupta

CEO

Noida, Uttar Pradesh, India6 yrs 8 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 5+ years of experience in Data Engineering
  • Developed a framework reducing data ingestion time by 50%
  • Master's in Data Science enhances technical expertise
Stackforce AI infers this person is a Data Engineer specializing in Fintech solutions with strong expertise in data pipeline development.

Contact

Skills

Core Skills

Apache SparkData EngineeringSqlDatabases

Other Skills

Amazon RedshiftAmazon Web Services (AWS)Apache KafkaApache Spark StreamingAzure DatabricksBig DataCloud ComputingData AnalysisData LakesData ModelingData PipelinesData ScienceData VisualizationData WarehousingExploratory Data Analysis

About

Highly motivated Data Engineer with 5+ years of experience specializing in Databricks, Spark, SQL, and Python. Proven ability to design and implement scalable data pipelines using these technologies to ingest and process data from diverse sources. A Master's in Data fuels my passion for building efficient and insightful solutions. I am eager to leverage my skills in a collaborative team environment. ● Current Experience: Senior Software Engineer, Tavant Technologies ◌ Working for a leading US mortgage client, leveraging my expertise in Spark to streamline data ingestion processes. ◌ Developed a highly efficient RDBMS Ingestion Framework using Spark, resulting in a 50% faster data ingestion. ◌ Responsible for designing and implementing data pipelines using SQL and Spark to ensure data quality and accessibility. ● Previous Experience: System Engineer, Tata Consultancy Services (Financial Services Domain) ● Education ◌ M.S. Data Science, Liverpool John Moores University ◌ B.Tech. Electronics & Communication Engineering, Dr. A.P.J. Abdul Kalam Technical University ● Skills ◌ Databricks Expertise: Data Ingestion, Pipeline Development, Optimization, SQL, Alerts ◌ SQL: Data Management, Querying, Analysis (MySQL and PostgreSQL) ◌ Python (Numpy, Pandas, Matplotlib, Seaborn): Data Manipulation, Visualization ◌ Big Data Tools: Apache Spark, PySpark ◌ Data Science: Exploratory Data Analysis, Data Cleaning ◌ ETL Development: Data Integration, Transformation, and Workflow Optimization ● Certifications ◌ Executive Post Graduation Program in Data Science, IIIT-Bangalore ◌ Data Engineer Associate, Databricks ◌ Associate Developer for Apache Spark 3.0 Developer, Databricks

Experience

6 yrs 8 mos
Total Experience
3 yrs 4 mos
Average Tenure
3 yrs 11 mos
Current Experience

Tavant

2 roles

Technical Lead

Jan 2025Present · 1 yr 3 mos · Noida, Uttar Pradesh, India · Hybrid

Apache SparkAzure DatabricksPySparkSQLExtractTransform+2

Senior Software Engineer

May 2022Jan 2025 · 2 yrs 8 mos · Noida, Uttar Pradesh, India · Hybrid

  • ◌ Experienced in developing Apache Spark and SQL scripts for a leading US-based Mortgage Client
  • ◌ Performed Ingestion, Transformation and Processing of Diverse Data Sources
  • ◌ Managing, monitoring and optimizing Data Workflows, Alerts in Databricks
  • ◌ Spearheaded the design and development of an RDBMS ingestion framework, achieving a 50% reduction in processing time.
  • ◌ Collaborated across teams to enhance data solutions, delivering improved performance and cost efficiency.
  • ◌ Acquired Data Engineer Associate and Apache Spark Certification from Databricks
Apache SparkAzure DatabricksSQLData EngineeringExtractTransform+5

Tata consultancy services

System Engineer

Jul 2019Apr 2022 · 2 yrs 9 mos · Gurgaon, India

  • ◌ Worked as an SQL Analyst in the Financial Services Domain.
  • ◌ It was a project of TCS Bancs - Capital Market. (TCS Bancs - It is an award-winning solution deployed at more than 40 clients worldwide).
DatabasesSQLMicrosoft ExcelMicrosoft OfficeLinux

Education

International Institute of Information Technology Bangalore

Executive Post Graduation Programme — Data science

Jun 2021Aug 2022

Liverpool John Moores University

Master of Science - MS — Data Science

Jul 2021Jun 2023

Dr. A.P.J. Abdul Kalam Technical University

Bachelor of Technology - BTech — Electronics and Communication Engineering

Aug 2015Jun 2019

Stackforce found 100+ more professionals with Apache Spark & Data Engineering

Explore similar profiles based on matching skills and experience