Abhay Singh

Data Engineer

Bengaluru, Karnataka, India7 yrs 11 mos experience
Highly Stable

Key Highlights

  • Proven track record in data engineering and machine learning.
  • Led successful data migration projects to cloud platforms.
  • Developed high-accuracy machine learning models for business insights.
Stackforce AI infers this person is a Data Engineering and Machine Learning expert in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringMachine LearningSoftware Development

Other Skills

.NetApache KafkaApache SparkAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevOpsAzure SynapseC#C++Data AnalysisData CleansingData ModelingData PipelinesData Science

About

I'm a data professional with a strong background in data engineering and machine learning . With a proven track record of delivering successful projects, I'm passionate about helping businesses harness data for informed decisions. Email: abhay4079@gmail.com

Experience

7 yrs 11 mos
Total Experience
2 yrs
Average Tenure
1 yr 9 mos
Current Experience

7-eleven

Senior Data Engineer

Sep 2024Present · 1 yr 9 mos · Bengaluru, Karnataka, India · Hybrid

A.p. moller - maersk

2 roles

Data Engineer III

Promoted

Apr 2024Sep 2024 · 5 mos · Bangalore Urban, Karnataka, India

  • Managed and directed a team of 5 individuals to optimize product delivery timelines, resulting in a 20% increase in on-time project completions.
  • Developed and implemented a comprehensive data cleansing framework in Python/Scala and SQL, resulting in a 60% reduction in manual effort required for cleaning data.
  • Developed a Random Forest-based machine learning model, achieving 92% accuracy in predicting claims for Containers, while optimizing accuracy by 15% through insightful data analysis and feature engineering.
  • Led the successful migration of complex company data from on-premise to Cloud using Databricks and Azure Synapse, leading to a 25% increase in performance.
  • Developed a comprehensive data solution that increased datalog accuracy by 36%, reducing errors and improving overall efficiency.
  • Designed and developed ETL architecture and Data Pipelines from scratch, enabling efficient loading of
  • operational data into the Data Warehouse. Achieved an accuracy rate of 99.9% for loaded data.
  • Developed Azure Databricks notebooks and built business models using SQL,Python and Scala which provides business owners a greater visibility on Terminal performance, leading to better decision-making processes.
  • Pulled data from multiple sources like Rest Api, Kafka, SQL Server, Blob, Gen2,Delta Lake using ADF and
  • Databricks
PythonScalaSQLAzure DatabricksDatabricksRandom Forest+5

Data Engineer

Jul 2021Apr 2024 · 2 yrs 9 mos · Bangalore Urban, Karnataka, India

  • Created Data Cleansing Framework in Python/Scala and SQL to automate the process by 60%.
  • Implemented complex data migration from on premise to Cloud using Databricks and azure synapse which lead an increase in performance by 25%.
  • Developed ETL architecture and Data Pipelines from scratch to load data into Data Warehouse.
  • Created reports and build Data models using Operational Data (Logistic/Shipment ) .
  • Created data model and BI reports to reduce false claims and helps on costs savings of 10% and also helps to manage Containers health.
  • Created Azure Databricks notebooks and build business models using SQL which helps business owners to have more visibility on Terminals performance.
PythonScalaSQLAzure DatabricksData Engineering

Topmate.io

Education Mentor

Apr 2024Present · 2 yrs 2 mos · India · Remote

Maq software

2 roles

Software Engineer

Promoted

Apr 2020Jul 2021 · 1 yr 3 mos

  • Analyze requirements provided by clients/stakeholders.
  • Working on a C# and .Net solution to enhance the Portal used by agents to monitor transaction
  • and fraud detection.
  • Created multiple portals/apps using PowerApps to enhance customer experience.
  • Worked on build pipelines and releases.
  • Designed and developed mart (data warehouse) on top of staged data using stored procedures.
  • Designed and developed a complex Tabular model which is being used for Marketing related metrics.
  • Created Power BI reports on top of SSAS models which will be used by stakeholders for taking better business decisions.
C#.NetPowerAppsPower BISSASSoftware Development

Associate Software Engineer

Apr 2019Apr 2020 · 1 yr

  • Build and optimize SSIS package to process the data in different environments
  • Building procedures that will incorporate business logic into the data
  • Build SSAS models to show the data on Power BI reports
  • Build Power BI reports on top of the processed data.
  • Optimize database backup and restore process
  • Create Test cases for the code developed.
SSISPower BISQLSoftware Development

casio india company private limited

Campus Ambassador

Jul 2018Apr 2019 · 9 mos

  • -Campus Ambassador

Education

Lovely Professional University

Bachelor of Technology - BTech — Computer Science

Stackforce found 100+ more professionals with Data Engineering & Machine Learning

Explore similar profiles based on matching skills and experience