Abhinav Singh

Data Engineer

Bengaluru, Karnataka, India6 yrs 2 mos experience

Highly Stable

Key Highlights

Expert in building scalable data pipelines.
Proven track record in reducing data latency and costs.
Strong background in data quality and automation.

Stackforce AI infers this person is a Data Engineering expert in the Healthcare and Fintech sectors.

Contact

Skills

Core Skills

Data EngineeringBig DataCloud ComputingSoftware DevelopmentMachine LearningData Science

Other Skills

API DevelopmentAgile MethodologiesAnalytical SkillsApache KafkaApache SparkAzure DatabricksAzure FunctionsBashBitbucketBootstrapBusiness RequirementsCC (Programming Language)Cascading Style Sheets (CSS)Cloud Applications

About

Senior Data Engineer with 5 years of experience in building and optimizing scalable data pipelines. Skilled in Apache Spark, Hadoop, SQL, Python, and cloud platforms (Azure, AWS). Expertise in designing ETL processes, data lakes, and real-time data solutions. Proven track record of improving data accessibility, reducing processing times, and delivering actionable insights. Passionate about data quality, automation, and leveraging big data technologies to drive business impact. Always eager to learn and innovate to build efficient, high-performance data systems. Key Skills : Python, Azure, Databricks, Spark, Hadoop, Snowflake

Experience

6 yrs 2 mos

Total Experience

4 yrs 7 mos

Average Tenure

1 yr 7 mos

Current Experience

Visa

Senior Data Engineer

Nov 2024 – Present · 1 yr 7 mos · Bengaluru, Karnataka, India · Hybrid

• Create and maintain big data models in Hadoop clusters to detect fraudulent credit card activities including enumeration attacks

Siemens healthineers

3 roles

Senior Data Engineer

Promoted

Nov 2021 – Nov 2024 · 3 yrs

Engineered and implemented advanced analytics platform solutions for the Diagnostics Department, leveraging Databricks for machine data ingestion and processing. The transition to the Databricks Lakehouse architecture achieved a 24-hour reduction in data latency and more than 70% decrease in infrastructure costs.
Architected and optimized the data ingestion pipeline to handle a throughput of 500 million records per day.
Conducted comprehensive data quality assessments and rigorous data validation procedures.
Developed and deployed monitoring dashboards to oversee pipeline performance and detect missing files in the production landing zone. Designed triggers for real-time anomaly detection.
Engaged in collaborative efforts with data analysts and other stakeholders to gather and translate data requirements and business needs.
Proficient in engineering large-scale systems within a production environment and adept at crafting complex SQL queries.

Engineer - Design and Development

Jul 2020 – Nov 2021 · 1 yr 4 mos

Worked on several projects to enable Digitalization of Healthcare services including
”Covid Home Self-test Kit”, urinalysis mobile app
Processing the image to be fed to the algorithms for making callouts. Checking the
image quality and validity.
Training of the algorithm responsible for making callouts (Accuracy - 95 percent).
Involved in experiment design, hypothesis testing, prototype development and final
product delivery
Designing the backend services involving implementation of API Gateway, Azure
Functions, REST APIs, containerization of micro-services using docker in serverless
architecture
Spearheading development of MLOps pipeline from scratch

Deep Learning Intern

May 2019 – Aug 2019 · 3 mos · Greater Bengaluru Area

Trained deep learning YOLOv3 model for detection of Siemens Multistix 10SG Reagent Strip involving data gathering and data annotation.
Processing the image for recognition of various medical conditions by analysing the color change in respective reagent segments.
Deploying a flask app in a linux based docker image.
Framework used:- Darknet.