Harshpreet Singh

CTO

London, England, United Kingdom9 yrs 6 mos experience

Key Highlights

Led AWS Security Data Library for authoritative security data.
Achieved 89% metric consistency at LinkedIn.
Developed innovative healthcare solutions using FHIR.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech with a focus on cloud solutions.

Contact

harshpreet909@gmail.com LinkedIn

Skills

Core Skills

Amazon Web Services (aws)Data EngineeringData AnalysisCloud ComputingHealthcare

Other Skills

AirflowAlgorithmsApache SparkApache Spark StreamingApache kafkaApache sparkAvroAzure Data FactoryBig DataBig Data AnalyticsC (Programming Language)C++Data ScienceData StructuresDatabase Development

About

As a Data Engineer at AWS Security, I lead and build the AWS Security Data Library, establishing it as the authoritative source of security data for AWS. I leverage my expertise in AWS, Spark,Scala and Python to design and implement scalable and reliable data pipelines, workflows, and transformations, enabling faster and easier access and analysis of security data across AWS services and teams. I have a Master's degree in Data Science from Birla Institute of Technology and Science, Pilani, and a Bachelor of Engineering (B.E.) from Netaji Subhas Institute of Technology. I have also obtained multiple certifications in Java, SQL, and machine learning. I am the owner of a patent for a tool to test varied branches of code seamlessly and holistically by simulating it with auto-generated multiple input variants intelligently. I am passionate about solving complex design problems and developing innovative solutions to unusual and difficult challenges.

Experience

Amazon web services (aws)

Senior Data Engineer - AWS Security

Apr 2022 – Jan 2025 · 2 yrs 9 mos · London, England, United Kingdom · Hybrid

Led and built the AWS Security Data Library, establishing it as the authoritative source of security data
for AWS.

Python (Programming Language)Extract, Transform, Load (ETL)Data AnalysisAirflowAmazon Web Services (AWS)Avro+3

Data Engineer

Feb 2020 – Apr 2022 · 2 yrs 2 mos

1. Lead cross-functional data top initiative to drive metric consistency across LinkedIn implementing KonMari datasets and achieved 89% metric consistency in customer facing LSS metrics and over 50 internal metrics.
2. Solved major challenge of code duplication for KonMari Single implementations (~10 datasets) with common dimensional code design that encapsulated all required seat level dimensions in a common Scala class file
3. Achieved SLA gains (up to 50%) due to leaner implementation, spark configuration tuning, use of cache and broadcasting smaller datasets.

Python (Programming Language)Extract, Transform, Load (ETL)Data AnalysisAirflowAmazon Web Services (AWS)Avro+3

Walmart labs india

Software development engineer III

Jul 2019 – Jan 2020 · 6 mos · Bengaluru, Karnataka, India

"Next-Gen PPA - Payments data platform" - Developing a cloud-based centralized data solution for multi-sourced financial data, with the capability of workflow orchestration (Azure Data Factory), data transformations (Apache Spark) and scheduling. The platform is based on reactive microservices architecture leveraging Functional Programming in Scala.

Python (Programming Language)Extract, Transform, Load (ETL)Data AnalysisAirflowAmazon Web Services (AWS)Avro+4

Sap

2 roles

Senior Software Developer

Promoted

Oct 2018 – Jun 2019 · 8 mos

Worked on NextGen Patient Management Solution in Healthcare domain. Using standard FHIR protocol developed REST APIs for accounting, inpatient and outpatient scenarios where the hospitals(SAAS) would have a subscription to our PAAS model while onboarding.

AvroHealthcare