Waqar Shahbaz

AI Researcher

Riyadh, Saudi Arabia8 yrs 1 mo experience

Most Likely To Switch

Key Highlights

8+ years of experience in data engineering.
Expert in building data warehouses and ETL processes.
Strong communicator bridging technical and business needs.

Stackforce AI infers this person is a Data Engineering expert with a focus on Healthcare and Enterprise solutions.

Contact

Skills

Core Skills

Data EngineeringEtl

Other Skills

Apache NifiMSSQLDBTPower BIMachine LearningData ExtractionAWS RedshiftAWS GLUEAWS DMSAWS AthenaData WarehousingData ModelingTalendGreenplumData Integration

About

I am a Senior Data Engineer with 8+ years of experience designing and optimizing end-to-end data solutions across healthcare, telecom, and enterprise domains. My career journey has been driven by a strong passion for solving complex data challenges and enabling organizations to make data-driven decisions with confidence. ⚙️ Tech Stack & Tools I Work With Databases: MSSQL, PostgreSQL, PostgreSQL (Greenplum), MySQL, Impala ETL & Data Integration: Apache NiFi, Talend, Pentaho, SSIS Data Transformation & Processing: Python, DBT, DBT Spark, Apache Spark Workflow Orchestration: Apache Airflow Cloud (AWS): Redshift, Athena, S3, GLUE, RDS, DMS, Data Lake Formation, CloudWatch, SNS Visualization & Analytics Enablement: Power BI ✨ What Sets Me Apart A problem-solver at heart: I enjoy digging deep into data challenges and finding efficient, scalable solutions. Strong communicator: I bridge the gap between technical complexity and business needs, ensuring clarity at all levels. Lifelong learner: I constantly explore new tools and technologies to stay ahead in the rapidly evolving data landscape. 🚀 I am passionate about driving innovation through data and excited to connect with professionals, organizations, and teams who share the vision of unlocking business value through smart data engineering.

Experience

8 yrs 1 mo

Total Experience

1 yr 2 mos

Average Tenure

2 yrs 5 mos

Current Experience

Confidential government

Senior Big Data Consultant

Dec 2023 – Present · 2 yrs 5 mos · Riyadh, Saudi Arabia · On-site

Senior Data Engineer, Lean Business Services, KSA (Riyadh)
Extracting data on request of health care providers and Ministry of Health, KSA, to derive insights
that will be useful for critical decisions.
I have optimized the data extraction pipeline on Apache Nifi by optimizing the SQL stored
procedure on MSSQL. This optimization resulted in less time consumption and resource
utilizations.
I have worked on building data warehouse for Ministry of Health using DBT that will eventual
help us build PowerBI dashboards and algorithm for Machine Learning to derive business
decisions and insights.
I have created a complete pipeline on Python to optimize the reports extraction and sharing
process to MOH.
Contributed to an ETL project focused on migrating data from diverse source systems to a data
lake using Apache Spark.

Data EngineeringApache NifiMSSQLDBTPower BIMachine Learning+1

Strategic systems international

Senior Data Engineer

May 2022 – Nov 2023 · 1 yr 6 mos · Pakistan

Engaged in diverse projects centered around ETL and data integration, showcasing versatility and expertise in navigating varied technical landscapes.
Currently spearheading a pivotal project focused on developing a Data Warehouse from inception on AWS Redshift. This involves extracting data from diverse sources such as Postgres (a relational database), client's raw email data, various lookup CSVs, and more. The process includes meticulous data modeling to uphold data integrity, with the final output loaded onto the AWS Redshift data warehouse utilizing AWS GLUE and AWS DMS.
Proficiently compose and execute queries on AWS Athena to validate the integrity of the AWS Redshift Data Warehouse.
Collaborating seamlessly with offshore teams, providing insights into the intricacies of the AWS stack and optimizing data performance.
Taking a proactive role in enhancing data warehouse performance through strategic data modeling and leveraging AWS Data Lake Formation.
Leveraging expertise to create insightful PowerBI reports over the AWS Redshift data warehouse, ensuring stakeholders have actionable and clear data-driven insights.

AWS RedshiftAWS GLUEAWS DMSAWS AthenaData WarehousingPower BI+2

Afiniti

Data Engineer

Feb 2021 – May 2022 · 1 yr 3 mos · Lahore, Punjab, Pakistan

Served as a Data Engineer for a prominent French telecom giant. Directed daily data loading processes, adeptly transforming data in accordance with AI team specifications, and orchestrating migration to the Greenplum data warehouse via Talend (Data Integration).
Pioneered the development of a sophisticated alert system using Talend (Data Integration). This system systematically compares AI modeling data in production with corresponding data in AI tables, ensuring optimal routing efficiency for Afiniti at the client level. The successful implementation of this alert system has been extended to other clients.
Collaborated with the French CDS team and other subject-matter experts to conduct thorough data analysis. Ensured the integrity of call center data and streamlined processes related to customer sales and retention.
Addressed challenges related to complex data transformation queries in Talend, which consumed substantial RAM and time. Devised and implemented an efficient Python script to execute these queries, significantly reducing processing time and enhancing overall efficiency.

TalendGreenplumData IntegrationData AnalysisData EngineeringETL

Curemd

2 roles

Lead ETL Engineer

Promoted

Mar 2020 – Feb 2021 · 11 mos

Conducted comprehensive source system analysis across diverse data sources including MySQL, SQL Server, PostgreSQL, Oracle databases, CSV, XML, JSON, and various data formats. Proficiently transformed healthcare data by developing and managing intricate source-to-target mappings.
Spearheaded the development of a streamlined data migration process within the same MS SQL Server database structure through dynamic Stored Procedures. This critical initiative on healthcare data demanded meticulous attention to detail for maintaining referential integrity.
Innovatively implemented a data extraction process using SSIS, automating a previously manual process of running queries and copying data to Excel. This automation significantly reduced time and effort, enhancing overall efficiency.
Leveraged SQL Server Management Studio to craft optimized queries, Stored Procedures, and Dynamic scripts for seamless migrations on OLTP servers. Proactively addressed customized client requests, ensuring client satisfaction.
Steered the ETL team as a lead, orchestrating efficient data migrations and fostering a collaborative and productive team environment.

SQL ServerSSISData MigrationStored ProceduresETL

ETL Engineer

Aug 2019 – Mar 2020 · 7 mos

Conducted comprehensive source system analysis across diverse data sources including MySQL, SQL Server, PostgreSQL, Oracle databases, CSV, XML, JSON, and various data formats. Proficiently transformed healthcare data by developing and managing intricate source-to-target mappings.
Spearheaded the development of a streamlined data migration process within the same MS SQL Server database structure through dynamic Stored Procedures. This critical initiative on healthcare data demanded meticulous attention to detail for maintaining referential integrity.
Innovatively implemented a data extraction process using SSIS, automating a previously manual process of running queries and copying data to Excel. This automation significantly reduced time and effort, enhancing overall efficiency.
Leveraged SQL Server Management Studio to craft optimized queries, Stored Procedures, and Dynamic scripts for seamless migrations on OLTP servers. Proactively addressed customized client requests, ensuring client satisfaction.

PentahoData IntegrationETL DocumentationETL

Kavtech solutions (private) ltd.

ETL Engineer

Aug 2018 – Aug 2019 · 1 yr · Pakistan

A real estate company based in California, USA providing complete marketing platform that leverages the latest technological innovations to help our clients generate new customers, mature their existing prospects, manage their team, and promote, advertise, and build their brand.
Kavtech Solutions is providing complete end-to-end business solution including API development, designing click stream Data Warehouse, development of ETL Mappings and providing a comprehensive Business Intelligence framework.
Responsibilities: My responsibilities include ETL Optimization, development of new ETL Mappings using Pentaho Data Integration and ETL Documentation.
Tools & Technologies: Pentaho Data Integration, Tableau, PostgreSQL, Working with REST API
Orchestrated end-to-end ETL mapping on Pentaho (Data Integration), seamlessly downloading real estate data from REST MLS API in JSON format. Executed meticulous parsing and transformation processes before orchestrating the migration to the destination data warehouse on PostgreSQL.
Innovatively crafted and implemented an ETL flow to upload videos on popular social media platforms such as Facebook and YouTube. This involved integrating their respective APIs through Pentaho, ensuring a smooth and automated process for efficient content dissemination.
Engineered a specialized ETL flow to optimize addresses within listings using the Google Address API. This involved designing and implementing a seamless process for enhancing the accuracy and precision of address information in the data.