Hariom S.

Data Engineer

Canada7 yrs experience

Highly Stable

Key Highlights

8 years of experience in large-scale data processing solutions.
Expert in cloud migration and data engineering.
Proficient in multiple cloud platforms including AWS and Azure.

Stackforce AI infers this person is a Data Engineering expert in Fintech and Cloud Computing.

Contact

Skills

Core Skills

Cloud MigrationData EngineeringBig Data AnalyticsData Analysis

Other Skills

AWS Cloud MigrationAWS GlueAWS LambdaAWS Step FunctionsAirflowAmazon CloudWatchAmazon EKSAmazon KinesisAmazon RedshiftAmazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)Apache AirflowApache FlinkApache Spark

About

8 years of experience in implementing large-scale data processing solutions for Retail & Finance Currently working as a Senior Associate at Publicis Sapient, developing data models, ETL solutions and data Warehouses for business insights. Area of expertise: Big Data Ecosystem: Spark (Core & SQL), PySpark, HIVE, Hadoop, Data Analytics, Data Modelling, SQL Server, Python, Scala, Airflow, Shell Scripting Cloud: Azure (Databricks, Azure Data Factory, Datalake, Synapse, Blob), AWS (S3, Glue, Athena, RDS, EC2, EMR, Lambda, Redshift, DynamoDB), GCP (BigQuery, Cloud SQL, Bigtable, Dataproc) File format ( csv, json, parquet, avro, delta, txt, gzip ) Familiar Skills: Strutured streaming, Kafka, DBT, Scala

Experience

7 yrs

Total Experience

2 yrs 4 mos

Average Tenure

Current Experience

Publicis sapient

Senior associate L2

Oct 2023 – Apr 2025 · 1 yr 6 mos · Toronto, Ontario, Canada · Remote

Worked on Cloud migration for on-prem application to azure cloud for financial services (RBC)

GlueAWS Cloud MigrationFinancial ServicesContinuous Integration (CI)ArtifactoryJenkins+37

Pwc acceleration centers

2 roles

Senior Associate

Promoted

Jul 2022 – Sep 2023 · 1 yr 2 mos

Working on developing ETL pipelines using ADF, Azure Synapse, Azure Databricks, Pyspark, Python and SQL

GitFinancial ServicesContinuous Integration (CI)Query WritingAmazon KinesisCloud Migration+18

Associate 2

Apr 2021 – Jun 2022 · 1 yr 2 mos

Spearheaded the development of a cutting-edge streaming platform leveraging AWS technologies and Python on Kubernetes.

GitAmazon EKSFinancial ServicesAWS Step FunctionsQuery WritingScheduling Tools+23

Envestnet | yodlee india

4 roles

Senior Data Engineer

Promoted

Feb 2021 – Mar 2021 · 1 mo

Worked on developing NPI and PII project for public information nullification
developed end-to-end data pipeline for batch process for spark jobs

GitAWS Cloud MigrationScalaBig Data AnalyticsETL ToolsQuery Writing+33

Data Engineer

Aug 2019 – Jan 2021 · 1 yr 5 mos

Worked on redesigning of legacy systems to achieve 90% performance improvement
Designed Hive tables by applying partitions and bucketing techniques and developed Hive queries for analysis
Used SQOOP to transfer data from RDBMS tables to Hive tables
Created custom SQL queries for data analysis/analytics over Redshift and Hive
Skills Used: Hive, SQL queries, SQOOP, HDFS commands, SQL

GitGlueQuery WritingAutomationScheduling ToolsSQL Database Administration+12