Lahu Bhawar

Data Engineer

Pune, Maharashtra, India10 yrs 10 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

10 years of experience in Data Engineering.
Expert in building scalable data processing pipelines.
Proficient in Google Cloud Platform and Oracle Cloud services.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech sectors.

Contact

Skills

Core Skills

Data EngineeringCloud Computing

Other Skills

AI Software DevelopmentAnsibleApache AirflowApache KafkaArtificial Intelligence (AI)BMC Control-MBig DataBigqueryCloud composerCloud functionCloud storageControl-MData AnalysisData ArchitectsData Architecture

About

10 years of experience in Data Engineering. I have worked on Google Cloud Platform (GCP), Cloud storage, Cloud pub sub, cloud function, BigQuery, Python, Apache Airflow, Apache Beam, SQL, ETL , Oracle Cloud, Apache Spark, DeltaLake, Dbt, Kafka, Databrics, and Datawarehouse.

Experience

10 yrs 10 mos

Total Experience

2 yrs 8 mos

Average Tenure

3 yrs 6 mos

Current Experience

Qualys

Senior Data Engineer

Dec 2022 – Present · 3 yrs 6 mos · Pune, Maharashtra, India · On-site

Working on design and development of lake house for machine learning training and exploratory analysis.
Developing infrastructure for data processing and storage for log data generated by various qualys applications such EDR, Malware detection, VMDR etc.
Developing lake house and ML data processing infrastructure using OCI( Oracle Cloud) services such as Object storage, cloud function, OCI dataflow, Pyspark, Event service, Elastic search, Parquet, DeltaLake etc.

OCIObject storageCloud functionOCI dataflowPysparkEvent service+5

Intersoft data labs

Senior Data Engineer

Apr 2021 – Dec 2022 · 1 yr 8 mos · Gurugram, Haryana, India · Remote

Worked on creating end to end data processing pipeline on Google Cloud using Bigquery, cloud storage, Google Dataplex and cloud composer.
We have setup automated dynamic pipeline to extract , transform and data quality check on the data.
Create and maintain Dbt models.

BigqueryCloud storageGoogle DataplexCloud composerDbtData Engineering+1

Capgemini

Data Engineer

Nov 2019 – Apr 2021 · 1 yr 5 mos · Pune/Pimpri-Chinchwad Area · On-site

Design and develop data intensive application on Google Cloud.
Design highly scalable batch and streaming data processing pipeline using Bigquery, dataflow(Apache Beam), Google Cloud Pub Sub and cloud storage

BigqueryDataflowGoogle Cloud Pub SubCloud storageData EngineeringCloud Computing

Bitwise inc

Data Engineer

Jul 2015 – Oct 2019 · 4 yrs 3 mos · Pune/Pimpri-Chinchwad Area · On-site

Building and Maintaining the data pipelines on on-premises as well as on Google Cloud Platform.
Extensively worked on Google BigQuery , Apache Airflow, Control-M and Netezza.
Worked on credit card transactions data, worked on data security techniques while moving data to cloud storage.
Worked on LOTR ( Life Cycle of Transaction) - to show 360 degree view of the transaction to merchant to track and reconcile there transaction’s. We have developed this application completely on Google Cloud using Dataflow, Bigquery, cloud storage and Apache airflow.

Google BigQueryApache AirflowControl-MNetezzaData EngineeringCloud Computing