Nipun Vats

Data Engineer

Netherlands10 yrs 11 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

5 years of experience in Big Data and Machine Learning.
Expert in real-time data processing with Apache Kafka and Spark.
Proficient in building data lakes and automated reconciliation systems.

Stackforce AI infers this person is a Big Data and Machine Learning expert with strong engineering capabilities.

Contact

Skills

Core Skills

Big DataData EngineeringMachine Learning

Other Skills

Apache KafkaApache NiFiApache SparkCassandraData analytics platformDeep LearningElastic Stack (ELK)HadoopJavaReal Time Response SystemScalaautomated end-to-end account reconciliationcluster computing frameworksdata ingestiondata lake

About

Proficient Software Engineer with 5 years of work experience in Big Data and Machine Learning tools. Strong engineering professional with an Engineering degree from Birla Institute of Technology and Science, Pilani, India. Tools I like to work with- • Apache Kafka & Apache Spark for real time processing on big data. • Hive/HDFS/Presto/Hudi to process/query the Big data. • PyTorch for machine learning techniques. • NoSql(Ignite, Cassandra) database for storing and querying data. • ELK stack & Grafana for creating live dashboards .

Experience

Uber

3 roles

Data Engineer - 2

Oct 2024 – Present · 1 yr 5 mos

Data Engineer - 2

Feb 2023 – Oct 2024 · 1 yr 8 mos

Data Engineer

Sep 2021 – Mar 2023 · 1 yr 6 mos

Expedia group

Big data SDE-2

Dec 2020 – Sep 2021 · 9 mos

Jio

2 roles

Big Data Engineer

Jul 2019 – Dec 2020 · 1 yr 5 mos · Greater Bengaluru Area

Data analytics platform - Building data lake which involves data ingestion and data management/ manipulation on PetaBytes of Data using various cluster computing frameworks, distributed streaming platforms and databases.
Campaign management system - Developed and executed real time campaigns.
Reconciliation - Worked on automated end-to-end account reconciliation.
Offers Engine - Restructuring data for analysis and visualisation.

Data analytics platformdata lakedata ingestiondata managementcluster computing frameworksdistributed streaming platforms+7

Big Data Intern

Jul 2018 – Dec 2018 · 5 mos · Bengaluru, Karnataka, India

Worked on time series data in Real Time Response System (RTRS).
Outlier detection - Worked on time series data to flag out the anomalous points and send alerts regarding the same using various machine learning techniques.
Active Dashboards - Created dynamic dashboards to monitor/visualise data and take actions when detecting anomalous behaviour.

time series dataReal Time Response Systemoutlier detectionmachine learning techniquesdynamic dashboardsMachine Learning+1