Ashish Kainth

Associate Consultant

Gurugram, Haryana, India8 yrs experience

Most Likely To SwitchHighly Stable

Key Highlights

7 years of experience in Big Data technologies.
Expert in Hadoop ecosystem and Spark applications.
Proficient in data ingestion and processing frameworks.

Stackforce AI infers this person is a Big Data Engineer with expertise in data processing and ingestion frameworks.

Contact

Skills

Core Skills

HadoopSparkEtlData Migration

Other Skills

HiveScalaOOZIETableauHQLApache SparkHDFSShell ScriptingData WarehousingExtractTransformLoad (ETL)SQLUnixInformatica

About

I am having overall 7 years of experience in IT Industry including as Hadoop developer in Big Data technologies mainly in Core Hadoop, Spark, Hive and Scala. Good Hands on experience in Hadoop Ecosystem and its major components. Improvising the tuning options using HIVE functions such as Partitioning, Bucketing, and Index. Worked with various HDFS file formats like parquet files, json, text files and various compression format like snappy. Developed scripts using shell script for validating the data. I am currently looking for new opportunity in Big Data.

Experience

Deloitte

2 roles

Senior Consultant

May 2023 – Present · 2 yrs 10 mos

Consultant

Sep 2021 – May 2023 · 1 yr 8 mos

Iqvia

Data Engineer

Dec 2020 – Sep 2021 · 9 mos

Tata consultancy services

3 roles

Hadoop Developer

Aug 2019 – Dec 2020 · 1 yr 4 mos

This project is regarding processing the raw data file by using spark application and then ingested the processed file from HDFS to Hive table and later files are generated as extracts using HIVE QL and sent to downstream. The Spark application code is developed using Scala in a Generic Extraction Framework (GEF)model, which processes data by referring the parameters in property file.

SparkHadoopHiveScala

Big Data Developer

Feb 2019 – Dec 2020 · 1 yr 10 mos

File to Hadoop ingestion:- In OneHadoop we developed a framework to ingest data from multiple sources DB2, Oracle, SQLServer, Teradata, Flat Files, Cassandra. Initially it was all written as single application. Due to increase in sources for analytical discovery, we developed a Common Ingestion Framework which connects the data sources and ingest the data into hadoop after validation for analytical purpose. Framework is developed in such a way that it handle sources like, JSON, RDBMS, Flat file and NoSQL like Cassandra.
After data ingested into hadoop, it is visualized by Tableau team
Responsibilities:-
Wrote core business logic or transforming data and ingesting data through OOZIE Workflows.
Developed hive queries as per business requirement to fetch data from different sources to pull required data as part of Table to table load and sending data to downstream after loading table data into text file.
Autosys scheduling to run the framework with required frequency (daily/weekly/monthly/quarterly) to handle various data ingestion.

HadoopOOZIEHiveTableauETL

Big Data Developer

Mar 2018 – Feb 2019 · 11 mos

Erica- A virtual voice assistant that makes keeping up on finances easy.SORS data that would provide the Customer events and relationship information with the Bank in a Hadoop as a service cluster service to the different LOB. Data from different sources needs to be moved from the Hadoop landing zone to external tables in Hive in a structured format and later files are generated as extracts using HIVE QL and sent to downstream
Data also needs to ingested from the RDBMS platform to a data lake where different LOB data reside in a single centralized zone
Responsibilities:-Migration of existing platform to a common centralized platform(HaaS)Hadoop as a service
Migration of existing platform to a common centralized platform(HaaS)Hadoop as a service
Develop Hive Query Language(HQL) for the extracts generation for downstream
Create new DDLs and make modifications for the new installs according to the requirement in
the existing framework

HadoopHiveHQLData Migration