Vikas kumar

Data Engineer

Haryana, India4 yrs 9 mos experience

Key Highlights

Proficient in Hadoop and Spark for big data applications.
Experienced in Google Cloud Platform for data processing.
Strong SQL skills with expertise in data management.

Stackforce AI infers this person is a Big Data Engineer with expertise in cloud solutions and data processing.

Contact

Skills

Core Skills

HadoopApache SparkGoogle Cloud Platform (gcp)Bigquery

Other Skills

Apache AirflowBig Data AnalyticsCloud FunctionCloud SchedulerCloud StorageCore JavaData Build Tool (DBT)Data FlowData ModelingData QualityData StructuresData catalogDatabricksExtract, Transform, Load (ETL)GitHub

About

• Experience in design and development of applications using Hadoop and its ecosystem components like Hadoop, Hive, Spark, Sqoop, and HBase. • Experience in design and development of applications using Google Cloud Platform (GCP) and its components like Data Flow, BigQuery, Cloud Function, Cloud Storage, and Cloud Scheduler. • Capable of processing sets of structured, Semi-Structured and Streaming data. • Experience in importing and exporting data using Sqoop from RDBMS to HDFS and vice-versa. • Good understanding building the applications using Spark Core, Spark SQL, and Data Frames. • Experience on Complex data processing and Generating Complex data. • I have a strong understanding of SQL and database management.. • Worked with various file formats like JSON, Parquet, AVRO, CSV and XML. • Developed HiveQL queries, Managed tables, external tables in hive. • Good understanding in Linux , Hadoop and Shell Scripting commands.