K

Kapil Paliwal

Data Engineer

Bengaluru, Karnataka, India11 yrs 8 mos experience

Key Highlights

  • Expert in Data Engineering and Apache Spark.
  • Developed Big Data Ready Enterprise for efficient metadata management.
  • Proficient in multiple programming languages and technologies.
Stackforce AI infers this person is a Data Engineering expert with a focus on Big Data technologies.

Contact

Skills

Core Skills

Data EngineeringApache Spark

Other Skills

Amazon Web Services (AWS)Apache KafkaApache OozieApache PigCore JavaDatabasesElasticsearchExtractGitHBaseHadoopHiveJavaJavaScriptJenkins

About

I have developed Big Data Ready Enterprise. This is open source with apache license. I worked on JAVA, MySQL, Oracle 11 g,JavaScript(Jquery,Spring,Bootstrap, jquery,angular.js) , Hadoop (MApReduce,Hive,Oozie, Flume,Sqoop), Jenkins, Amazon Web Services. In this we are developing an accelerator to simplify the work of a bigdata developer. Our basic goal is efficient metadata management which helps in controlling all process running on whole cluster. This whole project is very decoupled, so you can remove any part and replace it with any relevant technology you are using for that purpose.

Experience

Jumpcloud

Senior Data Engineer

Apr 2025Present · 11 mos · Remote

Lineaje inc

Senior Staff Engineer

Feb 2024Apr 2025 · 1 yr 2 mos · Remote

Skyhigh security

Senior Software Engineer

Mar 2022Apr 2024 · 2 yrs 1 mo

Spring BootScalaPostgreSQLSqoopSQLApache Oozie+12

Mcafee software (india) private limited

Engineer III

Feb 2018Mar 2022 · 4 yrs 1 mo · bangalore

Spring BootScalaPostgreSQLSqoopSQLApache Oozie+11

Skyhigh networks

Engineer I

Sep 2017Jan 2018 · 4 mos · Bengaluru Area, India

Spring BootScalaPostgreSQLSqoopSQLApache Oozie+11

Wipro

project engineer

Jul 2014Sep 2017 · 3 yrs 2 mos · Bengaluru Area, India

  • Working in a team as developer and writing some exciting codes on various platforms like mysql,java,jquery,javascript,mapreduce,hive,python. Withinn short time got lots of experience of various technologies.
Spring BootSqoopSQLGitApache OozieMaven+6

Education

Indian Institute of Technology (Banaras Hindu University), Varanasi

Bachelor of Technology (B.Tech.) — Mining Engineering

Jan 2010Jan 2014

Adarsha Vidya Mandir, Keshav Parisar, jodhpur, Rajasthan

Jan 1996Jan 2009

Stackforce found 100+ more professionals with Data Engineering & Apache Spark

Explore similar profiles based on matching skills and experience