M

Manoj Kumar

Software Engineer

Bengaluru, Karnataka, India17 yrs 6 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in Big Data and Distributed Systems.
  • Developed automated frameworks for Hadoop/Spark optimization.
  • Led teams in high-impact data analytics projects.
Stackforce AI infers this person is a Big Data Engineer with expertise in data analytics and distributed systems.

Contact

Skills

Core Skills

Big DataDistributed SystemsHadoopEtlData Analytics

Other Skills

Data StructuresJavaAlgorithmsCSoftware DevelopmentLinuxBig Data AnalyticsCascadingSQLMySQLShell ScriptingCore JavaAgile MethodologiesUnixEclipse

About

Data at Scale

Experience

17 yrs 6 mos
Total Experience
4 yrs 4 mos
Average Tenure
10 yrs 7 mos
Current Experience

Linkedin

3 roles

Staff Software Engineer

Promoted

Oct 2021Present · 4 yrs 8 mos

Distributed SystemsData StructuresJavaAlgorithmsHadoopC+27

Senior Data Engineer

Jan 2020Oct 2021 · 1 yr 9 mos

Senior Software Engineer

Nov 2015Dec 2020 · 5 yrs 1 mo

  • Apache Hadoop Contributor
  • Hadoop/Spark Auto Tuning: Built an automated framework for tuning Hadoop/Spark jobs using particle swarm optimization (PSO) algorithm. This is an automated iterative way of tuning a job and require 3-5 executions to come up with optimal parameters. Tuning is done during regular scheduled executions of the job. This framework is part of Dr. Elephant open source project. Worked on integrating Azkaban plugin for Pig and Spark in open source with Auto Tuning framework. Presented this work in Spark + AI Conference, Strata Data Conference 2018 and Pune Data Conference in 2018 .
  • Worked on projects like TD-Hive query conversion, disaster recovery system, complex ETL report etc. (Teradata, Informatica, Hadoop, Presto, Hive, Spark etc.)
HadoopSparkETLApache HadoopInformaticaPresto+2

Pubmatic

2 roles

Tech Lead

Apr 2015Nov 2015 · 7 mos

  • Lead a team of 7-8 engineers to work on data analytics application. (Hadoop, Map Reduce, Hive, Cascading, Hbase, Apache Phoenix)
HadoopMap ReduceHiveCascadingHbaseApache Phoenix+2

Senior Software Engineer

Aug 2011Mar 2015 · 3 yrs 7 mos

  • Design and develop data analytic platform involving work on Hadoop, Map Reduce, Hive, Pig, Cascading, HBase, Apache Phoenix etc.
HadoopMap ReduceHivePigCascadingHBase+3

Amazon

Software Development Engineer

Apr 2010Aug 2011 · 1 yr 4 mos

  • Design and develop FOS service which has an SLA of 200ms (tp99.9).

Pubmatic

Software Development Engineer

Oct 2008Mar 2010 · 1 yr 5 mos

  • Services, Web Wrappers, Scripting

Education

Indian Institute of Technology, Bombay

MTech — Computer Science

Jan 2006Jan 2008

University of Rajasthan

BE — Information Technology

Jan 2002Jan 2006

Govt Senior Secondary School, Barmer

Science

Jan 2000Jan 2002

Stackforce found 100+ more professionals with Big Data & Distributed Systems

Explore similar profiles based on matching skills and experience