Subrat Kumar ๐ฎ๐ณ โ DevOps Engineer
CCA Spark and Hadoop Developer | AWS Cloud | Spark | Hadoop | Python | Java 8 | JEE | Airflow | Hive | LinuxData Engineering professional having 10 years of experience in Python, Java for Spark & Hadoop Big Data Applications with Hadoop ecosystem (like HDFS, Hive, Sqoop, Apache Airflow, Oozie, MapReduce etc) and Java for Java/JEE Enterprise Applications.Having knowledge on real time processing technologies like Spark Streaming, Kafka and Interactive SQL tool on Hadoop like Impala.Extensive experience in designing, developing and monitoring of Spark, Hadoop based applications on Windows, UNIX and Linux platforms.Experienced on major components of Hadoop Ecosystem including HDFS, Map-Reduce, Hive, Pig, SQOOP, Yarn, NoSQL Database like HBase and its Integration with other components.Extensive knowledge and experience on data pipeline tools like Apache Airflow and Oozie along with their Integration.Experienced in designing, developing and automating ETL processes, Batch processes on Hadoop Ecosystem and handling variety of data using the right Hadoop components on different Hadoop distributions like MapR, Hortonworks and Cloudera.Designed and Built Data Extraction / Ingestion, Quality, Aggregation / Provisioning framework using Sqoop, Flume, Kafka, Spark, MapReduce, Hive.Experienced in Java/JEE/JDBC/Servlets/JSP, Spring, Struts, Hibernate, REST Web Services and excellent hold on query language like SQL/PLSQL.Experienced in Software architecture, design, development where I performed spectrum of roles during encompassing entire Software Development Life Cycle.Strong analytical and reasoning skills with extensive working experience in data structures, algorithm, design patterns etc.Strong engineering professional with a Master's degree in AI and Bachelor's degree focused in Computer Science & Engineering.
Stackforce AI infers this person is a Data Engineering and Big Data specialist with a strong focus on machine learning applications.
Location: Bengaluru, Karnataka, India
Experience: 12 yrs
Skills
- Data Engineering
- Machine Learning
- Big Data
- Software Development
- Java
- Embedded Systems
- Robotics
Career Highlights
- 10 years of experience in Data Engineering and Big Data.
- Expert in building scalable data pipelines and machine learning systems.
- Strong background in both software development and data analytics.
Work Experience
ConcertAI
Lead Data Engineer (2 yrs 7 mos)
Senior Data Engineer (2 yrs)
IBM
Data Engineer: Big Data (2 yrs 2 mos)
ITC Infotech
Associate IT Consultant - Software Engineering (3 yrs 1 mo)
UST Global
Software Developer (10 mos)
Scala
Software Engineer R&D (1 yr 4 mos)
ROBOSAPIENS TECHNOLOGIES Pvt. Ltd.
Research Engineer (5 mos)
Education
Master of Technology - MTech at Birla Institute of Technology and Science, Pilani
PG Level Diploma Degree (DAI & ML) at University of Hyderabad
Bachelor of Technology - BTech at The ICFAI University, Dehradun