Rahul Paul

Software Engineer

Bengaluru, Karnataka, India10 yrs 9 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in Big Data Engineering and Hadoop Ecosystem.
Proven track record in machine learning application development.
Strong experience in managing Hadoop clusters with high uptime.

Stackforce AI infers this person is a Big Data Engineer specializing in Fintech and Infrastructure.

Contact

Skills

Core Skills

Big Data EngineeringData ModelingHadoop Administration

Other Skills

Apache KafkaApache PigApache SparkApache ZooKeeperCCloudera ImpalaCloudera ManagerCloudera distributed Hadoop Cluster ManagementData StructuresData analysisData pipelineData validationDatabase managementDistributed SystemsFeature Engineering

About

Experienced Big Data Engineer with a demonstrated history of working in the Banking and Retail industry. Skilled in Big Data Engineering, Data modeling, Hadoop development and administration. Have strong skill in programming. Strong information technology professional with a Bachelor's Degree in Computer Science & Engineering from Jadavpur University.

Experience

Walmart global tech india

3 roles

Staff Software Engineer

Nov 2024 – Present · 1 yr 4 mos

Data & ML Engineer ( Senior SDE ) at Walmart Labs India

Oct 2021 – Nov 2024 · 3 yrs 1 mo

Data & ML Engineer ( SDE 3 )

Jun 2020 – Nov 2021 · 1 yr 5 mos

Target

Senior Big Data Engineer

Feb 2018 – Jun 2020 · 2 yrs 4 mos · Greater Bengaluru Area

Working as a Sr. Big Data Engineer.
o Build Data pipeline for the machine learning application.
o Design Data modeling for large scale machine learning application
o Design architecture and data flow for a large-scale machine learning application.
o Migrate traditional machine learning model to large scale distributed system.
o Data analysis and statistical reporting for the machine learning Model.
o Feature Engineering, Data validation and imputation.
o Build data validation and other tools to Help Data Scientists and Data analyst in their day to day task.
o Detailed end to end knowledge about Hadoop Ecosystem tools like Hive, Sqoop, HDFS, YARN, MR, Spark, Oozie, HBASE
o Proficient in pySpark. Also having decent knowledge on scala for spark.

HadoopData modelingData pipelineMachine learningData analysisFeature Engineering+5

Visa

Hadoop Platform Engineer

Jul 2015 – Feb 2018 · 2 yrs 7 mos · Bangalore

2+ Years of IT experience.
o Basic Abinitio for ETL.
o Strong knowledge on all Hadoop Ecosystem tools including HBASE, Spark, Kafka.
o Part of Hadoop Platform team for Managing Infrastructure of Hadoop Clusters.
o Core member of the team giving 99.99% uptime for Hadoop cluster.
o Got 2 month of Work Experience in USA on Hadoop Administration due to business requirement.
o Tuning and optimization of production jobs. Also working with development team in developing application.
o Proactive action and tuning to avoid production issues.
o Strong knowledge on python and shell scripting.
o Automation using Python and shell scripting.
o POC for Apple Pay HBASE Infrastructure.
o SME of HBASE infrastructure for Apple Pay, Android Pay cluster giving 100% uptime for the cluster.
o Strong Experience and Knowledge on Cloudera Manager.
o Leading meeting and bridges to solve production issues.
o Working Actively with Cloudera Support.
o Second POC for SOLR.
o Core part of the team Installing and Expanding Hadoop cluster horizontally.
o Tuning and optimization of Hadoop clusters for Better performance.
o POC for all new HBASE infrastructure.
o Second POC for all Spark and Kafka clusters.