P

Pradeep Kumar

AI Researcher

Delhi, India7 yrs 2 mos experience
Highly Stable

Key Highlights

  • Over 8 years of experience in Data Engineering.
  • Proficient in Big Data tools and AWS services.
  • Strong background in software development and team leadership.
Stackforce AI infers this person is a Big Data Engineer with expertise in cloud-based data solutions.

Contact

Skills

Core Skills

Big Data ToolsData EngineeringBig Data EngineeringHadoop EcosystemSoftware Development

Other Skills

AWSAmazon S3AnalysisApache KafkaApache SparkBig DataBigDataCloudera ImpalaCloudera ManagerDevelopmentEC2EMRETLHBaseHadoop

About

100 Months of Experience in Data Engineering domain. Worked on AWS Based Infrastructure and On-Prem eco system like Yarn , Spark, Map Reduce, Hive, Sqoop, Spark,Spark Streaming, Kafka, Impala, Presto, Python, Kubernetes, Unix shell scripting. DBT with Snowflake . Data Structure & Algorithm | Hadoop | Apache Spark | Python | Sqoop | Hive | UNIX Shell Scripting | AWS | Amazon S3 | EMR| AWS LAMDA | CLOUDWATCH | EC2 | Athena | Data Bricks | Apache Kafka | Streaming | SQL | SSRS | SSIS | SQL server | Postgress | Informatica| ETL | DATA WAREHOUSING Currently working in Big Data Tech Stack writing Spark code & Hive scripts & Sqoop & Kafka. I have hands on experience in development of jobs which comprises writing bash shell scripts, HQL,dealing with HDFS & AWS(S3,EMR,EC2). Proficient with all aspects of software development, right from Requirement Analysis, Database Design, Application Development, Debugging, Testing and Documentation. Experience holder in leading small team, taking ownership and working with Business Teams & End Stake holders. Specialities: • Big Data Tools : Spark, HDFS, Hive ,Sqoop , Kafka, Presto ,Impala, Pyspark , DBT, Airflow • Data Warehouse and Data Modelling. • Languages : Python , Shell Script. • Database : MS SQL ,Postgres, Mysql , SAP Hana, Mongo DB , Snowflake. • AWS Service : S3, Lambda, EMR, Glue, Cloudwatch, Redshift, SNS, Athena). • Tools : Intellij,Spyder,DBeaver,Zeeplin, Notebook, Git,SVN, Jenkins, TOAD, Jira ,Confluence . * Good in Data Structures & Algorithm fundamentals

Experience

Vmware

Senior Data Engineer

Apr 2021Nov 2022 · 1 yr 7 mos · Bengaluru, Karnataka, India

Iris software inc.

Sr Data Engineer

Apr 2020Apr 2021 · 1 yr · Noida

  • BigData | Hadoop | Apache Spark | Python | Scala | Kubernetes | Hive | UNIX Shell Scripting | AWS | Amazon S3 | EMR | EC2 | Apache Kafka | Streaming | SQL | SSRS | SSIS | SQL server
BigDataHadoopApache SparkPythonScalaKubernetes+14

Bank of america

Big Data Engineer

Feb 2017Apr 2020 · 3 yrs 2 mos · Bengaluru, Karnataka, India

  • Worked in Big Data Hadoop Environment , Cloudera Manager, Yarn and Spark Architecture, Map Reduce,Hive,Sqoop,Spark,Spark Streaming,Python,Kafka,Impala,Scala, Python,Jquery,Javascript,unix shell scripting ,Yarn Resource Pool and Java.
Big DataHadoopCloudera ManagerYarnSparkMap Reduce+11

Royal bank of scotland business

Software Engineer

Sep 2015Feb 2017 · 1 yr 5 mos · Bengaluru, Karnataka, India

  • Mostly Analysis and Development, working on defects and enhancement.Used tools like hive, pySpark and ETL.
  • Performance Optimization for Batch processing
AnalysisDevelopmentHivePySparkETLSoftware Development+1

Education

Kendriya Vidyalaya

SSE — PCM

Apr 2008Mar 2009

Sikkim Manipal University - Distance Education

MCA — Computer Engineering

Stackforce found 100+ more professionals with Big Data Tools & Data Engineering

Explore similar profiles based on matching skills and experience