Pradeep Kumar — AI Researcher
100 Months of Experience in Data Engineering domain. Worked on AWS Based Infrastructure and On-Prem eco system like Yarn , Spark, Map Reduce, Hive, Sqoop, Spark,Spark Streaming, Kafka, Impala, Presto, Python, Kubernetes, Unix shell scripting. DBT with Snowflake . Data Structure & Algorithm | Hadoop | Apache Spark | Python | Sqoop | Hive | UNIX Shell Scripting | AWS | Amazon S3 | EMR| AWS LAMDA | CLOUDWATCH | EC2 | Athena | Data Bricks | Apache Kafka | Streaming | SQL | SSRS | SSIS | SQL server | Postgress | Informatica| ETL | DATA WAREHOUSING Currently working in Big Data Tech Stack writing Spark code & Hive scripts & Sqoop & Kafka. I have hands on experience in development of jobs which comprises writing bash shell scripts, HQL,dealing with HDFS & AWS(S3,EMR,EC2). Proficient with all aspects of software development, right from Requirement Analysis, Database Design, Application Development, Debugging, Testing and Documentation. Experience holder in leading small team, taking ownership and working with Business Teams & End Stake holders. Specialities: • Big Data Tools : Spark, HDFS, Hive ,Sqoop , Kafka, Presto ,Impala, Pyspark , DBT, Airflow • Data Warehouse and Data Modelling. • Languages : Python , Shell Script. • Database : MS SQL ,Postgres, Mysql , SAP Hana, Mongo DB , Snowflake. • AWS Service : S3, Lambda, EMR, Glue, Cloudwatch, Redshift, SNS, Athena). • Tools : Intellij,Spyder,DBeaver,Zeeplin, Notebook, Git,SVN, Jenkins, TOAD, Jira ,Confluence . * Good in Data Structures & Algorithm fundamentals
Stackforce AI infers this person is a Big Data Engineer with expertise in cloud-based data solutions.
Location: Delhi, India
Experience: 7 yrs 2 mos
Skills
- Big Data Tools
- Data Engineering
- Big Data Engineering
- Hadoop Ecosystem
- Software Development
Career Highlights
- Over 8 years of experience in Data Engineering.
- Proficient in Big Data tools and AWS services.
- Strong background in software development and team leadership.
Work Experience
VMware
Senior Data Engineer (1 yr 7 mos)
Iris Software Inc.
Sr Data Engineer (1 yr)
Bank of America
Big Data Engineer (3 yrs 2 mos)
Royal Bank of Scotland Business
Software Engineer (1 yr 5 mos)
Education
SSE at Kendriya Vidyalaya
MCA at Sikkim Manipal University - Distance Education