Jerin P.J

Senior Software Engineer

Bengaluru, Karnataka, India5 yrs 2 mos experience

Highly Stable

Key Highlights

3+ years of experience in data engineering.
Expert in AWS and big data technologies.
Proficient in designing scalable data solutions.

Stackforce AI infers this person is a Data Engineer specializing in AWS and big data solutions.

Contact

Skills

Core Skills

EtlAws

Other Skills

CC++Data StructuresHadoopHiveJavaMachine LearningManagementPySparkSqoopTeam ManagementTeamwork

About

Experienced Data Engineer with 3+ years of hands-on expertise in Python, Spark, Hadoop, SQL, Sqoop, Hive and AWS services. Proficient in crafting efficient data solutions, I specialize in processing and analyzing large datasets. My expertise extends to designing and implementing scalable solutions, harnessing the power of Hadoop and Spark to process vast datasets efficiently.

Experience

Tiger analytics

Senior Software Engineer

Nov 2024 – Present · 1 yr 4 mos · Bengaluru, Karnataka, India

Capgemini

3 roles

Associate Consultant

Promoted

Oct 2022 – Oct 2024 · 2 yrs

Designed and developed ETL processes for loading customer data into the data warehouse from Amazon S3 using AWS serverless fan out architecture using Lambda, SQS, SNS and transient EMR.
Used the combination of PySpark and Hadoop to load the data into Hive by developing Spark jobs for transformations and further loaded the aggregated data into the Data Warehouse for storage and reporting.
Leveraged Spark and Python for advanced data transformations and processing.
Performed import and export of data into HDFS and Hive using Sqoop and managed data within the
environment.

ETLAWSPySparkHadoopHiveSqoop