Jayant Chawla

Data Engineer

Noida, Uttar Pradesh, India4 yrs 7 mos experience

Most Likely To Switch

Key Highlights

Proven track record in data migration projects.
Expertise in PySpark and AWS Glue for data processing.
Strong analytical and problem-solving capabilities.

Stackforce AI infers this person is a Data Engineering specialist in SaaS environments.

Contact

Skills

Core Skills

Data EngineeringEtl DevelopmentData MigrationData Quality Checks

Other Skills

AWS GlueAbacusAgile MethodologiesAmazon Web Services (AWS)Analytical SkillsApache SparkAzure DevOps ServicesBig Data ProcessingC (Programming Language)C++Continuous Integration (CI)Data AnalysisData AnalyticsData InfrastructureData Science

About

Experienced PySpark Developer with a proven track record of contributing to successful data migration projects using PySpark & AWS Glue. Offering proficiency in Python, PySpark, and HDFS, along with strong analytical and problem-solving skills. Seeking a challenging role to leverage my expertise in big data processing, ETL development, and data engineering.

Experience

Riskonnect, inc.

Data Engineer

Jul 2024 – Present · 1 yr 8 mos · Noida, Uttar Pradesh, India · Remote

Data EngineeringETL DevelopmentPySparkAWS Glue

Wipro

Project Engineer

Dec 2021 – Jul 2024 · 2 yrs 7 mos · Noida, Uttar Pradesh, India · Hybrid

Collaborated in the design and implementation of data migration projects, successfully transferring large datasets to Amazon Aurora
using AWS Glue.
Developed and maintained ETL workflows using PySpark, optimising data processing pipelines for enhanced efficiency.
Worked closely with cross-functional teams to gather and understand data requirements, ensuring alignment with project objectives.
Implemented data quality checks and performance tuning strategies to enhance overall system reliability and speed.
Created a PySpark and Python based Data Validation Framework for quality check, data comparison & validating the data migrated to the target database with the
source database.

AWS GluePySparkETL DevelopmentData MigrationData Quality Checks

Mindtree

Engineer

Aug 2021 – Dec 2021 · 4 mos · Bengaluru, Karnataka, India

Collaborated on team projects and develop a solid understanding of distributed computing concepts.
Utilized PySpark’s DataFrame API for data manipulation and exploration.
Acquired foundational knowledge in HDFS storage mechanisms.

PySparkHDFS

Netlink software group america inc

Deep-Learning Intern

Jun 2021 – Aug 2021 · 2 mos · Bhopal, Madhya Pradesh, India

Dataset Preparation(Cleaning and transforming) & Model Training for ANPR System
Requirement Gathering for Automation Use Cases in Towel Industry Machineries
Worked closely with the Manufacturing Team of Client to understand their pain-point for Deep Learning automation.

Dataset PreparationModel Training