Navej Pathan — Data Engineer
Motivated Data Engineer with 4+ years of experience in Data Engineering and Analytics domain which includes AWS Services, SQL, Python, Snowflake, Pyspark, Data Warehousing, Data Modelling & ETL. Strong desire to move forward, face new challenges and expand my skillset. 1) Project: Data Visualization Tech Stack: SQL, AWS Athena, Quicksight. • Build Quicksight dashboards to visualize core business KPI’s. • Automated existing manual reporting and KPI calculations which results in saving 6 hrs per week. • Created Data Models by writing complex SQL queries. • Prepared Test Case, SIT and Technical documents. • Mentored junior team members. 2) Project: Data Migration Tech Stack: Python, Pyspark, SQL, Pandas, PostgresSQL, Datacompy, Snowflake, AWS Services: S3, Glue, Athena, IAM, Secrete Manager, Cloudwatch. • Build Data platform using AWS S3 as data Lake and Snowflake as Data warehouse which results in cost-effectiveness, Scalability and faster delivery. • Migrated 9 Applications (around 450+ tables) through automated ETL framework which reduces manual work by 29% monthly. • Used AWS Glue+Pyspark to extract data from different sources like database/file and load it into cloud warehouse (Snowflake) with different loading strategies (Incremental load / full load / SCD2). • Used AWS Glue workflows and triggers for orchestration of ETL pipeline. • Created AWS Glue+Python script to refresh external table in snowflake which reduces manual work by 50%. • Developed configuration-based Data Validation framework using pandas and datacompy to ensure accuracy of migrated data which reduces manual data validation up to 70%. • Created Views and stored procedures in snowflake to load data in Data marts (dimensional models) as per the business requirement. • Prepared Test Case, Unit Testing, SIT, Runbooks and Technical Specification documents. • Mentored junior team members.
Stackforce AI infers this person is a Data Engineering specialist in the SaaS industry.
Location: Pune, Maharashtra, India
Experience: 4 yrs 9 mos
Skills
- Data Engineering
- Data Analytics
Career Highlights
- 4+ years of experience in Data Engineering and Analytics.
- Automated reporting saving 6 hours weekly.
- Mentored junior team members in data projects.
Work Experience
Blazeclan Technologies
Senior Data Engineer (8 mos)
Data Engineer (3 yrs 9 mos)
Data, Analytics & Insight Intern (6 mos)
Education
CERTIFICATION COURSE IN DATA ASSOCIATE/DATA SCIENCE at Symbiosis Skills & Professional University
Bachelor's degree at Shri Gajanan Maharaj Shikshan Prasarak Mandals College of Education for Women, Otur, Dumbarewadi,Tal.Junnar,Dist. Pune 412409
Diploma of Education at Vamanrao Ithape Polytechnic Sangamner
HSC at Shramik Junior College Sangamner
SSC at Hindamata Vidyalaya Vadgoan-Kandali
