Praful Saxena

Data Engineer

Lucknow, Uttar Pradesh, India8 yrs 2 mos experience

Highly StableAI Enabled

Key Highlights

Expert in building data pipelines using Spark and Scala.
Proficient in ETL processes and data engineering on AWS.
Strong background in machine learning and data analytics.

Stackforce AI infers this person is a Data Engineer with expertise in Fintech and data analytics.

Contact

praful.saxena@paytm.com LinkedIn

Skills

Core Skills

Data EngineeringEtlData AnalysisMachine Learning

Other Skills

AWSAirflowArtificial Intelligence (AI)Big DataData ManagementData ModelingData ScienceData StructuresData VisualizationDeep LearningEDAExploratory Data AnalysisForecastingHadoopLinear Regression

About

Developing robust data pipelines and features that enhance the merchant and customer experience using Spark-Scala on the AWS cloud platform. With a strong foundation in mechanical engineering from Dr. A.P.J. Abdul Kalam Technical University and specialised knowledge in data analytics and machine learning from Imarticus Learning, I bring a multifaceted approach to data engineering. My expertise lies in ETL processes, specifically with programming Language and Apache Airflow, and crafting scalable solutions that drive efficiency and innovation.

Experience

8 yrs 2 mos

Total Experience

4 yrs 11 mos

Average Tenure

3 yrs 3 mos

Current Experience

Paytm

Senior Data Engineer

Mar 2023 – Present · 3 yrs 3 mos · Noida, Uttar Pradesh, India · Hybrid

Working with Data Engineering team.
Creating Pipelines and building merchant features and customer features using Spark- Scala
Cloud Platform- AWS(Amazon Web Services)
Programming Lang:- Spark, Python
IDE- VS studio and IntelliJ
Created a python script for sending alerts on app( official communication).
Worked on the Airflow from POC to migration of flows (building the airflow design, creation of DAG, wrapper operators. etc)
Created a python script for sending real time data reports to business head mails.Report consist of Iteration type, last seven days considerably D-1 and current iteration.
Worked on the Datahub Lineage- modified our script for taking a list of dataset names and returns dataset Ids by using Datalake config file.

SparkScalaAWSPythonAirflowData Engineering+1

Ncc limited

Engineer

Apr 2018 – Mar 2023 · 4 yrs 11 mos · Adani Lucknow International Airport Limited

handling operations machinery data like productions , status of machinery etc by EDA and other useful techniques
Created a ML script from scratch (logistic Reg) for Classification data type, Use of EDA for Analysis, Data skewness , Data pre-processing work, use of ML algos.

EDALogistic RegressionMachine LearningData Analysis