Sep 2021 – Dec 2022 · 1 yr 3 mos · Greater London, England, United Kingdom

Dec 2018 – Aug 2021 · 2 yrs 8 mos · Gurugram, Haryana, India

• Project is intended to ingest the clinical trials data from multiple systems and massage it as per the business requirement and need. Also conducted predictive analysis for Clinical Trial data.
•  Responsible for constructing end to end data cycle, starting from ingesting data from sources like internal databases mysql, oracle or files, to the hdfs and then massaging data based on business requirement.
•  Created multiple pyspark jobs to transform data and create multiple features based on business logic.
•  Conducted a proof of concept to build multiple machine learning models to forecast the outcome of clinical trial using supervised learning.
•  Used Predictive analytics on available data to improve clinical trial processes and trial outcomes.

Apr 2017 – Dec 2018 · 1 yr 8 mos · Gurugram, Haryana, India

• Project is intended to migrate the Informatica based data warehouse to the Hadoop system.
• This Migration includes 14 Applications Migration including customers data, contract data, billing details and quoting data. The project scope was to retire the Informatica based warehouse and move the processing and reporting to Hadoop which would help in cost reduction and have a common data hub for the organization.
•  Development & testing of Sqoop import jobs to pull data from relation source.
•  Development & testing of HiveQL jobs on Spark execution engine to convert the Informatica ETLs to hive and spark scripts.
•  Creation of DDL structure in hive in Text, RC and Parquet format as per requirement.
•  Creation & testing of validation SQL scripts to verify data between source and target and middle layers of ETL Process.
•  Preparing, design and Develop Unix shell scripts to drive Hadoop Scripts flows.
•  End to End scheduling of complete flows in Mastero (Scheduling Agent).
•  Post Production Bug fixing and Enhancements.
•  POC on spark to bring in live stream of data to move away from batch mode to live stream mode in future.

Nov 2016 – Apr 2017 · 5 mos · Gurugram, Haryana, India

• Project is intended to compensate passengers where time delays have occurred with journeys of trains travelled by national Express Rail Franchise. There are several Criteria on which the Refunds and vouchers are created and provided to the customers.
•  Analyzed data by retrieving through SQL queries.
•  Requirement analysis, gathering, coding and testing various modules in a software development life cycle
•  Post Production Bug fixing and Enhancements.
•  Writing procedures, Cursors, triggers, Functions
•  Preparing, design and Develop Unix shell scripts
•  Worked on different client requirements.