Jun 2019 – Oct 2021 · 2 yrs 4 mos · Noida, Uttar Pradesh, India · Hybrid

• Accountabilities:
• > Take ownership of the development and deployment of our ETL data engineering process, that allows relevant data to be centrally collected, aggregated, and processed.
• > Work with engineering and IT functions to ensure sufficient relevant data is being gathered to provide the best information for engineering platforms like HPC, Storage, EDA, Emulation...
• > Have continuous communication with the customers/stakeholders for changing priorities and improvements needed for the development of the service in the area of data engineering.
• My tasks typically include:
• ETL Code Development: Data source exploration, extract, transform and load engineering data from various sources for visualization.
• Build and deploy ETL workflows for continuous data delivery to the dashboards making sure it is robust and scalable.
• Follow software engineering standards: Testing analytics products for robustness: Source Control, Code Testing, Verify Code Logic and Data integrity, Debugging and Review of Code and Data anomaly.
• Enhance data collection and data processing methodologies.
• Collaborate with the other team members who use various statistical and Machine Learning models to build predictive analytical products for our Engineering and Platform Operation teams.

Aug 2018 – May 2019 · 9 mos · Noida, Uttar Pradesh, India · On-site

• Responsibilities:
• Re-engineering of the MS SQL Server system to Big Data ecosystem.
• Requirement gathering for upcoming development activities and enhancements and giving an estimation for the same.
• Developed Hive scripts to extract meaningful data from Blob Storage and performed analytics over it.
• Involved in the development of the code as per the product requirements.

Jun 2016 – Jul 2018 · 2 yrs 1 mo · Noida · On-site

• Responsible for design, develop, modify, debug and maintain software systems. Served as an expert on specific modules, applications or technologies, and dealt with complex assignments during the software development lifecycle.