Mar 2019 – Mar 2021 · 2 yrs

• Building and maintaining data pipelines and marts for mayor online supermarket.
• The Data Engineering department is in charge of managing the company’s data life cycle. Our systems collect all types of operational data from multiple business processes and departments, we gathering requirements from different consumers of this data (business analysts, data scientists, business reporting), in order to make the data available in a consistent and durable fashion, providing insights and driving business decisions.
• Responsibilities:
• Evaluated multiple commercial tools for extracting data from Oracle change-data-capture into BigQuery. Designed a plan and testing environment for a PoC.
• Architecture and technical design for new low latency pipelines in the Google Cloud Platform.
• Migrated data pipelines from legacy orchestration systems into Cloud Composer.
• Gather requirements for data customers. Enhance the data warehouse and build new data marts for them.

Oct 2017 – Mar 2019 · 1 yr 5 mos

• Re-architecture software systems for the HR department in a major online supermarket. The HR systems manages over 20K active employees and consists of 20 different applications (employee management, planning & rostering, recruitment, payroll, training) in different legacy stages, over a wide range of technologies. The systems needed performance improvements, stability and re-architecture in order to meet the increasing demand from the business.
• Responsibilities:
• Evaluate current architecture, identify failure points and bottlenecks. Redesign and simplify application integration. Create and implement plans for future requirements or replacement.
• Maintenance of in-house legacy applications, providing effective monitoring and alerting.
• Tuning and performance optimizations for Oracle databases to maintain stability, and building pipelines to export data into a cloud datalake for data analysis and reporting.
• Documenting legacy systems, recovering user requirements and improving UX. Rebuilding and modernising continuous integration processes, development environments and testing.
• Coordinating support with devops, providing 1-click deployment processes, organising issue triage, change management and incident resolution.

Oct 2015 – Sep 2017 · 1 yr 11 mos · Dublin

• Supporting researchers in the development of trading strategies, back-testing, data analysis tasks and tools for data ETL.
• In charge of building tools for gathering, cleaning and pre-processing historical market data.
• Designed the infrastructure, scheduling and workflow for running data pipelines and machine learning processes in a computer grid.
• Initial provisioning, configuration and monitoring the grid. Coordinated system administrators, storage, networks and support in order to build the production system and automate it.

Jan 2010 – Oct 2016 · 6 yrs 9 mos · Dublin

• Participated in the design, coding and testing of multiple automated and semi-automated trading applications, including low-latency, high-frequency trading.
• Worked on all aspects of a trading platform, software and infrastructure, databases, market data, order routing, quoting, trading strategies, data analysis and back-testing.
• Provided developer support for the front desk.
• Participated in gathering requirements for modifications and additions of new functionality.
• Devised tools and methodologies to improve the team operation.
• Promoted design and coding good practices and standards within the team.
• Mentor and trainer for new members.

Sep 2007 – Dec 2009 · 2 yrs 3 mos · Dublin

• Participated in the design, coding and testing of a system that provides high performance simulation and QoS measurement of networking protocols, especially VoIP, IPTV and Video Streaming.
• Participated in design and adapted customer requirements into into new features.
• Debugged and re-factored the multi-threaded server controller to improve efficiency and throughput in concurrent tasks.
• Provided maintenance and re-factoring for cleaning code.
• Used Hibernate to persist server transactions, configuration and statistics to DB.
• Devise a validation framework to ensure consistent server states and avoid data DB inconsistency.
• Implemented unit-tests and integration test.
• Implemented a XML configuration systems using JAXB for XML data binding.

Dec 2005 – Aug 2007 · 1 yr 8 mos · Murcia, Spain

• Designed, developed and deployed of a VoIP Call Management System (VCMS).
• Integrated several VoIP hardware with the VCMS.
• Designed and leaded the development of software for VCMS, including processing call detail records, pricing and billing.
• Developed GUI management software for the local version of the VCMS, using Eclipse RPC, SWT and Java.
• Served as Linux Systems Administrator providing High Availability for servers.
• Created VPN network infrastructure, PBX and Call Centre services between remote office branches.
• Integrate the VCMS with VoIP providers using web services to provide automatic pricing adjustment and Call Detail Records reconciliation.
• Trained new members in software development and networking.