Feb 2024 – Mar 2025 · 1 yr 1 mo · Chicago, Illinois, United States · Hybrid

Feb 2024 – Mar 2025 · 1 yr 1 mo · Chicago, Illinois, United States · Hybrid

Nov 2022 – Jan 2024 · 1 yr 2 mos · Parramatta, New South Wales, Australia

• Implementation of modern data platform (MDP) to set up the pipelines configurable and parameterized to be able to quickly ingest many systems and tables with minimal development effort.
• Data Ingestion from several source systems such as Oracle, managed data feeds using auto loader. Following the medallion lakehouse architecture, loaded data into multi-layers (raw, cleansed and curated layers). Implemented SCD over the curated layer to cater to business requirements to track history of changes. Prototyped Change Data Capture(CDC) and Delta live Tables(DLT).
• worked along to support migration of Databricks workspaces to enable Unity catalog for simple and consistent way to govern all aspects of the Databricks Lakehouse.

Dec 2020 – Nov 2022 · 1 yr 11 mos · Sydney, New South Wales, Australia

• Working on cutting edge technologies to transform the data using spark , python on the Databricks platform. Building Datawarehouse for BI solution on Azure Synapse and Domo
• My role involves working and managing a team of smart data engineers and data analysts supporting them to build data pipelines at scale.
• I liase with multiple teams and stakeholders to gather requirement, agile run down to get the tasks completed.
• Worked with other leads to define Product and Engineering Strategy for the financial year.
• Setting up Databricks environment to bring in best practises to team.
• Working on defining architecture for the smooth data ingestion from manufacturer to retailer opening up endless opportunities to grow.
• Also being part of leadership team has transformed my role from just being tech savvy to more effective and influential people leader.

Sep 2020 – Nov 2020 · 2 mos · Sydney, New South Wales, Australia

• It was a short but fantastic experience working at Cuscal to implement Structured Streaming solution using Databricks consuming millions of transaction daily from various payment platforms, systems. Gained valuable nights on payment processing, PCI compliance.

Dec 2017 – Sep 2020 · 2 yrs 9 mos · Sydney

• Great exposure on this greenfield project having worked with Solution Architect for setting up the data pipeline integrating with various existing system
• Used Amazon services like API Gateway, Lamdba based serverless micro services architecture to build data pipeline and Redshift as datawarehouse.
• Experience leading a team of Data Engineers and interacting with Business for planning sprints, deliverables.
• Worked closely with Data scientists and engineered the Machine Learning algorithms for building recommendation engine.
• Implemented inhouse algorithms in PySpark for faster processing.
• Upgraded to new version of data pipeline using Structured streaming and Databricks delta tables to overcome limitations of redshift
• Batch Processing and Stream Processing of data - Implemented logic on the tables using pyspark and sql building numerous views to facilitate reporting using Power BI.

Nov 2015 – Present · 10 yrs 7 mos · US

• Sparkflows helps to Build and Deploy Big Data Applications 10-30x faster. It also helps to do Machine Learning and Random Data Analytics on large dataset. Sparkflows provides 100+ building blocks and workflows for various applications.
• The workflow UI provides interactivity, schema propagation, is pluggable and has rich visualizations and dashboards. Plugging in new backend logic is easy and is auto-discovered by the UI.

Nov 2015 – Dec 2017 · 2 yrs 1 mo · Sydney, Australia

• Deliver projects, enhancements or fault remediation using Java J2EE Technologies like Spring Web Flow,Spring MVC, JSF and understanding IVR applications. My role involves not only development but also support and maintenance of the entire Phone Banking application for Westpac and St George.
• Creating efficient and accurate queries for generating statistical reports and attractive dashboards for user friend accessing of data, configuring Alerts using Splunk.

Aug 2014 – Nov 2015 · 1 yr 3 mos

• Worked as a Senior Developer for one of the leading Australian Wealth management organization- BT Financial Group, WestPac Account.
• As part of one of the largest wealth transformation Panaroma program, my role and responsibilities included designing and implementing the integration layer which provides an abstraction for all the services provided by the Avaloq Banking Solutions.
• Worked on breaking monolith application into Microservice implementation using Spring Boot framework. BT being part of Westpac, I got opportunity to work on end to end implementation and integrating with GCM system for clients maintenance screens which provided great exposure to User Interface development using Backbone js.

Apr 2013 – Jul 2014 · 1 yr 3 mos

• Worked as an Analyst and a Senior Java Developer for a Rural Housing Loan Application Development Project - NewCAPS for JP Morgan Chase Account. CAPS is an application used across JP Morgan Chase for processing/ registration of Loans. CAPS System is aimed to provide an efficient application for processing of loans.
• My responsibilities included requirement gathering, analysis, design, development using J2EE frameworks like Struts, EJBs and worked on several user interface screens using JSP,Jquery while adhering to the best practises, coding standards and also worked on testing using junit and java code coverage with jacoco plugin.I was involved in all the phases of SDLC.

Aug 2011 – Mar 2013 · 1 yr 7 mos

• Worked as Developer for designing and implementing Real Time Monitoring Applications using Systar BAM.Built, tested and deployed scalable, highly available and modular software products. Was able to work on modules independently and delivered defect free components. These applications were used by the CTO Group of JP Morgan Chase Bank.

Jul 2009 – Aug 2011 · 2 yrs 1 mo

• Started my career as a Systar BAM Developer creating applications for real time monitoring of Personal and Business Accounts with Bank of America as Clients. Any abnormal situation was to be notified of a status change as they occur so that correction could take place the same day.
• Got exposure to work and interact with clients to establish problem specifications and system designs.