Oct 2018 – Feb 2020 · 1 yr 4 mos · Bangalore

• Working on strategies to provide technical solutions based on business requirements by understanding and using various tools, platforms and libraries, with always a vision to make them work together.
• Built the whole data platform on the GCP infrastructure using various services based on stream and batch data. Airflow/Composer/Data Fusion being our major orchestrator.
• Converted the complete customer data platform from Redshift/Sas to Google bigquery.
• Create ETL pipelines to deliver sanctioned data to stakeholders, while maintaining high accuracy and reliability.
• Experience in data quality definition, data cleansing and data treatment/profiling process
• Proactively drive the vision for data engineering across verticals and define and execute on a plan to achieve that vision.
• Brainstorm data product ideas and partner closely with Data Scientists; Product Management and Operations teams to develop; test; deploy; and operate high-quality software
• Tune and monitor data infrastructure Performance to support a growing organization
• Responsible for maintaining the operation of the system platform, including system inspection, troubleshooting, system optimization, data backup, etc., to ensure the high-quality and efficient operation of the platform.

Sep 2015 – Oct 2018 · 3 yrs 1 mo · Bangalore Area, India

• Designing and architecting the data ingestion from source into Big data and using various niche technologies like SPARK to process the data faster in Hortonworks Distribution.
• Development, and testing of enterprise decision solution for NBCU’s Bigdata system. Solution involved integration of Big data system with various BI and Data Warehousing tool to demonstrate how faster the data can be processed influencing business decisions.
• Developing Scripts/Jobs for data ingestion into HDFS/HIVE/HBASE, data analysis, aggregations and data validation. Automating the entire data ingestion process.
• Responsible for designing and deploying relevant application platforms.
• Diagnose and solve issues in our existing data pipelines and envision and build their successors.

Jan 2014 – Sep 2015 · 1 yr 8 mos · Chennai Area, India

• As a senior developer solving the business problems of our clients by operationalizing hadoop and its ecosystem was our main goal. Involved in Requirement gathering from the client in the client meeting and explains the same to the team and help them understand and provide support.Handled importing of data from various data sources, performed transformations using Hive, Map Reduce Analyzed the data by performing Hive queries and running Pig scripts to know user behavior. Prepared scripts to ensure proper data access, manipulation and reporting functions with R programming languages.

Jan 2012 – Jan 2014 · 2 yrs · Chennai Area, India

• Understand the business requirement in German and providing the Functional, technical documentation. Efficient Coding in SWT01.Translate the business requirements from German to English and provide end-to-end solutions for the clients.The project was implemented using Agile Methodology.Individually designed and implemented the Decision making system with Zero Defect.Configured SAP’s Project System and Investment Management modules for domestic operations of major Pharmaceutical Company. Responsible for business requirements analysis, process decomposition, process reengineering, integration testing, training facilitation, securities profile development, and post production support.
• The project involves maintaining the Dialogue System Leiustung which is a Benefit System in Zurich Germany which handles all the claim processing and settlement. It’s a centralized system specifically designed to handle settlements from various systems like GRL, VSL & ZL systems. DSL system acts like a plug and play device, many interfaces like text adaptor, VSL, GRL, Inkasso; FSCD interacts with DSL for payment processing. All the changes & modifications as well settlements to various policies are done through online IMS screens. These screens are designed using a tool Bonndias.

Sep 2009 – Jan 2012 · 2 yrs 4 mos · Chennai Area, India

• The project involves managing the Master Security Description applications are part of core processing in Global Wealth Management division of Morgan Stanley. MSD is a centralized data base for all security related information (End to end information about all products like Stock’s, Bond’s etc.). The project involves Development & Maintenance of MSD, PRC, SEC applications and the Joint Venture of Morgan Stanley with Smith Barney that deals with the migration of Smith Barney accounts into Morgan Stanley System.