Jun 2021 – Jul 2023 · 2 yrs 1 mo · Pune, Maharashtra, India

• Led the design and development of real-time data pipelines to ingest and store streaming data in Parquet format on AWS S3, enabling high-performance analytical processing.
• Enhanced existing data ingestion services to seamlessly consume data from Confluent Kafka and deliver it to S3 in both Parquet and JSON formats, improving flexibility for downstream analytics.
• Architected and implemented a microservice to aggregate real-time Kafka data and persist it in a Time Series Database (TimescaleDB) for efficient trend and metric analysis.
• Designed and developed a gRPC service to expose aggregated time-series data with low-latency access for analytical and monitoring use cases.
• Spearheaded the creation of a Feature Store to empower data scientists with centralized, high-quality feature datasets for machine learning and advanced analytics, accelerating model development.

Sep 2020 – May 2021 · 8 mos · Pune, Maharashtra, India

• Government Compliance (Drug supply chain)
• Design and develop custom frameworks and services in microservice architecture to help Drug manufacturers/CMOs to ship their products to distributors/wholesalers by following all government-mandated guidelines
• Design and develop services as per customers requirement at the same time make sure that services remain compatible with respective government systems
• Enhance and maintain core part of the product which acts as data layer throughout the architecture and connects to most of the exposed services as their backbone
• Technologies: Java 8, Scala, Spring (Core), AWS (S3, CloudSearch, SQS, DynamoDB, Redshift)

Feb 2018 – Sep 2020 · 2 yrs 7 mos · Pune/Pimpri-Chinchwad Area

• Cross Property Data Lake – 2 (CPDL-2)
• Design and develop low latency and high throughput using Kafka, Java and related framework.
• Develop custom frameworks and services for processing Class 2 data using Raptor (PayPal developed) framework, other streaming related frameworks and API.
• Design and develop Rest service using which authorised clients can extract/save/update Class 2 data in Class 2 datastore (Oracle).
• Design and develop Restful web services to accept data from authorised clients and publish it to Kafka topics for further processing.
• Design and develop daemon applications to consume messages from Kafka, process these message and again publish to another Kafka.
• Locally setup SonarQube for static analysis.
• Create Jenkins jobs for building project and executing functional test cases for required Git branch.
• Independently handling all enterprise applications across CPDL.
• Technologies: Java 8, Spring (Boot, Integration Kafka, Batch), Kafka, Rest web services, Oracle, JPA, Git, BitBucket, Maven

Sep 2015 – Feb 2018 · 2 yrs 5 mos · Pune/Pimpri-Chinchwad Area

• Part of PTDS unit which stands for Post Trade Derivatives System. As name suggests, team is responsible for developing and maintaining post trade derivatives API. Currently we have three such Java APIs.
• 1. FpML API
• 2. GMIOne
• 3. Tax Calculator
• Team also handles various R&D projects.
• Technologies Used:
• Core Java, Spring (IOC, Hibernate), JPA (Hibernate), Webservices (JAX-WS, JAX-RS) etc.

May 2012 – Sep 2015 · 3 yrs 4 mos · Pune

• The project is all about build automation. My responsibilities in this project are developing the different components of build automation framework.
• Some of the major components are:
• 1. 'Enterprise Dashboard' for consolidated project details where each and every quality check metric can be viewed.
• 2. 'IPS-Util Agent' to send collect data present in XML files, separating it as per tools and quality parameter and send over server in the form of byte stream.
• 3. 'CBA Listener' is an servlet listening for incoming byte streams sent by IPS-Util agent and detokenizing it and storing in centralized MySQL DB.
• 4. 'Modular Report' generating single report with multiple project data as per customized view.
• Technologies used:
• Core Java, Hibernate, XML parsing (JAXB, DOM), Struts 2.0, Servlet, JSP, JavaScript, CSS, XSLT etc.