Jun 2021 – Jul 2022 · 1 yr 1 mo · Bangalore Urban, Karnataka, India

Oct 2019 – Jun 2021 · 1 yr 8 mos

• Building scalable Data pipelines to ingest billions of events every day from client apps and Data API's.
• Designing cost efficient solutions for data flows for accurate identification of users and devices.
• Working with downstream teams to increase the ROI on each attribute tracked and each data point ingested.
• Maintaining the public API's to have high availability and low response times.

Oct 2018 – Sep 2019 · 11 mos

Dec 2017 – Sep 2018 · 9 mos

Nov 2016 – Oct 2017 · 11 mos · Bengaluru Area, India

• Scalend provides an end to end solution to transform raw data into meaningful insights. Easy to use UI encapsulates the complex and agile Hadoop infrastructure at the backend. The platform can handle variety of data sources of any volume.
• The platform is built using Java Spring MVC framework to drive API’s and Web UI(JSP, jQuery) , Kafka for messaging, bash scripts for interacting with Hadoop infrastructure, python for machine learning jobs, AWS for cloud instances.
• My main responsibilities are to architect the warehouse on big data technologies (Cloudera/HDFS/MapReduce/Spark/Hive/) and to build wrappers using bash/python on top for seamless integration with API’s which is robust enough to handle increasing demands of capability, scalability and security.
• Improved the product’s data science module(built on standalone R) by implementing python jobs on Spark 1.6 using ML libraries to utilize the distributed infra. Also, working on moving the existing R scripts to run on SparkR.
• Implementing/designing POC’s for new adopters of the product like connectors for new sources, data modelling, data transformation (ETL), data science insights and visualization, text mining etc.
• Developed new UI feature “Data Console” for users to ease through their data quickly by writing interactive queries, browsing the data, downloading the results as csv or xls. developed a simple query parser for instant errors instead of hitting the warehouse.
• Reinforced the development of the product by setting up DEV and QA environments for data warehouse and backend infrastructure .

Jul 2013 – Oct 2016 · 3 yrs 3 mos · Chennai Area, India

• Part of team which developed Open Analytics Platform(OAP), an application that provides seamless interface to multiple data infrastructures including Teradata,Hadoop and the scheduling systems. The OAP service accesses these systems on behalf of users and performs required actions.
• Open Analytics Platform (OAP) acts as a seamless bridge between the data analysts and the technologies via a web interface serving over 1500 users inside the company.
• OAP handles multiple data infrastructures including Teradata, Hadoop and scheduling systems with emphasis on reduced idea-to-execution cycle time for the users.
• One of the major contributions was “Elastic Workspaces” on OAP which allows the system to intelligently maintain the space available for each user.
• Built an engine for querying user clickstream patterns like finding paths, fallout metrics etc., on top of a SPARK cluster with data available on Hadoop file system. This was part of initiative called PayPal FPTI data, a better event processing engine.
• Application was built using Java Spring MVC framework, JMS, JDBC to connect to Oracle DB and Teradata and web UI using JSP, JavaScript and jQuery.
• Led a 2-member team for split up of the OAP application and its resources between the
• both companies’ which included a stand-alone installation of the app for EBAY.

May 2012 – Jul 2012 · 2 mos

• Designed and built a real-time Employee management System with features like performance
• evaluation and Salary update using PHP, Smarty (a template engine) and Mysql database.

May 2011 – Jul 2011 · 2 mos · Chennai

• I worked on various GIS’s (Geographical Information system) like QGIS, Grass, Map Server and open source JavaScript API’s like OpenLayers and HeatMap etc, for visualizing the spatial data of the company’s branches on Map, which will help in better and quick decision making.

Dec 2009 – Dec 2009 · 0 mo

• Was a dedicated member of marketing team which was actively involved in publicizing and marketing
• of NPTEL, a Govt. of India initiative.