Sep 2020 – Jul 2021 · 10 mos

May 2017 – Sep 2020 · 3 yrs 4 mos

• Building the next gen cloud security data platform using Kafka streaming, Elasticsearch, Spark and ML.
• Leading a team of engineers across Geo's to implement various threat workflows within cloud security domain.

Mar 2015 – May 2017 · 2 yrs 2 mos · santa Clara CA

• Managed a team of 4 engineers to implement the variant store project as part of the BaseSpace informatics suite
• Developed the ETL pipeline using HDP, Oozie, Hive, Pig and other hadoop tools
• Developed the bioinformatics machine learning algorithms in Spark Java
• Developed the real time access system on ElasticSearch
• Developed the REST API's using Java Spring MVC framework and Spring boot
• Ran Loadtest of Hadoop and ElasticSearch on AWS to scale to 1 billion variants over 100K samples
• Played the role of scrum master within the agile process
• Developed Hadoop ETL pipeline to ingest phenotype and molecular data as part of the NextBio Clinical product
• Setup and administered Hortonworks cluster using Ambari
• Helped build all the API components to run in Docker containers
• Created automated production deployment scripts in Ansible to setup multiple clusters across regions

Aug 2011 – Mar 2015 · 3 yrs 7 mos · mountain view CA

• Led a team of 4 engineers on various BI hadoop projects
• Developed BI feeds for Coupons.com Search, Facebook, Coupon-Codes and product management teams using Hadoop technologies
• Setup and administered 40 nodes Hadoop cluster and 10 nodes HBase cluster using Cloudera distribution (CDH 4.x)
• Setup and administered 10 node Cassandra ETL cluster using DataStax distribution
• Developed Coupons Sessions based application using HBase
• Developed self-serving reporting UI on top of Solr and Hadoop
• Generated reports for various data feeds using Netezza SQL and Microstratergy for finance, sales and Marketing teams
• Converted big data queries from Netezza sql to Hadoop-Impala sql
• Worked on extracting data from Cassandra SSTables using mapreduce and also converting text files into Cassandra for Bulk Load ingestion

Aug 2007 – Aug 2011 · 4 yrs · Sunnyvale CA

• Developed Content Match Ad based system using C++ and Perl
• Tested the Content Match system using Test Manager and Cluster testing.
• Trained the team in India to take over the maintenance of the Content Match System
• Participated in the Software and Hardware architecture of Mobile Ad ETL system
• Setup the entire ETL cluster using Moab/Torque and LOTUS
• Led a team of four involved in the creation of the Mobile Ad ETL system
• Developed the Mobile ETL system using C++, Perl and Shell scripting
• Developed Data Systems Anonymization A29 project as part of Yahoo Legal compliance using C++ and Perl
• Performed the black box testing using test manager and Perl scripts
• Developed the APT Display advertising warehouse project features using Hadoop, Java, MR and Pig scripting
• Provided various data feeds on the APT pipeline for Finance, Marketing and Internal teams

Jan 2006 – Aug 2007 · 1 yr 7 mos · Urbana-Champaign, Illinois Area

• Designed and developed the USB drivers for mass storage to NAND using C
• Designed and developed the USB UI for mass storage to NAND using C++
• Developed the USB component for high speed chip test in factory using C
• Lead the Datalogging feature involving three different teams
• Designed and developed the Datalogger UI using C++
• Designed and developed the Datalogger SD card drivers using C
• Developed application drivers related to PictBridge based on USB
• Tested all the features on simulator, RTA and prototype hardware

Aug 2005 – Dec 2005 · 4 mos · Austin, Texas Area

• Developed the Device Manager adapters using C++ and Code Warrior
• Developed the Server Initiated Action user interface using C++ and Code Warrior
• Developing SameTime Messenger midlet programs using Java and Wireless Tool Kit
• Designed the XForms call structure using Rational Application Developer
• Implemented the IBM XForms based on XML using Java and WSDD
• Tested the Device Manager Adapters using IBM SCTS tool (SyncML based)

Jan 2003 – May 2003 · 4 mos · Hyderabad, Telangana, India

• Designed the model using Rational Rose RT
• Developed the reactor software using Tornado/VxWorks and C
• Implemented the client’s interface using VC++
• Developed the communication between the reactor and the client using sockets
• Implemented a key board based control system to stabilize the reactor