Mar 2022 – Oct 2023 · 1 yr 7 mos

Oct 2017 – Feb 2022 · 4 yrs 4 mos · Amsterdam, North Holland, Netherlands

• During my tenure at ING, I played a pivotal role in designing and migrating several data-intensive 3rd party applications from on-prem infra to public cloud infrastructure. My work in this capacity involved:
• Accomplishments
• Designing and developing data pipelines in Google Cloud Platform, utilizing a range of big data technologies such as Dataflow, BigQuery, Google Cloud Storage, Kafka, and PubSub, after consultation with various stakeholders.
• Conducting performance tests on different data pipelines to select the best tech for various use cases, such as BigQuery SQL vs Storage API vs BI Engine. Various Database comparisons within GCP: BigTable, CloudSQL, Cloud Spanner
• Implementing various data models and schemas backed by different performance tests, such as nested vs. flat, to optimize performance.
• Designing and building data pipelines in Cloudera using Kudu and Impala technologies for on-prem solutions.
• Contributing to network design discussions for firewall and VPN setup within internal and public cloud networks.
• Migrating old CI/CD pipelines from Jenkins to Azure DevOps.
• Migrating spring, tcserver-based applications to Spring-boot embedded server applications to improve scalability, performance, and reduce risk.
• Sharing my expertise by presenting on Big Data Technologies and hosting hackathons for colleagues.
• Introducing and sharing knowledge about various dev tools such as Docker, Maven plugins, etc., with the team to facilitate a smoother development cycle and easier upgrading to newer versions of libraries.
• My technical skillset for this role included Java, GCP, Private Cloud, Spring, Oracle, Bigquery, Bigtable, Azure DevOps, Springboot, Docker, Cloudera, and more. My contributions played a significant role in the successful migration of data-intensive applications to the public cloud, helping to ensure optimal performance, scalability, and security.

Oct 2017 – Mar 2020 · 2 yrs 5 mos · Amsterdam, North Holland, Netherlands

Jan 2017 – Mar 2020 · 3 yrs 2 mos · Rotterdam Area, Netherlands

• At Lunatech, I worked with clients in the insurance and financial markets domain. At our Insurance client, some of the major areas I worked on are migration of an outdated, monolithic search solution build directly on an SQL database to a more reliable, scalable Elasticsearch based system resulting in a significant improvement in the search system's performance. Also worked on implementing an efficient CI/CD setup using GitLab pipeline, Maven, liquibase etc., automating the application build, test and deployment process. This accelerated timelines, reduced errors, and improved productivity, allowing us to deliver high-quality software quickly to meet client needs.

May 2015 – Dec 2016 · 1 yr 7 mos · Bangalore

• As Co-Founder and CTO of Sankheki Analytics and Research, a Machine Learning driven Big Data Search and Analytics company, I led the development of customized end to end cloud-based solutions for our customers in the domains of data mining, analytics, and visualization using various Open Source technologies such as Apache Spark-ML, Solr, Scala, Python, MySQL, Hive, Highcharts etc. Our team also built planDemand, an intelligent demand planning suite for small businesses, which leverages advanced algorithms and augments internal business data with external public data such as rain and crop production. Additionally, we developed custom graph algorithms for in-store location analytics, utilizing Wi-Fi/Bluetooth ping data and clustering with Apache Spark-ML. Our natural language processing and information retrieval solutions for travel reviews and e-commerce utilized techniques such as Natural Language Query based reporting platforms. We also developed computer vision and deep learning solutions for palm tree counting and weed detection in farm fields, utilizing techniques such as convolutional neural networks (CNN) based implementation. Overall, our projects improved customer experience, reduced errors, and saved time for our clients while utilizing state-of-the-art technologies.
• Furthermore, I am pleased to share that Sankheki Analytics and Research's accomplishments and expertise in Machine Learning, Big Data Search and Analytics were acknowledged by a prominent US-based analytics company, which led to our successful acquisition. This recognition further validates our team's ability to deliver high-quality solutions to clients and highlights our commitment to utilizing cutting-edge technologies to solve complex problems.

Aug 2013 – May 2015 · 1 yr 9 mos · Bengaluru Area, India

• Site Search:
• Technology used: Scala, Playframework. Slick, MySQL, Java, Solr, Redis,Jenkins,S3, Liquibase, AngularJS, Nagios, Graphite, AWS Cloudwatch
• Worked in building the customer facing site search product dashboard which allows users see performance of search system and configure some rules for custom search ranking.
• Our team won the Engineering Excellence Award for the successfully developing the product.
• Features developed:
• Various Solr components for different use case: Autocorrection of queries and relevant result output, redirect of queries, campaign association with search query keywords
• Auto Configuration management for testing of various config at different environment before pushing to prod servers
• MySQL Database Schema Design
• Role and Authentication System
• Metric selection and monitoring system for the complete system
• Developed Synonyms consumption algorithms; Implemented it as Solr query processor

Oct 2011 – Aug 2013 · 1 yr 10 mos · Bengaluru Area, India

• Search Engine Backend Development:
• Technologies Used: Java, Solr, CXF, Redis, Jmxtrans, StatsD, Graphite, Gradle
• Owner of Search Backend System
• Developed search data indexing pipeline which is scalable and realtime to reflect and attribute changes in 100k+ product documents; Its parallel processing design helped reduce indexing time from 45+mins (old indexing pipeline) to 3 mins for complete indexing of 100k+ products.
• Developed REST Api for exposing the search query engine
• Impleted multiple search custom algorithm like Curated search (expose rule engine to BI people to change ranking of products), query rewrite/redirect, A/B testing search ranking algorithms
• Complete Monitoring setup of the search system using Jmxtrans, Statsd, Graphite
• RPM based packaging of search service for easy deployment in a better way
• Developing Search Service with business logic for internal use case on top solr
• Virtual Trial Room (VTR or StyleStudio): Designed the complex database schema for VTR involving 33 tables. Also worked in the backend web services development in Java, CXF, JPA, MySQL.
• Engineering Owner of Catalog Managment System(CMS): Before moving to search services and feature development completely, I was the owner of CMS. Developed Rich Internet Applications using PHP, MySQL, ExtJS, RabbitMQ for CMS like: bulk editing, updating etc. of products, different apps for different stages of 100K+ products life cycle in CMS
• Hack night projects:
• Sentiment analysis of customer's feedback and visualization as world tag cloud
• Top Colours detection from product images using computer vision and machine leaning algorithms

Jan 2011 – May 2011 · 4 mos · Bengaluru Area, India

• Stereo vision based project. Identifiying vehicles and finding its location.