Jul 2021 – Nov 2023 · 2 yrs 4 mos · Bengaluru, Karnataka, India

• Clients: Citi Bank, Airbnb
• Real Time Data processing (Including Image data) using Kafka
• Data Injestion into Cloud MongoDB
• Analysing Data using Spark
• Image to Text conversiong using OCR technologies and openCV
• And used Rest Frameworks(Spring Boot and FastAPI) for backend Tech

May 2019 – Jun 2021 · 2 yrs 1 mo · Greater Bengaluru Area

• I was part of Movoto Data Analytics Team.
• Handling USA Real estate public records data, it changes monthly so we process each month to update and refresh.
• Creating Point of interests for particular properties using both batch and realtime process.
• Working on various complex geo data, which are Raster, Shape, GeoJson files using Spark and postgis.
• Created Real estate listing metrics which is used to create geo related metrics on Movoto website.
• Handling Movoto Site SEO Ranking data from getstats.
• Processed NGINX and Cloudfront logs in Athena
• Technologies : Spark, GeoTrellis, GeoSpark, PostGis, AWS Athena, Hadoop, Luigi, Airflow, Kubernetes, Docker, Python, Java and Scala

Feb 2018 – Oct 2018 · 8 mos · Bengaluru, Karnataka, India

• Worked on Identityplus product.
• It’s a Customer network-based product.
• Creating Customers Network, based on various parameters and find relations between customers.
• Worked backend services for IdentityPlus product using Spring REST API.
• And also worked as Team of Afficency Product, which is online insurance Products.
• Handled Various complex REST APIs and Spring Rest token management.
• Major Frameworks and tools : Hadoop, Spark, Spark Graphx, Spring MVC, Scala, Java and Gradle.

May 2017 – Jan 2018 · 8 mos

• Handled Ad clicks log data from various sources with stable data pipeline.
• Cleaning log data, Druid automated data injestion, Spark ETL for data process into 40 nodes Sonobi Hadoop Cluster.
• All these workflows execution by Airflow, which is responsable for executing hourly, daily, weekly and monthly tasks.
• Worked on one of the Stable Data Pipeline.
• Worked on creating metadata for various data saving in HDFS.
• Major Frameworks and tools are Hadoop, Spark, Airflow, Druid, Python.
• Client: Sonobi Inc.
• Poc Project for Insurance Claims Fradualent :
• Worked on all phases like pre-model building, model building and productionization of model phases.
• In pre-model building phase, we worked on data preparation and also done exploratory data analysis using clustering.
• This POC Project was done for Insurance Company.
• Major Frameworks and tools are Hadoop, Spark, Flask, pyspark, Pandas, and Python.

May 2017 – Jan 2018 · 8 mos · Pune/Pimpri-Chinchwad Area

• Working as a Senior Engineer for Sonobi Data Engineering offshore team at QuantFarm.
• Responsible for end-to-end development of Big Data Platform, data pipeline etc.
• Major Frameworks and tools: Hadoop, Spark, Airflow, Druid, Python.

Oct 2014 – Apr 2017 · 2 yrs 6 mos · Bengaluru, Karnataka, India

• Hands on experience in working with EMR Sprak, Druid and Hadoop clusters.
• Created and Managed multiple sub-projects using Gradle.
• And responsible for project end-to-end development.
• Worked for one of international Client.
• And Major Tools are Spark, Sparkline, Hadoop, Druid, Hive, Scala, Java, Gradle
• Experience in working with tuning Machine Learning Algorithms (Sessional Algorithms) using Spark.
• Worked for one of world large retails company.
• And Major Tools are Spark, Hadoop, Python etc.
• Worked on Dropwizard with CouchBase.
• Worked for one of world large retails company.
• Major Tools are Dropwizard, CouchBase, JAVA etc.
• Hands on experience on Spring RestFul Framework.
• And also worked on Spring session Management.
• Worked for various clients using these technologies.
• Major Tools are Spring MVC, Java, MySql, PostgreSQL, JSP etc.
• Hands on experience on Play Framework.
• Worked on fetching and managing data from QuickBooks, Stripe, and Braintree.
• Enables users to analyze spends across payment networks. Forecasting users LTV, and Churn rates.
• Major tools are Play Framework, Java, Scala, PostgreSQL etc.
• Hands on experience on Web-scraping.
• Integrations with various advertising networks – API / REST based.
• Scrapers to get spend from networks.
• Major Tools are Spring MVC, Java and integrations with various networks.
• Software : Trello,JIRA,Github,Maven,Gradle,SBT, Confluence
• Methodologies : Agile, Scrum, TDD, DevOps
• IDE : Intellij, Eclipse, Jupyter Notebook, Netbeans

Feb 2013 – Sep 2014 · 1 yr 7 mos

• Fetching and analysis of Twitter Data using core JAVA and Twitter4j package.
• The application extract tweets from the followers of a particular brand and Saving data in NoSql
• Databases.
• Hands on experienced on design and develop PHP Web projects.
• Worked on product design and development of the Enterprise Resource Planning Tool.
• Primary business goal is developing and maintaining ERP product tools for mid and small level companies.
• And also worked on Web and Desktop based ERP projects.