Arpan Gupta

Software Engineer

Bengaluru, Karnataka, India11 yrs 6 mos experience
Highly Stable

Key Highlights

  • Expert in building high-performance data pipelines.
  • Proficient in modern cloud technologies and microservices.
  • Strong background in semantic search and query optimization.
Stackforce AI infers this person is a SaaS backend engineer with expertise in data processing and search technologies.

Contact

Skills

Core Skills

Apache FlinkCockroachdbAerospikeGo (programming Language)ElasticsearchSolrJavaPython (programming Language)Bigcommerce

Other Skills

AlgorithmsAmazon Elastic MapReduce (EMR)Amazon Web Services (AWS)Apache AirflowApache KafkaApache ZooKeeperBusiness IntelligenceComputer ScienceCore JavaData StructuresFluxGoogle Cloud Platform (GCP)HTMLJavaScriptKubernetes

About

Experienced Software Engineer with a demonstrated history of working in the computer software industry. Skilled in Python, Computer Science, Java. Strong engineering professional with a Bachelor of Engineering (B.E.) focused in Computer Science from PESIT.

Experience

Viven

Engineering

Oct 2025Present · 5 mos · Bengaluru, Karnataka, India

Netcore unbxd

5 roles

Principal Software Engineer

Promoted

Apr 2023Oct 2025 · 2 yrs 6 mos · On-site

  • Currently working on New Reporting and Analytics Pipeline System using Apache Flink, Apache Druid, Apache Kafka & Cockroach DB
  • Building a New Document Store using Aerospike/TiKV for 20-30% faster retrieval of products
  • New search-index on ARM coupled with Apache Solr 9 and deeper nested document support leading to 20-30% better query performance
  • New query-engine for search-index with custom DSL support, AST for DSL translation, delivering 10-15% better query formation efficiency
  • New Service using Cockroach DB and redis for Enhanced user-segmentation support, improving latency by 40%
  • Custom Search, Facet and Debug Apache Solr Components to inject external documents from multiple sources
  • Adopted ProtoBuf & gRPC for inter-service communication, improving data transfer times by 20%
  • Helped implementing Git-based CD Pipeline using GitOps/FluxCD and its adoption across seven datacenters
FluxProtobufApache FlinkApache KafkaAerospikeSolr+3

Lead Software Engineer

Promoted

May 2021Mar 2023 · 1 yr 10 mos · On-site

  • Built a highly concurrent service in Golang that does inter-service request routing with dynamic network topology based on request parameters, handling 7 datacenters in 4 geographies
  • Helped implementing event-driven cross-region communication system on NATS
  • Built a revamped promotion engine to execute site merchandiser defined business rules using Mongo, Redis and Elasticsearch
  • Built an improved recommendations pipeline with new services added for handling templating config and core recommendations logic to support page based recommendations
  • A centralized hierarchical configuration management service using Dgraph
  • with config change notifications using NATS
Go (Programming Language)RedisJavaMongoDBSolrElasticsearch+4

Software Engineer

Promoted

Mar 2015Apr 2021 · 6 yrs 1 mo · On-site

  • Built a Custom query parser with a custom grammar and several Analysis Tokenizers and Filters to help enable semantic search in Apache Solr
  • Transformed monolithic query pipeline to microservices architecture, moving from large monolith built on solr 4.5 to microservices design
  • Created custom index solution based on Solr 6.6 fork with custom plugins, query parsers, and search components with support for nested documents
  • Contributed to query expansion service built using Mongo and Zookeeper for change event notifications
  • Used dependency parsing of top queries to automate generation of “Must Have Tokens” to support semantic retrieval using spaCy and Spark. Also presented it at Berlin Buzzwords, 2018
  • Contributed to the workflow orchestration service to automate generation of various backend ML models
SolrJavaPythonMongoDBApache ZooKeeperspaCy+3

Solutions Engineer

Jul 2014Feb 2015 · 7 mos · On-site

  • Developed a Bigcommerce Feed & Recommendations app utilizing Webhooks and Bigcommerce API for real-time data updates.
  • Integrated Unbxd Search and Recommendations across diverse platforms including Magento, Shopify, and Volusion. Enhanced feed management efficiency through Redis, improving response times and user experience.
Python (Programming Language)BigCommerceShopifyRedis

Software Intern

Jan 2014Jun 2014 · 5 mos · On-site

Ruby on RailsMachine LearningJava

Education

PESIT

Bachelor of Engineering (B.E.) — Computer Science

Jan 2010Jan 2014

Stackforce found 100+ more professionals with Apache Flink & Cockroachdb

Explore similar profiles based on matching skills and experience