Rohit Jha

CTO

Bengaluru, Karnataka, India9 yrs 5 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Built AI-powered applications for MSME automation.
  • Scaled SaaS platforms to 3M+ users with high transaction volume.
  • Achieved 99.9% uptime for chat systems handling millions of transactions.
Stackforce AI infers this person is a SaaS and AI Engineering expert with a focus on scalable backend architecture.

Contact

Skills

Core Skills

Backend & ArchitectureAi/ml EngineeringScalable Saas Development

Other Skills

Node.jsAWSmicroservicesserverlessRetrieval-Augmented GenerationVector DatabasesLLM Fine-tuningConversational AIMachine Learning PipelinesSystems DesignREST APIsSoftware ProjectsJavaScriptPrompt EngineeringNatural Language Processing (NLP)

About

I am a hands-on, Senior Backend / AI Engineer, and solutions architect with 8+ years of experience building cloud-native, high-scale platforms that blend traditional backend engineering with cutting-edge AI capabilities. I specialize in designing scalable distributed systems, leading engineering teams, and delivering AI-powered products that impact millions of users. I've built and shipped 3 major SaaS products—Employee Connect, Dealer Connect, Partner Connect—now used by 3M+ users and processing 6 crore+ monthly transactions. My work combines Node.js, AWS, microservices, serverless architecture, and AI/ML integration to deliver intelligent, stable, and cost-optimized systems. ----- AI Engineering Expertise (Recent Focus) RAG (Retrieval-Augmented Generation): Built enterprise knowledge bases and intelligent search systems using vector databases and LLM orchestration LLM Fine-tuning: Fine-tuned domain-specific models for MSME use cases, improving task-specific accuracy by 40% AI Chat Support: Developed conversational AI systems for customer support, reducing response time by 70% Predictive Analytics: Implemented ML pipelines for business forecasting, inventory optimization, and user behavior prediction AI Infrastructure: Deployed production-ready AI systems with monitoring, A/B testing, and continuous model improvement ----- What I Do Best AI/ML Engineering: RAG, LLM fine-tuning, conversational AI, predictive analytics, ML Ops Backend & Architecture: Node.js, microservices, serverless, distributed systems, high-availability APIs Cloud Engineering: AWS (Lambda, EC2, S3, RDS, SageMaker, Bedrock), CI/CD, DevOps workflows Scalable SaaS Development: Launched platforms for 70+ MSMEs, optimized infra, reduced cloud cost Engineering Leadership: Strategy, roadmap ownership, hiring, mentoring, and cross-functional execution ----- Career Highlights Built AI-powered applications using RAG and fine-tuned LLMs for MSME automation Scaled SaaS platforms to 3M+ users and 6Cr+ monthly transactions Deployed predictive analytics models improving business decision-making by 35% Built systems supporting 20M+ monthly chat transactions with 99.9% uptime Bootstrapped and exited a platform after scaling it to 500K+ users Founding backend engineer for a Temasek-backed job platform ----- I'm passionate about where AI, architecture, and product strategy intersect—building real, measurable value through robust engineering and intelligent automation. Currently progressing deeper into AI Engineering while maintaining my backend engineering foundation.

Experience

9 yrs 5 mos
Total Experience
2 yrs 4 mos
Average Tenure
3 yrs 2 mos
Current Experience

Nexxio technologies

Engineering Lead

Mar 2023Present · 3 yrs 2 mos · Bengaluru, Karnataka, India · On-site

  • 70+ MSMEs | 3M+ users | 6Cr+ monthly transactions
  • Core Engineering:
  • Architected and scaled B2B SaaS platforms using Node.js, AWS, microservices, serverless
  • Built Employee Connect, Dealer Connect, Partner Connect → 3M+ users
  • Reduced cloud cost by 40%, improved reliability through serverless and infra redesign
  • Owned engineering strategy, roadmap, hiring, and delivery management
  • AI/ML Engineering (2024-Present):
  • RAG-Based Knowledge Systems: Built enterprise knowledge bases using vector databases (Pinecone, Weaviate) and LLM orchestration, enabling natural language queries across 100K+ documents
  • LLM Fine-tuning: Fine-tuned open-source models (Llama, Mistral) for MSME-specific tasks including invoice processing, compliance checks, and automated reporting—improving accuracy from 65% to 92%
  • Conversational AI: Developed AI-powered chat support systems using GPT-4 and Claude, reducing customer support response time by 70% and handling 50K+ monthly conversations
  • Predictive Analytics: Implemented ML pipelines for demand forecasting, inventory optimization, and churn prediction using scikit-learn, XGBoost—improving forecast accuracy by 35%
  • AI Infrastructure: Built MLOps pipelines with model versioning, A/B testing, monitoring, and automated retraining workflows using AWS SageMaker and Lambda
  • Vector Search: Implemented semantic search capabilities across product catalogs, reducing search-to-purchase time by 45%
  • Leadership & Collaboration:
  • Collaborated with founders on product vision, AI strategy, GTM planning, and investor documentation
  • Led AI adoption workshops for engineering teams, establishing best practices for LLM integration and prompt engineering
  • Evaluated and integrated AI APIs (OpenAI, Anthropic, AWS Bedrock) for production use cases
Node.jsAWSmicroservicesserverlessBackend & ArchitectureAI/ML Engineering

Goodworker

Senior Software Engineer

Sep 2021Mar 2023 · 1 yr 6 mos · Bengaluru, Karnataka, India · On-site

  • Founding backend engineer for a job platform used by millions
  • Designed secure, high-availability microservices + scalable APIs
  • Owned API architecture, low-latency services, and system optimization
  • Led backend integrations across product, data, mobile, and infra teams
Systems DesignREST APIsBackend & Architecture

Appnow technologies

Full Stack Developer

Jun 2018Sep 2021 · 3 yrs 3 mos · Bengaluru, Karnataka, India

  • Scaled chat platform to 20M+ monthly transactions
  • Built SaaS commerce and chatbot products delivering high uptime
  • Led backend architecture improvements to support multi-tenant deployments
REST APIsSoftware ProjectsBackend & Architecture

Accenture

Development Associate

Nov 2016May 2018 · 1 yr 6 mos · Bangalore · On-site

  • Improved backend performance for Cisco Webex
  • Enhanced scalability, reliability, and security for ETS (TOEFL/GRE) systems
JavaScriptREST APIsBackend & Architecture

Education

Veer Surendra Sai University Of Technology ( Formerly UCE ), Burla

Bachelor's degree — Information Technology

Jan 2012Jan 2016

Maharshi College of Natural Law, BBSR, Khurda

High School — Junior High/Intermediate/Middle School Education and Teaching

Jan 2009Jan 2011

Stackforce found 89 more professionals with Backend & Architecture & Ai/ml Engineering

Explore similar profiles based on matching skills and experience