Harshit Mahajan

Software Engineer

Bengaluru, Karnataka, India4 yrs 7 mos experience

AI EnabledHighly Stable

Key Highlights

Expert in building scalable distributed systems.
Led development of AI Gateway integrating top Generative AI APIs.
Ranked Top 5 worldwide on SWE-Bench.

Stackforce AI infers this person is a SaaS expert specializing in AI and distributed systems.

Contact

Skills

Core Skills

Large Language Models (llm)Distributed SystemsGenerative AiAws SagemakerMachine LearningDatabasesWeb Development

Other Skills

Algorithm DesignAmazon DynamoDBAmazon S3Amazon SQSC++Cascading Style Sheets (CSS)Data StructuresDatabricks ProductsDockerDropwizardElasticsearchExpress.jsFlaskFull-Stack DevelopmentHTML

About

Aspiring to solve real-world problems through technology, with a focus on building scalable distributed systems powered by advancements in AI.

Experience

Harness

Senior Software Engineer II - AI

Jan 2025 – Present · 1 yr 2 mos · Bengaluru, Karnataka, India · Hybrid

Leading development on the Harness AI Code Agent. Ranked Top 5 worldwide on SWE-Bench.

Large Language Models (LLM)Distributed SystemsAlgorithm DesignJavaMachine Learning

Atlassian

2 roles

Software Development Engineer II, ML Platform

Apr 2023 – Jan 2025 · 1 yr 9 mos · Bengaluru, Karnataka, India · Remote

AI Gateway
Led the development of AI Gateway, a centralized service integrating Generative AI APIs from providers like OpenAI, Google Gemini, and AWS Bedrock, along with self-hosted models. Drove the deployment and productionization of large open-source Gen-AI models (Llama, Mixtral, Phi) on AWS SageMaker, enhancing model performance and scalability through infrastructure tuning and optimization strategies.
ML Studio
Built the foundations for ML Studio, a platform enabling teams to create jobs for analyzing user generated content, training models, and performing large-scale data transformations.
Atlassian Analytics
Contributed to the successful launch of Atlassian Analytics by increasing data reliability, ensuring that no event loss occurs within the Jira to data lake replication pipeline.

Generative AIAWS SageMakerPerformance TestingMachine LearningData Structures

Software Developer, Transactional Data Platform

Jul 2021 – Mar 2023 · 1 yr 8 mos · Bengaluru, Karnataka, India · Remote

Building an enterprise-grade key-value store as a PaaS, transforming how Atlassian manages OLTP data stores with low-latency, high-throughput, and predictable access patterns.

DatabasesJavaPerformance Testing

Flipkart

SDE Intern

Apr 2020 – Jun 2020 · 2 mos

Developed two microservices for the Liquidation Bidding Portal to automate auction and bundle management. Led the UI effort to build the Bidding Portal offering functionalities to view and participate in auctions.

JavaWeb DevelopmentMicroservices