Nitin Singh

Product Manager

Bengaluru, Karnataka, India11 yrs 5 mos experience

Highly StableAI Enabled

Key Highlights

Expert in architecting intelligent infrastructure for engineering organizations.
Pioneered integration of Generative AI for advanced test automation.
Led significant improvements in observability and model reliability.

Stackforce AI infers this person is a Fintech-focused Principal SDET with expertise in AI-driven testing and platform engineering.

Contact

Skills

Core Skills

Artificial Intelligence (ai)Platform EngineeringObservability

Other Skills

PythonDeepEvalAI-driven Recommendation EnginesLangChainLangSmithQuality StrategyCloud-native platformsKubernetesNew RelicDatadogChatOpsSelenium TestingSelenium WebDriverTestNGSelenium

About

I am a Principal SDET and Architect standing at the intersection of Generative AI, Platform Engineering, and Quality Strategy. With over a decade of experience across Fintech, Telecom, and Enterprise SaaS, my career has evolved from writing test scripts to architecting the intelligent infrastructure that powers engineering organizations. Currently, I am focused on solving the challenge of Non-Deterministic Testing—architecting Multi-Stage Evaluation Frameworks (using LangChain, DeepEval, and LangSmith) that validate the accuracy of AI-driven Recommendation Engines. What I bring to the table: 🚀 Innovation: Moving beyond traditional automation to implement LLM Ops and AI Agents for self-healing test architectures. 🏗️ Scale: Designing cloud-native platforms on AWS (Lambda/API Gateway) and Kubernetes that handle fintech-grade transaction volumes. 📊 Observability: Turning data into action using New Relic, Datadog, and custom ChatOps bots that bring real-time alerts directly to developers. I am passionate about "Shift-Left" cultures, Developer Experience (DevEx), and the fascinating chaos of distributed systems.

Experience

11 yrs 5 mos

Total Experience

2 yrs 6 mos

Average Tenure

1 yr 1 mo

Current Experience

Bidgely

Principal SDET

Apr 2025 – Present · 1 yr 1 mo · Bengaluru, Karnataka, India · Remote

GenAI & Recommendation Engine Strategy:
1. Evaluation Architecture: Architected a Multi-Stage Model Evaluation Framework using DeepEval to validate the accuracy of our Energy Recommendation Engine. Implemented automated scoring for metrics like faithfulness and relevancy, ensuring high-fidelity insights for millions of users.
2. GenAI Integration: Spearheaded the integration of Generative AI agents using LangChain to automate complex test scenarios, significantly advancing the organization’s automation maturity.
3. Observability: Implemented LangSmith for tracing and debugging LLM chains, enabling the team to identify latency bottlenecks and improve model reliability in production.
Platform Engineering & Infrastructure:
1. Internal Delivery Platform: Led the stability overhaul of our internal delivery platform, resolving critical bottlenecks in distributed databases (Cassandra) and data extraction pipelines to ensure high availability.
2. Environment Optimization: Drastically reduced "time-to-ready" for engineering environments by resolving infrastructure blockers, enabling faster iteration loops for product teams.
Strategic Delivery & Leadership:
1. Enterprise Client Delivery: Orchestrated the end-to-end technical delivery for major Enterprise Utility Clients, ensuring 100% validation coverage under aggressive timelines.
2. Engineering Leadership: Managed a squad of engineers, establishing a "Shift-Left" quality culture and fostering technical growth through peer reviews and mentorship.

Artificial Intelligence (AI)PythonPlatform Engineering

Refyne india

Quality Assurance Engineering Manager

Nov 2024 – Apr 2025 · 5 mos · Bengaluru, Karnataka, India · On-site

Joined as a hands-on Engineering Manager to overhaul the Quality Engineering landscape. In a short span, I successfully modernised the release lifecycle and stabilised team operations.
Strategic Leadership:
1. Process Overhaul: Managed a team of 5 QA Engineers, restructuring workflows to eliminate team burnout. Collaborated with Product Managers and Developers to realign expectations and streamline the QA backlog.
2. Shift-Left Implementation: Initiated and enforced a "Shift-Left" philosophy specifically for backend services, moving testing earlier in the lifecycle to catch defects instantly.
Technical Wins:
1. CI/CD Maturity: Fixed broken CI/CD processes and integrated the automation framework directly into the pipeline, establishing a reliable "Quality Gate" for releases.
2. Acceleration: Drastically reduced the Dev-to-QA feedback loop by increasing "In-Sprint" automation coverage, allowing the team to deliver faster and safer releases.

Niyo solutions inc.

Lead Software Development Engineer Test

Sep 2018 – Oct 2024 · 6 yrs 1 mo · Bangalore,India · On-site

As a Lead SDET, I focused on Engineering Productivity and Developer Experience (DevEx), building internal tools that bridged the gap between QA, DevOps, and Development.
Developer Experience & Tooling:
1. Release Automation: Architected a custom Automated Release Management framework on top of GitLab, streamlining the deployment process for developers.
2. Observability & Analytics: Built a custom data pipeline (PostgreSQL) to aggregate tech support issues and engineering KPIs, visualizing trends on Grafana dashboards to drive data-driven management decisions.
3. ChatOps: Developed Google Chat bots integrated with test suites to provide real-time feedback and alerts to developer channels.
Test Architecture & Infrastructure:
1. Framework Design: Built and scaled the API Automation framework used across multiple cross-functional teams.
2. Performance Engineering: Wrote high-concurrency performance tests using Gatling (Scala) to validate system reliability.
3. Cloud-Native CI/CD: Modernized the testing infrastructure by containerizing test suites with Docker and orchestrating execution via Kubernetes within the CI/CD pipeline.

Verizon

IT Quality Assurance Analyst - Automation Framework devlopment for Web, Mobile and API

May 2017 – Aug 2018 · 1 yr 3 mos · Greater Chennai Area · On-site

As part of the Vision Automation team, I focused on building scalable tools to automate the Verizon Wireless Backend Systems. I developed utilities that significantly reduced manual effort for the functional testing teams.
Key Innovations:
1. Python & OpenCV Utility: Developed a custom Python script using OpenCV to automate the comparison of billing PDF files, solving a critical challenge in verifying complex billing data.
2. Self-Service Automation Framework: Built a unified scalable framework (Web, Mobile, & API) integrated with a Web UI, allowing non-technical users to trigger automation jobs on-demand.
Responsibilities:
1. Mobile Automation: Automated over 100+ critical scenarios for mobile-first applications using Appium.
2. CI/CD Integration: Integrated web application automation suites with Jenkins to run daily health checks and ensure system stability.
3. Backend Testing: Automated functionality for the "Vision System" (customer data management) using robust API testing strategies.

Mindtree

Senior Test Engineer

Oct 2014 – May 2017 · 2 yrs 7 mos · Greater Chennai Area · On-site

Started my career at Mindtree, rapidly progressing from manual testing to automation and performance engineering. Over this tenure, I took ownership of implementing modern testing frameworks for key clients and internal products.
Key Contributions:
1. Automation & Frameworks: Built and integrated functional testing frameworks with Jenkins CI/CD pipelines to accelerate build delivery.
2. Proof of Concepts (POCs): Spearheaded technical research (POCs) on Rest Assured, Cucumber BDD, Serenity, and Robot Framework to modernize the testing stack.
3. Mobile Testing: Implemented mobile automation for iOS/Android using Appium, significantly reducing regression timelines.
4. Performance Engineering: Executed load and stress testing using Gatling and JMeter to ensure system stability under peak traffic.
5. Product Delivery: Played a key role in the QA success of Mindtree’s internal product ("Short Class") and supported critical production releases, focusing on P1/P2 defect reduction.