Sourav Singh — CEO
In December 2025, I hit 10 years in the industry. I took the last week of the year off - not for vacation, but to reflect. A decade as a Lead SDET. Hundreds of releases shipped. Countless bugs caught. Automation frameworks built from scratch. And one question I couldn't stop thinking about: What comes next ? Earlier that year, I'd built something that surprised me. A production-grade mock platform - Python, FastAPI, React. A stack I barely knew. POC in a weekend. Full platform shipped in 3 months, while doing my regular tasks. It's served over 3 million requests till date. Teams across our org use it daily to spin up API mocks in seconds - paste a curl, get a mock. No code. No deployment. I built it using AI assistance. Just prompting. And sitting in that reflection week, I realised something uncomfortable : I can build with AI. I have no idea how to test AI. Ten years of testing experience. Automation frameworks, complex systems, enterprise QA strategies that's my world. But evaluating LLM outputs ? Measuring generation quality ? Testing non-deterministic systems ? I don't have a methodology. Yet. So as 2025 ended, I made a decision : I'm spending 2026 fixing that gap - publicly. 52 weeks. Learning GenAI testing from the ground up. Documenting everything : the progress, the confusion, the mistakes. I'm not positioning myself as an expert. I'm a testing veteran who proved you can build with AI, and is now figuring out how to test AI. There's a difference. What I've shipped : A production grade platform serving 1.5M+ requests What I'm learning : How to actually evaluate AI systems What I'm building toward : LLMTestKit - an open-source GenAI testing framework If you've built something with AI and felt that same gap - you're not alone. If you're already doing GenAI testing in production - I'd love to learn from you. This is my Year 11. Let's see where it goes. GitHub: srvsngh99 | YouTube: @SouravAILabs
Stackforce AI infers this person is a Lead SDET with expertise in Automation and GenAI testing in the Fintech sector.
Location: Bengaluru, Karnataka, India
Experience: 10 yrs 4 mos
Skills
- Automation Architect
- Leadership
- Mobile Testing
Career Highlights
- Built a production-grade mock platform serving over 3 million requests.
- Transitioning from building with AI to testing AI systems.
- Documenting a year-long journey to learn GenAI testing.
Work Experience
CRED
Lead SDET (7 mos)
Senior SDET (3 yrs 7 mos)
One97 Communications Limited
Senior Quality Assurance Engineer (2 yrs 9 mos)
Tata Consultancy Services
System Engineer (4 yrs)
Education
Bachelor of Engineering - BE at New Horizon College of Engineering