A developer built an agentic AI harness to automate game playtesting, exposing a practical blueprint for AI-driven QA loops.
Jeff Schomay published a detailed blog post describing how he built an agentic test harness that lets an LLM autonomously play his game. The system feeds game state to the AI, receives actions, and loops — effectively automating playtesting without human involvement. The post gained 121 upvotes on Hacker News, signaling broad developer interest. No specific commercial tool was released; this is an open architectural blueprint with working code.
This is a working proof-of-concept for replacing manual playtesting with an agent that reads game state, generates actions, and iterates — a loop pattern directly transferable to any stateful app or simulation, not just games. The architecture is straightforward: serialize state to text, prompt an LLM to choose an action, execute it, repeat. The key insight is that LLMs can act as surprisingly capable exploratory testers when given well-structured state representations. This is essentially fuzzing with semantic intent.
Adapt Schomay's state-serialization loop to your own stateful app this week: pick your highest-complexity user flow, serialize the state to JSON, and prompt Claude or GPT-4o to choose the next action — measure how many edge cases it surfaces vs your existing test suite.
Open Claude.ai and start a new conversation
Tags