Discussion about this post

User's avatar
Halfcycle's avatar

The day-two run is the most useful part of this. The district scope is the moment I'd underline: the written requirements said "the whole open list", the agent asked anyway, and "use your judgment" handed the decision straight back to it. That is a scope change made by default with a question attached. The CSV button and the new permission boundary also got the same process, which is the cost of a fixed set of skills: it can't tell a small change from a scope change. We built Halfcycle to size the questions to the change and keep each answer on record for the next feature. If you run day two again, try npx halfcycle on the same CSV request and see what it asks. Did anyone notice the scope narrowing before testing?

antonia's avatar

Suggested answers being a trap is the finding I'd pass on to teams: a recommended default in a multiple-choice question gets accepted like a cookie banner. Answering from a one-page spec written before the session fixes that, and it gives the reviewer at each checkpoint something to check against.

Ready for more?