Skip to content

[bug] Auto interview mode: the required form of an assumed intake answer is hard to find, costing a gate-check round trip #766

Closed

Description

@MendixMau

Field report (Greenfield build, Interview mode: auto, 2026-11-13; relayed by the maintainer, anonymised).

What happened: with "ask me nothing at all", the agent filled intake.md with "Assumed (Interview mode auto)" answers. Its first gate-check failed Stage P, and it passed only after the answers were rewritten in the form the gate parses. Intake still assumes a chat interview, and nothing says what an auto-mode answer must look like.

Asked for: one clear, findable statement, at the point where auto mode is chosen, of the exact answer marker the Stage P gate accepts (and an example). skills/poc-build.md already spells out its own markers for the POC case; the general auto-mode case has no equivalent.

Related: skills/interview-protocol.md (modes), bin/gate-check.sh Stage P, #636, #624.


Filed by the triage desk from a field report. Generated by Claude Code

Activity

  1. MendixMau commented on Nov 16, 2026

    @MendixMau
    OwnerAuthor

    Triage: FIX track. docs-skill, verified (the gate matcher was replayed in a scratch copy)
    Root cause / Problem: the gate already accepts an auto-mode form. bin/gate-check.sh:861 matches ^(answered|answer|a|decision|assumed)\s*(\(...\))?\s*:, so Assumed (Interview mode: auto): … PASSES. Replayed: Assumed (auto) — x (no colon), status: ASSUMED, consentBy: auto-mode and _Assumed (auto-mode)_: x all FAIL.

    Nothing an auto-mode agent reads first shows the accepted form:

    • the intake preamble (bin/lib/intake-template.sh:28-38) lists only Answered (CONFIRMED): and Unverified — how to verify:, and sends ASSUMED answers "to PROJECT.md";
    • skills/interview-protocol.md:73 says "recorded ASSUMED as above", and "above" (:52-57) is the four-field register shape (status: ASSUMED, consentBy: auto-mode), which the intake gate rejects.

    The exact form appears only in the FAIL message (gate-check.sh:895), after the round trip. Only skills/poc-build.md:8 spells out markers in advance.
    Value: M. Every auto-mode kickoff pays one gate-check round trip and a rewrite of all 16 answers. The field report hit exactly this.
    Risk of fixing: L. Text only. The preamble isn't re-synced into existing intakes (sync appends missing questions only, sync-project.sh:421-594), so no existing project changes. Q9's body must stay untouched, because --repair-intake byte-matches it. interview-protocol.md is baseline: about +35 words (66,196 / 80,000 now).
    Rigidity check: no change to the matcher, the gate verdicts or the questions asked.
    Process cost (#687): none at run time. It saves about one gate-check plus a 16-answer rewrite per auto-mode kickoff (est. 2–5 min). Can turn red: n.
    Needs clarification: no
    Learning value: learned rule in skills/interview-protocol.md: in auto mode, each intake answer reads Assumed (auto-mode): <default> — rejected: <alt>, with the colon after the parenthesis.
    Proposed fix:

    • Add a third form to the preamble at intake-template.sh:30: Assumed (auto-mode): … Interview mode: auto only — the recommended default; the full record goes in PROJECT.md.
    • At interview-protocol.md:73, replace "recorded ASSUMED as above" with the literal line plus one example.

    Alternative, not recommended: widen the matcher to accept Assumed (…) — without a colon. That loosens a gate whose history is false greens (:826-854).
    Proof: a new case in tests/wave2/test-stage-p.sh: a fresh scaffold's preamble contains Assumed (auto-mode):, and a section answered that way PASSES. The preamble check fails on master.
    Effort: S. Recommendation: FIX NOW: two text edits that remove a guaranteed round trip.
    Labels: kind/bug, documentation, size/xs

    Reply go (FIX) or go option N (DISCUSS). Fix PRs still get independent review and your merge.


    Generated by Claude Code

  2. added
    documentationImprovements or additions to documentation
    and removed on Nov 16, 2026
  3. MendixMau commented on Nov 16, 2026

    @MendixMau
    OwnerAuthor

    Fix PR opened: #773. It adds the Assumed (auto-mode): ... form to the intake preamble and gives the literal line in interview-protocol.md. It also adds fixture case T12, which fails on master and passes on the branch. Baseline goes 66,196 → 66,227 words. It is waiting for an independent review before merge.


    Generated by Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions