docs: continuous_improvement evidenced via self_audit — 7 of 12
With briefs in the record, the audit named the planted brief/condition mismatch as a setup defect and proposed the brief change, and independently found its own earlier quoting failures and proposed the fix already made. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
9ca71e5fa4
commit
509b7ceb89
@@ -65,7 +65,7 @@ holding (it was 55 of 85 dangling once).
|
|||||||
| `codebase_research` | code_archeologist architecture_mapper flow_tracer vault_scribe | research_readonly | 11 | **yes** — first run 2026-09-22 |
|
| `codebase_research` | code_archeologist architecture_mapper flow_tracer vault_scribe | research_readonly | 11 | **yes** — first run 2026-09-22 |
|
||||||
| `papers_research` | domain_scout paper_reader library_curator | research_web_readonly | 8 | **yes** — first run 2026-09-22 |
|
| `papers_research` | domain_scout paper_reader library_curator | research_web_readonly | 8 | **yes** — first run 2026-09-22 |
|
||||||
| `insight_research` | implementation_tracker novelty_hunter publication_drafter | research_readonly | 8 | no |
|
| `insight_research` | implementation_tracker novelty_hunter publication_drafter | research_readonly | 8 | no |
|
||||||
| `continuous_improvement` | brain_inspector improvement_proposer improvement_evaluator | research_readonly | 7 | **finds real patterns; diagnosis blocked by the record (fixed, unre-run)** |
|
| `continuous_improvement` | brain_inspector improvement_proposer improvement_evaluator | research_readonly | 7 | **evidenced** — `self_audit` recipe; diagnosed a planted cause and found a real one |
|
||||||
|
|
||||||
**Six of twelve are evidenced.** `backend` was exercised on 2026-09-22,
|
**Six of twelve are evidenced.** `backend` was exercised on 2026-09-22,
|
||||||
the first time anything had been staffed from it: all five roles
|
the first time anything had been staffed from it: all five roles
|
||||||
@@ -184,6 +184,29 @@ followed:
|
|||||||
Counts, pattern-vs-incident discipline and verbatim evidence: shown. A
|
Counts, pattern-vs-incident discipline and verbatim evidence: shown. A
|
||||||
correct diagnosis of a cause: not yet shown, and until now not possible.
|
correct diagnosis of a cause: not yet shown, and until now not possible.
|
||||||
|
|
||||||
|
**Re-run with the fixes (mission 01a0cb54) — evidenced.** A second planted
|
||||||
|
pair, whose lines now carry their briefs, joined the record (11 lines: 5 MET,
|
||||||
|
6 UNMET). Launched again with nothing but `template_kind` and a repo, the
|
||||||
|
audit copied the record into the checkout, and the judge confirmed its counts
|
||||||
|
by grep against that copy. It passed on iteration 0. Its findings:
|
||||||
|
|
||||||
|
- **The planted pattern, diagnosed correctly.** *"The requirement appeared in
|
||||||
|
the condition but not in the brief, so the agent was never asked to write
|
||||||
|
it … a setup defect."* The proposal is the right one: the brief, old wording
|
||||||
|
quoted, new wording asking for the section.
|
||||||
|
- **A pattern nobody planted.** Its own two earlier UNMET audits (v3, and
|
||||||
|
01a0cb3f's first attempt) were judged for the same missing thing. It noted
|
||||||
|
that their briefs predate the record carrying briefs, so it could not tell
|
||||||
|
what those agents were told, and proposed "copy the record, quote verbatim".
|
||||||
|
That is the fix made by hand in `9ca71e5`, found independently from the
|
||||||
|
record alone.
|
||||||
|
|
||||||
|
**Seven of twelve.** Limits: the planted pattern is one shape (brief omits a
|
||||||
|
condition's requirement); the pre-fix lines still render two missions as
|
||||||
|
`01a0cb38`, which the audit counted correctly as two lines; and it proposes
|
||||||
|
into a markdown file. Nothing reads `research/IMPROVEMENT-AUDIT.md` or files
|
||||||
|
`level_up_proposals` from it.
|
||||||
|
|
||||||
**Two of the remaining six are still unevidenced**, and the other four
|
**Two of the remaining six are still unevidenced**, and the other four
|
||||||
are blocked on a target stack. The other nine are well-formed scaffolding:
|
are blocked on a target stack. The other nine are well-formed scaffolding:
|
||||||
roles, prompts, brain seeds and resolving skills, and no run behind any of
|
roles, prompts, brain seeds and resolving skills, and no run behind any of
|
||||||
|
|||||||
Reference in New Issue
Block a user