From 509b7ceb891251ea1669893e0e45cbd613e4f6cf Mon Sep 17 00:00:00 2001 From: Omar Sobh Date: Tue, 22 Sep 2026 18:01:15 -0500 Subject: [PATCH] =?UTF-8?q?docs:=20continuous=5Fimprovement=20evidenced=20?= =?UTF-8?q?via=20self=5Faudit=20=E2=80=94=207=20of=2012?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit With briefs in the record, the audit named the planted brief/condition mismatch as a setup defect and proposed the brief change, and independently found its own earlier quoting failures and proposed the fix already made. Co-Authored-By: Claude Opus 5.5 (1M context) --- docs/TEMPLATE-MATURITY.md | 25 ++++++++++++++++++++++++- 1 file changed, 24 insertions(+), 1 deletion(-) diff --git a/docs/TEMPLATE-MATURITY.md b/docs/TEMPLATE-MATURITY.md index ef8c68b..b338dae 100644 --- a/docs/TEMPLATE-MATURITY.md +++ b/docs/TEMPLATE-MATURITY.md @@ -65,7 +65,7 @@ holding (it was 55 of 85 dangling once). | `codebase_research` | code_archeologist architecture_mapper flow_tracer vault_scribe | research_readonly | 11 | **yes** — first run 2026-09-22 | | `papers_research` | domain_scout paper_reader library_curator | research_web_readonly | 8 | **yes** — first run 2026-09-22 | | `insight_research` | implementation_tracker novelty_hunter publication_drafter | research_readonly | 8 | no | -| `continuous_improvement` | brain_inspector improvement_proposer improvement_evaluator | research_readonly | 7 | **finds real patterns; diagnosis blocked by the record (fixed, unre-run)** | +| `continuous_improvement` | brain_inspector improvement_proposer improvement_evaluator | research_readonly | 7 | **evidenced** — `self_audit` recipe; diagnosed a planted cause and found a real one | **Six of twelve are evidenced.** `backend` was exercised on 2026-09-22, the first time anything had been staffed from it: all five roles @@ -184,6 +184,29 @@ followed: Counts, pattern-vs-incident discipline and verbatim evidence: shown. A correct diagnosis of a cause: not yet shown, and until now not possible. +**Re-run with the fixes (mission 01a0cb54) — evidenced.** A second planted +pair, whose lines now carry their briefs, joined the record (11 lines: 5 MET, +6 UNMET). Launched again with nothing but `template_kind` and a repo, the +audit copied the record into the checkout, and the judge confirmed its counts +by grep against that copy. It passed on iteration 0. Its findings: + +- **The planted pattern, diagnosed correctly.** *"The requirement appeared in + the condition but not in the brief, so the agent was never asked to write + it … a setup defect."* The proposal is the right one: the brief, old wording + quoted, new wording asking for the section. +- **A pattern nobody planted.** Its own two earlier UNMET audits (v3, and + 01a0cb3f's first attempt) were judged for the same missing thing. It noted + that their briefs predate the record carrying briefs, so it could not tell + what those agents were told, and proposed "copy the record, quote verbatim". + That is the fix made by hand in `9ca71e5`, found independently from the + record alone. + +**Seven of twelve.** Limits: the planted pattern is one shape (brief omits a +condition's requirement); the pre-fix lines still render two missions as +`01a0cb38`, which the audit counted correctly as two lines; and it proposes +into a markdown file. Nothing reads `research/IMPROVEMENT-AUDIT.md` or files +`level_up_proposals` from it. + **Two of the remaining six are still unevidenced**, and the other four are blocked on a target stack. The other nine are well-formed scaffolding: roles, prompts, brain seeds and resolving skills, and no run behind any of