feat(judge): Kimi as a fallback independent judge when GLM cannot answer
deploy / test (push) Successful in 5m32s
deploy / build (push) Successful in 6m4s

GLM's plan limit ran out for the second time in a month, and with one judge
every conditioned phase on every mission fails until it resets. When the
primary independent judge errors, CLAWMATES_VALIDATOR_FALLBACK_MODEL (prod:
kimi:kimi-for-coding) judges instead, through the same independence checks
(one shared function) plus one more: never the primary's own family.

Measured first: judge-eval 15 cases x 3, kimi-for-coding 44/45 vs glm-5.3
43/45; goodhart — the false positive that once ruled Kimi out — 3/3.

When both fail, the primary's error leads so the phase runner still reads the
z.ai plan-limit code and does not spend the pass. Prod's kimi provider moved
to the anthropic format the eval used (host config, backed up).

Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
This commit is contained in:
Omar Sobh
2026-09-23 07:32:41 -05:00
co-authored by Claude Opus 5.5
parent a13f01e09c
commit abfba832e1
3 changed files with 167 additions and 2 deletions
@@ -123,6 +123,11 @@ services:
# so the shape is compatible — but the headroom is why the evaluator's
# max_tokens was raised alongside this.
CLAWMATES_VALIDATOR_MODEL: glm:glm-5.3
# Second independent judge, used only when GLM cannot answer (its plan
# limit ran out twice in a month). Needs the `kimi` provider in
# anthropic format (base_url https://api.kimi.com/coding). judge-eval:
# 44/45 vs glm-5.3's 43/45, goodhart 3/3.
CLAWMATES_VALIDATOR_FALLBACK_MODEL: kimi:kimi-for-coding
CLAWMATES_JUDGE_MODEL: glm:glm-5.3
# The §15 door is closed by default since 2026-09-20: with no governor
# and no CLAWMATES_DOOR_POLICY=allow every outbound action is denied.