rustyverse/rustytorch
2
0
Fork 0
Code Issues Pull Requests Actions 6 Packages Projects Releases Wiki Activity

rtx-csm: docs/perf_history — add watermarker backend matrix (SilentCipher row)

Browse Source 
Captures the Phase 10 work in the consolidated perf doc. New section
"Watermarker backend matrix" lists AudioSeal (Meta) and SilentCipher
(Sesame's actual) side by side with measured RTF, capacity, conflicts,
and a per-use-case recommendation table.

Headline: SilentCipher is Sesame's literal production watermarker, now
shipping in pure candle with bit-perfect round-trip on real LibriSpeech
audio (15/15 codes, confidence 1.0000) and ~10× smaller than AudioSeal
(~3M params vs ~30M). The "blow them out of the water" item from the
Sesame gap analysis is closed.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
This commit is contained in:
osobh
2026-04-27 13:27:28 -07:00
co-authored by Claude Opus 4.7
parent 385858a3ba
commit c92e8f2eef
1 changed files with 31 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
crates/models/rtx-csm/docs/perf_history.md
+31
View File
@@ -105,6 +105,37 @@ own commit.
| Moonshine KV cache + profile binary (8.9) | RTF 0.0294 × (~34× faster than realtime) | `95015c1` | | Moonshine KV cache + profile binary (8.9) | RTF 0.0294 × (~34× faster than realtime) | `95015c1` |
| **Moonshine in converse_server (8.10)** | **TTFA -80 % (4915 ms → 939 ms)** vs Kyutai+warmup | `932a93c` | | **Moonshine in converse_server (8.10)** | **TTFA -80 % (4915 ms → 939 ms)** vs Kyutai+warmup | `932a93c` |
## Watermarker backend matrix
Two watermarkers ship in rtx-csm. Both shaped behind the same
`Watermarker` trait + `ResampledWatermarker(24 kHz <-> 16 kHz)`.
| Backend | Capacity | Embed RTF | Detect RTF | Conflicts | Notes |
|---------|----------|-----------|------------|-----------|-------|
| AudioSeal (Meta) | 16 bits | not timed | not timed | none | Per-sample presence map. ~30M params total. Phase 4 |
| **SilentCipher (Sesame)** | ~24 bits | 0.10× | 0.14× | none | **Sesame's actual production watermarker.** ~3M params. Phase 10. |
Both bit-perfect on `/tmp/asr_test.flac` round-trip with `0xCAFE`
message: AudioSeal 16/16 bits, SilentCipher 15/15 codes, both with
mean_presence/confidence 1.0000.
End-to-end through the full converse_server WS pipeline (24 → 16 →
24 kHz resample, mock LLM, Q8 + Kyutai): SilentCipher confidence
0.7614, message 0xCAFE recovered cleanly (above the 0.7 threshold
used for `Option<u16>` mapping).
### Recommendation
| Use case | Watermarker |
|----------|-------------|
| Literal Sesame parity (production CSM watermark identity) | **SilentCipher** |
| Per-sample presence map (e.g. clip detection, diff localization) | AudioSeal |
| Either / don't care | SilentCipher (smaller, identical bit accuracy on real audio) |
Build flags:
- AudioSeal: `--watermark-generator <safetensors> --watermark-detector <safetensors>`
- SilentCipher: `--watermark-silentcipher hf` (or local dir with the 3 .ckpt files)
## STT backend matrix (final) ## STT backend matrix (final)
Three STT backends now ship in rtx-csm, tested on the same 10.43 s Three STT backends now ship in rtx-csm, tested on the same 10.43 s