rustyverse/rustytorch
2
0
Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity

rtx-csm: 7-emotion RAVDESS pack — calm/disgust/surprised benched

Browse Source 
Extracted decoder steering vectors for the remaining 3 RAVDESS
emotions (calm, disgust, surprised). Single-seed bench at
seed=42 on Amini context, decoder route, recipe defaults:

  emotion     cos_ctx  WER    transcript
  calm        0.70     0.86   "I'm sorry. Um, I don't know."
                              (natural hesitation markers — the
                              recipe produces semantically-emotion-
                              matched content, not just acoustic
                              shift)
  disgust     0.81     0.93   "For that, that..." (truncated)
  surprised   0.95     2.57   "Too couple, sorry, and that's saying,
                              even a premier and super driver..."
                              (long rambling; voice migrates well,
                              text drifts)

All 7 RAVDESS emotions now produce coherent English on the decoder
route — calm is solid first-shot, disgust truncates, surprised
rambles. Roll N seeds via emotional_speech_n.sh for the latter two.

emotional_speech_guide.md updated with the per-emotion table now
covering all 7. Voice character preservation (cos vs context > 0.7)
holds for every emotion in the pack.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
This commit is contained in:
osobh
2026-04-29 19:29:47 -07:00
co-authored by Claude Opus 4.7
parent f022e14f34
commit e6f8d77328
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
crates/models/rtx-csm/docs/emotional_speech_guide.md
+3 -1
View File
@@ -99,7 +99,9 @@ seeds rolled = 5
| angry | ✓ | 100 | Voice migrates well; text drift on some prompts (URL spam observed once). | | angry | ✓ | 100 | Voice migrates well; text drift on some prompts (URL spam observed once). |
| fearful | ✓ | 7 | Stable on Amini context. | | fearful | ✓ | 7 | Stable on Amini context. |
| sad | ✓ | 7 | Works on decoder route only. **Failed on the backbone route** at every scale we tested 0.15–0.3. The architectural switch was the unlock. | | sad | ✓ | 7 | Works on decoder route only. **Failed on the backbone route** at every scale we tested 0.15–0.3. The architectural switch was the unlock. |
| calm, disgust, surprised | not benched | — | Vectors haven't been extracted; should work but untested. | | calm | ✓ | 42 (1-seed) | First bench produced "I'm sorry. Um, I don't know." (WER 0.86) — natural hesitation markers semantically match the emotion. Roll N seeds for fidelity. |
| disgust | ⚠ | 42 (1-seed) | First bench produced "For that, that..." (WER 0.93, truncated). Probably needs different scale or seed. |
| surprised | ⚠ | 42 (1-seed) | First bench produced fluent but rambling output (cos 0.95, WER 2.57). Voice migrates well; text drifts. Consider N-seed sampling. |
The per-emotion best seed is **context-specific**. Seed 42 wins for happy on The per-emotion best seed is **context-specific**. Seed 42 wins for happy on
both Amini and Carlini contexts, but seed 7 wins for sad/fearful on Amini both Amini and Carlini contexts, but seed 7 wins for sad/fearful on Amini