rustytorch

Author	SHA1	Message	Date
osobhandClaude Fable 5	733b02cd8b	feat(inference): concrete EAGLE draft model + real tokenizer at the serving boundary GPU Tests / Check GPU Availability (push) Successful in 1s Details CI / Build (ubuntu-latest) (push) Failing after 6s Details CI / Build (macos-latest) (push) Failing after 11s Details Documentation / Build User Guide (push) Successful in 7s Details CI / Clippy Check (push) Failing after 21s Details CI / Format Check (push) Failing after 6s Details GPU Tests / CUDA Tests (11.8) (push) Has been skipped Details GPU Tests / CUDA Tests (12.1) (push) Has been skipped Details CI / Build CPU-Only (Explicit) (push) Failing after 6s Details GPU Tests / Metal Tests (push) Has been skipped Details CI / Test (macos-latest) (push) Has been skipped Details CI / Test (ubuntu-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped Details CI / WASM Build + Size Check (push) Has been skipped Details CI / Distributed Training Tests (push) Has been skipped Details CI / CI Success (push) Failing after 0s Details Performance Benchmarks / Run Benchmarks (push) Successful in 28s Details Documentation / Build API Documentation (push) Failing after 25s Details EAGLE (rtx-inference/src/eagle.rs, ~610 lines, mirrors medusa.rs conventions): EagleDraftHead autoregressive FFN with Concat/Add/ Attention feature fusion, EagleHeads draft model with draft/ draft_steps (per-step top-k for candidate trees) and teacher-forced training_loss; implements the speculative::EagleDraftModel trait so it plugs into the orchestration layer. 38 unit tests. Tokenizer (rtx-inference/src/tokenizer.rs): ServingTokenizer enum — Vocab (HuggingFace tokenizers, loadable from tokenizer.json) or ByteLevel fallback preserving previous behavior. rtx-serving-api's AppState and rtx-streaming's token generator now encode/decode through it (with_engine_and_tokenizer / set_tokenizer added; existing signatures unchanged). Also fixes two pre-existing compile errors in rtx-streaming (missing import, stray .await) that blocked its lib tests entirely. Tests: rtx-inference 328 pass, rtx-serving-api 193 pass, rtx-streaming 53 pass (2 pre-existing mock-server connection failures unrelated to these changes). Co-Authored-By: Claude Fable 5 <[email protected]>	2026-07-09 21:54:05 -07:00
redclawsystems	4d88dc0584	Initial commit	2026-03-04 00:08:42 +00:00