Whole-workspace rustfmt pass picked up while iterating on Mamba GPU
backward work. Verified formatting-only via diff sampling; no logic
changed.
Co-Authored-By: Claude Sonnet 5 <[email protected]>
Demos:
- rtx-distllm-demo: real rtx-tensor weights per shard, real
scaled-dot-product attention forward, metrics measured (Instant)
instead of hardcoded constants; network topology remains a documented
simulation fed by real tensor byte sizes.
- rtx-model-zoo: MockInferenceEngine deleted; RealInferenceEngine loads
a tiny real transformer into rtx_inference::InferenceEngine and runs
genuine engine.infer per request; domain outputs are explicitly-
labeled toy proxies derived from real output tokens.
- rtx-inference-profiler: mock models deleted; profiles real
matmul/softmax pipelines on rtx-tensor with measured latency/memory.
Inference-path bugs the demos surfaced (fixed here):
- ForwardPass::apply_embedding misused Tensor::gather for the embedding
lookup — gather returns the indices' shape, silently dropping the
hidden dim and breaking every downstream broadcast. Now uses the
existing Tensor::embedding_lookup ([vocab,hidden] x [batch,seq] ->
[batch,seq,hidden]).
- Attention weight lookup accepts both self_attn. (HF-LLaMA) and
attention. prefixes; final layer norm accepts norm.weight /
model.norm.weight / ln_f.weight aliases.
- Integration fixture gains the final norm weight; the previously
always-failing engine tests now pass (8/8 model_loading_test).
End-to-end inference through the real engine now works for the first
time — verified via model_zoo_demo producing real forward-pass outputs
across all categories.
Co-Authored-By: Claude Fable 5 <[email protected]>
demos/{rtx-mre,rtx-bioheat,rtx-hemodynamics} defaulted to [cpu, openblas, metal],
which broke cargo build --workspace on BOTH platforms:
- openblas: no system lib on macOS + buggy on arm64 (sgemm returns zeros, per rtx-tensor note)
- metal: objc2 deps are macOS-only, so enabling it on Linux fails to resolve
Default to cpu only; openblas/metal/accelerate remain opt-in per platform.
Co-Authored-By: Claude Opus 4.8 <[email protected]>
The workspace root was upgraded to thiserror = "2" in an earlier commit,
but 56 per-crate Cargo.toml files still independently declared "1.0".
These crates do not use workspace.dependencies inheritance for thiserror.
All updated to thiserror = "2" for complete fleet alignment.
Includes: rtx-backend, rtx-tensor, rtx-losses, rtx-backend-cuda/rocm/metal,
all training crates (rtx-auto, rtx-rl, rtx-distributed, rtx-federated, etc.),
specialized crates (rtx-science, rtx-platform, rtx-nmf, rtx-neuro-*),
production crates (rtx-streaming, rtx-serving-api), and all demo crates.
cargo check --workspace: PASSES.
