rustyverse/rustytorch
2
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
437 Commits 1 Branch 0 Tags
3fd4fb7b8c56f93c1a38ee270f4c5870e4affc5e
Commit Graph
3 Commits
Author SHA1 Message Date
osobhandClaude Fable 5 e080748d88 feat(demos,inference): wire simulation demos to real compute; fix embedding lookup and weight-name aliases
GPU Tests / Check GPU Availability (push) Successful in 0s
Details
GPU Tests / Metal Tests (push) Has been skipped
Details
CI / Clippy Check (push) Failing after 7s
Details
Performance Benchmarks / Run Benchmarks (push) Failing after 7s
Details
GPU Tests / CUDA Tests (12.1) (push) Has been skipped
Details
CI / Build CPU-Only (Explicit) (push) Failing after 43s
Details
CI / Format Check (push) Failing after 6s
Details
GPU Tests / CUDA Tests (11.8) (push) Has been skipped
Details
CI / Build (ubuntu-latest) (push) Failing after 7s
Details
Documentation / Build User Guide (push) Successful in 8s
Details
CI / Build (macos-latest) (push) Failing after 9s
Details
CI / Test (macos-latest) (push) Has been skipped
Details
CI / Test (ubuntu-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped
Details
CI / WASM Build + Size Check (push) Has been skipped
Details
CI / Distributed Training Tests (push) Has been skipped
Details
Documentation / Build API Documentation (push) Failing after 48s
Details
CI / CI Success (push) Failing after 0s
Details 
Demos:
- rtx-distllm-demo: real rtx-tensor weights per shard, real
  scaled-dot-product attention forward, metrics measured (Instant)
  instead of hardcoded constants; network topology remains a documented
  simulation fed by real tensor byte sizes.
- rtx-model-zoo: MockInferenceEngine deleted; RealInferenceEngine loads
  a tiny real transformer into rtx_inference::InferenceEngine and runs
  genuine engine.infer per request; domain outputs are explicitly-
  labeled toy proxies derived from real output tokens.
- rtx-inference-profiler: mock models deleted; profiles real
  matmul/softmax pipelines on rtx-tensor with measured latency/memory.

Inference-path bugs the demos surfaced (fixed here):
- ForwardPass::apply_embedding misused Tensor::gather for the embedding
  lookup — gather returns the indices' shape, silently dropping the
  hidden dim and breaking every downstream broadcast. Now uses the
  existing Tensor::embedding_lookup ([vocab,hidden] x [batch,seq] ->
  [batch,seq,hidden]).
- Attention weight lookup accepts both self_attn. (HF-LLaMA) and
  attention. prefixes; final layer norm accepts norm.weight /
  model.norm.weight / ln_f.weight aliases.
- Integration fixture gains the final norm weight; the previously
  always-failing engine tests now pass (8/8 model_loading_test).

End-to-end inference through the real engine now works for the first
time — verified via model_zoo_demo producing real forward-pass outputs
across all categories.

Co-Authored-By: Claude Fable 5 <[email protected]>
 2026-07-09 22:06:29 -07:00
Omar Sobh 16161bb9df deps: align all 56 per-crate Cargo.toml files to thiserror v2 
The workspace root was upgraded to thiserror = "2" in an earlier commit,
but 56 per-crate Cargo.toml files still independently declared "1.0".
These crates do not use workspace.dependencies inheritance for thiserror.
All updated to thiserror = "2" for complete fleet alignment.

Includes: rtx-backend, rtx-tensor, rtx-losses, rtx-backend-cuda/rocm/metal,
all training crates (rtx-auto, rtx-rl, rtx-distributed, rtx-federated, etc.),
specialized crates (rtx-science, rtx-platform, rtx-nmf, rtx-neuro-*),
production crates (rtx-streaming, rtx-serving-api), and all demo crates.

cargo check --workspace: PASSES.
 2026-04-26 11:45:14 -07:00
redclawsystems 4d88dc0584 Initial commit 2026-03-04 00:08:42 +00:00