Commit Graph
2 Commits
Author SHA1 Message Date
osobhandClaude Sonnet 5 4aaa36a57a style: cargo fmt --workspace (whitespace/wrapping only, no semantic change)
Whole-workspace rustfmt pass picked up while iterating on Mamba GPU
backward work. Verified formatting-only via diff sampling; no logic
changed.

Co-Authored-By: Claude Sonnet 5 <[email protected]>
2026-08-10 07:09:36 -07:00
Omar SobhandClaude Sonnet 4.6 6daa20c94b feat(batch15): Shampoo optimizer, beam search decoder, sliding window attention
CI / Format Check (push) Failing after 14s
CI / Clippy Check (push) Failing after 18s
Documentation / Build API Documentation (push) Failing after 27s
CI / Build (ubuntu-latest) (push) Failing after 58s
GPU Tests / Check GPU Availability (push) Successful in 0s
Documentation / Build User Guide (push) Successful in 13s
GPU Tests / CUDA Tests (12.1) (push) Has been skipped
GPU Tests / CUDA Tests (11.8) (push) Has been skipped
Performance Benchmarks / Run Benchmarks (push) Successful in 1m55s
CI / Build CPU-Only (Explicit) (push) Failing after 1m18s
CI / Build (macos-latest) (push) Failing after 56s
CI / Test (macos-latest) (push) Has been skipped
CI / Test (ubuntu-latest) (push) Has been skipped
CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped
CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped
CI / WASM Build + Size Check (push) Has been skipped
CI / Distributed Training Tests (push) Has been skipped
CI / CI Success (push) Failing after 0s
GPU Tests / Metal Tests (push) Has been skipped
- ShampooOptimizer: Kronecker-factored L/R preconditioners; Schulz iteration
  for A^{-1/4} (two-pass: inv_sqrt then inv_sqrt of sqrt); spectral-norm
  normalization; large-dim SGD fallback; 16 tests
- BeamSearchDecoder: length normalization (Wu et al. α); n-gram blocking;
  EOS suppression before min_length; DiverseBeamSearchDecoder with per-group
  diversity penalty; 20 tests
- SlidingWindowAttention: causal/bidir window; global tokens attend to all;
  O(n·W) forward_single_head + multi-head forward; AttentionStats sparsity;
  WindowMask; 20 tests

Co-Authored-By: Claude Sonnet 4.6 <[email protected]>
2026-06-27 06:26:31 +00:00