rustytorch

Author	SHA1	Message	Date
osobhandClaude Sonnet 5	4aaa36a57a	style: cargo fmt --workspace (whitespace/wrapping only, no semantic change) Whole-workspace rustfmt pass picked up while iterating on Mamba GPU backward work. Verified formatting-only via diff sampling; no logic changed. Co-Authored-By: Claude Sonnet 5 <[email protected]>	2026-08-10 07:09:36 -07:00
Omar SobhandClaude Sonnet 4.6	54a9652041	feat(batch16): SOAP optimizer, lookahead decoding, SWA+SWAG CI / Format Check (push) Failing after 13s Details CI / Build (ubuntu-latest) (push) Failing after 1m5s Details GPU Tests / CUDA Tests (11.8) (push) Has been skipped Details GPU Tests / CUDA Tests (12.1) (push) Has been skipped Details Documentation / Build API Documentation (push) Failing after 1m8s Details Performance Benchmarks / Run Benchmarks (push) Successful in 1m54s Details CI / Clippy Check (push) Failing after 1m16s Details Documentation / Build User Guide (push) Successful in 12s Details GPU Tests / Check GPU Availability (push) Successful in 0s Details CI / Build CPU-Only (Explicit) (push) Failing after 3m21s Details CI / Build (macos-latest) (push) Failing after 58s Details CI / Test (macos-latest) (push) Has been skipped Details CI / Test (ubuntu-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped Details CI / WASM Build + Size Check (push) Has been skipped Details CI / Distributed Training Tests (push) Has been skipped Details CI / CI Success (push) Failing after 1s Details GPU Tests / Metal Tests (push) Has been skipped Details - SoapOptimizer: Adam in Shampoo eigenbasis (arXiv:2409.11321); Jacobi eigendecomposition for L/R Kronecker factors; projection G_hat=Q_L^T@G@Q_R, bias-corrected Adam, unproject U=Q_L@U_hat@Q_R^T; 1D plain Adam fallback; 19 tests - LookaheadDecoder: NGramCache (FIFO eviction, count-sorted candidates); draft-then-verify loop; auto-cache update on accepted tokens; LookaheadStats with avg_tokens_per_step; 22 tests - SwaTrainer+SwagBuffer: cyclic cosine LR schedule; online incremental mean (SwaBuffer); E[θ²]-E[θ]² diagonal variance + low-rank deviation columns; Box-Muller SWAG sample; 29 tests Co-Authored-By: Claude Sonnet 4.6 <[email protected]>	2026-06-27 06:43:23 +00:00