rustytorch

Author	SHA1	Message	Date
osobhandClaude Sonnet 5	4aaa36a57a	style: cargo fmt --workspace (whitespace/wrapping only, no semantic change) Whole-workspace rustfmt pass picked up while iterating on Mamba GPU backward work. Verified formatting-only via diff sampling; no logic changed. Co-Authored-By: Claude Sonnet 5 <[email protected]>	2026-08-10 07:09:36 -07:00
Omar SobhandClaude Sonnet 4.6	4ae0c34537	feat(batch11): WSD LR scheduler, KV CPU offloading, GQA KV head expansion CI / CI Success (push) Failing after 0s Details CI / Format Check (push) Failing after 9s Details CI / Build CPU-Only (Explicit) (push) Failing after 1m6s Details CI / Clippy Check (push) Failing after 19s Details Documentation / Build API Documentation (push) Failing after 10s Details GPU Tests / Check GPU Availability (push) Successful in 0s Details Documentation / Build User Guide (push) Successful in 11s Details Performance Benchmarks / Run Benchmarks (push) Failing after 38s Details CI / Build (ubuntu-latest) (push) Failing after 54s Details GPU Tests / CUDA Tests (11.8) (push) Has been skipped Details GPU Tests / CUDA Tests (12.1) (push) Has been skipped Details CI / Build (macos-latest) (push) Failing after 59s Details CI / Test (macos-latest) (push) Has been skipped Details CI / Test (ubuntu-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped Details CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped Details CI / WASM Build + Size Check (push) Has been skipped Details CI / Distributed Training Tests (push) Has been skipped Details GPU Tests / Metal Tests (push) Has been skipped Details - WSD scheduler (Warmup-Stable-Decay / trapezoidal): linear warmup → constant plateau → cosine/linear/sqrt decay; extend_stable() adds steps mid-run without restart; phase_at()/decay_progress() introspection; 26 tests + 2 doctests - KV CPU offloading: KvCpuOffloadManager LRU-based GPU→CPU page spill with on-demand prefetch; insert() auto-offloads when at gpu_page_limit; stats() with hit rate and utilization; 14 tests - GQA KV head expansion: GqaConfig validates num_q_heads/num_kv_heads divisibility; expand_kv_heads() tiles KV [batch,kv_heads,seq,dim]→[batch,q_heads,seq,dim]; gqa_attention_cpu() with numerically stable softmax + causal mask; 15 tests Co-Authored-By: Claude Sonnet 4.6 <[email protected]>	2026-06-27 05:28:27 +00:00