Commit Graph
4 Commits
Author SHA1 Message Date
osobhandClaude Sonnet 5 4aaa36a57a style: cargo fmt --workspace (whitespace/wrapping only, no semantic change)
Whole-workspace rustfmt pass picked up while iterating on Mamba GPU
backward work. Verified formatting-only via diff sampling; no logic
changed.

Co-Authored-By: Claude Sonnet 5 <[email protected]>
2026-08-10 07:09:36 -07:00
Omar SobhandClaude Sonnet 4.6 4ae0c34537 feat(batch11): WSD LR scheduler, KV CPU offloading, GQA KV head expansion
CI / CI Success (push) Failing after 0s
CI / Format Check (push) Failing after 9s
CI / Build CPU-Only (Explicit) (push) Failing after 1m6s
CI / Clippy Check (push) Failing after 19s
Documentation / Build API Documentation (push) Failing after 10s
GPU Tests / Check GPU Availability (push) Successful in 0s
Documentation / Build User Guide (push) Successful in 11s
Performance Benchmarks / Run Benchmarks (push) Failing after 38s
CI / Build (ubuntu-latest) (push) Failing after 54s
GPU Tests / CUDA Tests (11.8) (push) Has been skipped
GPU Tests / CUDA Tests (12.1) (push) Has been skipped
CI / Build (macos-latest) (push) Failing after 59s
CI / Test (macos-latest) (push) Has been skipped
CI / Test (ubuntu-latest) (push) Has been skipped
CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped
CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped
CI / WASM Build + Size Check (push) Has been skipped
CI / Distributed Training Tests (push) Has been skipped
GPU Tests / Metal Tests (push) Has been skipped
- WSD scheduler (Warmup-Stable-Decay / trapezoidal): linear warmup → constant
  plateau → cosine/linear/sqrt decay; extend_stable() adds steps mid-run without
  restart; phase_at()/decay_progress() introspection; 26 tests + 2 doctests
- KV CPU offloading: KvCpuOffloadManager LRU-based GPU→CPU page spill with
  on-demand prefetch; insert() auto-offloads when at gpu_page_limit; stats()
  with hit rate and utilization; 14 tests
- GQA KV head expansion: GqaConfig validates num_q_heads/num_kv_heads divisibility;
  expand_kv_heads() tiles KV [batch,kv_heads,seq,dim]→[batch,q_heads,seq,dim];
  gqa_attention_cpu() with numerically stable softmax + causal mask; 15 tests

Co-Authored-By: Claude Sonnet 4.6 <[email protected]>
2026-06-27 05:28:27 +00:00
osobhandClaude Opus 4.6 02d382d5f6 style: apply rustfmt across all crates and demos
Consistent formatting pass: line wrapping, import sorting, trailing
whitespace removal, let-chain indentation, merged derive attributes,
and unsafe block reformatting.

Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
2026-04-12 07:01:58 -07:00
redclawsystems 4d88dc0584 Initial commit 2026-03-04 00:08:42 +00:00