rustyverse/rustytorch
2
0
Fork 0
Code Issues Pull Requests Actions 46 Packages Projects Releases Wiki Activity
430 Commits 1 Branch 0 Tags
53078c2aa7af77df2e56ba29172bbd50a0aff781
Commit Graph
2 Commits
Author SHA1 Message Date
osobhandClaude Sonnet 5 4aaa36a57a style: cargo fmt --workspace (whitespace/wrapping only, no semantic change) 
Whole-workspace rustfmt pass picked up while iterating on Mamba GPU
backward work. Verified formatting-only via diff sampling; no logic
changed.

Co-Authored-By: Claude Sonnet 5 <[email protected]>
 2026-08-10 07:09:36 -07:00
Omar SobhandClaude Sonnet 4.6 0b06c0fa81 feat(batch28): GpuViTEncoder, distributed grad sync, eval harness
Performance Benchmarks / Run Benchmarks (push) Failing after 7s
Details
CI / Format Check (push) Failing after 11s
Details
Documentation / Build User Guide (push) Successful in 11s
Details
CI / Build (macos-latest) (push) Failing after 29s
Details
CI / Build (ubuntu-latest) (push) Failing after 52s
Details
CI / Clippy Check (push) Failing after 54s
Details
Documentation / Build API Documentation (push) Failing after 52s
Details
CI / Test (macos-latest) (push) Has been skipped
Details
CI / Test (ubuntu-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped
Details
CI / WASM Build + Size Check (push) Has been skipped
Details
CI / Distributed Training Tests (push) Has been skipped
Details
CI / Build CPU-Only (Explicit) (push) Failing after 3m22s
Details
CI / CI Success (push) Failing after 0s
Details 
Gap 1 — GpuViTEncoder + encoder-agnostic JepaTrainerV2 (jepa_gpu.rs, 12 tests):
- ExecutionTarget enum (Cpu | Cuda{device_id}); GpuViTEncoder wraps CpuViTEncoder
- cuda feature: Arc<CudaDevice> + try_allocate_gpu_buffer() via cudarc
- no-cuda: graceful Cpu fallback with correct shapes
- JepaTrainerV2 now holds Box<dyn JepaEncoder> + EmaTargetEncoderDyn
- new_with_encoder() constructor; JepaTrainerV2::new() backward-compatible
- JepaEncoder::l2_normalize gets `where Self: Sized` for dyn-compatibility
- 46 existing jepa_vit tests preserved (zero regressions)

Gap 4 — Distributed gradient sync (jepa_distributed.rs, 15 tests):
- JepaGradSync: single_process / simulated(world_size, rank) / nccl(...)
- sync_gradients(): noop at world_size=1; divides grads by world_size (simulated)
- effective_batch_size(), is_primary(), barrier() stubs
- JepaRunConfig: +world_size/rank/master_addr/master_port fields + TOML parser
- run_jepa_training() wired: creates JepaGradSync, syncs after each step,
  gates logging+checkpointing on is_primary(); summary carries world_size + eff_batch

Gap 6 — JEPA eval harness (jepa_eval.rs + examples/jepa_eval.rs, 15 tests):
- JepaEvalConfig: feature_dim, num_classes, linear probe + kNN params, seed, mode
- EvalMode: LinearProbe / KNN / Both
- run_eval_suite(): LCG-generated L2-normalised features → JepaEvaluator dispatch
- load_features_txt / load_labels_txt / save_eval_csv (stdlib only)
- EvalSuiteResult::summary() and to_csv_row()
- examples/jepa_eval.rs: --mode/--dim/--classes/--train/--test/--epochs/--lr/--k
  --seed/--features/--labels/--test-features/--test-labels/--output CLI flags

Co-Authored-By: Claude Sonnet 4.6 <[email protected]>
 2026-06-27 15:37:30 +00:00