3 Commits

Include renames

Author	SHA1	Message	Date
osobhandClaude Fable 5	73102b71cf	feat(transformers): real compute in orchestrator modalities and attention planner ... - orchestrator_core: execute_classical is genuine seeded QKV self-attention; execute_flash_attention delegates to rtx_flash_attention::flash_attention_forward (8-head reshape, clear Err on indivisible hidden); execute_hybrid composes the two; execute_edge/execute_distributed return explicit "modality not implemented" errors instead of fake success — which makes the previously-dead fallback_modalities retry loop real. - tensor_core_kernels: AttentionComputationOptimizer::execute dispatches Standard/Online to scaled_dot_product_attention, Flash to rtx-flash-attention, Approximated to an explicit Err (no approximation kernel exists; refuses to compute exact attention under an approximated label). - 10 new always-on tests incl. flash-vs-standard 1e-3 agreement and an Edge->Distributed->Classical fallback end-to-end. - docs/consolidation.md updated: both entries moved from scaffolding/no-op-stub status to real dispatch descriptions. 982 rtx-transformers lib tests pass. Co-Authored-By: Claude Fable 5 <[email protected]>	2026-07-10 07:06:50 -07:00
osobhandClaude Fable 5	4ba1b78215	docs(consolidation): audit outcome — flagged MoE/flash-attn duplicates are not duplicates ... Call-site rewrite pass audited every flagged site; none needed consolidation: metal_moe is an API-consistent backend specialization, modular/router.rs is module-level (not expert-token) routing, glam.rs is disabled dead code with a pre-existing bug (noted for whoever re-enables it), and the three flash-attention "reimplementations" turn out to be planner scaffolding, no-op stubs, and a doc comment — no attention math exists to delegate. jepa_gpu's attention is documented as part of the fused GPU ViT block by design. Verified no regressions: rtx-transformers 961 lib tests pass, jepa_gpu 34/34 with cuda, rtx-training cuda check clean. Co-Authored-By: Claude Fable 5 <[email protected]>	2026-07-09 22:30:35 -07:00
osobhandClaude Fable 5	5f32165184	chore(sweep): delete 43 orphaned source files; document SYCL/demo/duplication status ... Deletions (all verified unreferenced by any mod/include/path declaration; git history preserves them): - rtx-transformers: entire orphaned curriculum/ split (mod.rs holds the real inline implementation), non-_simple graph variants, superseded simmim/jepa_integration files, layers/{sliding_window_attention, positional_encoding,ssm_state_cache_original}, lib_full/lib_minimal/ error_full/error_minimal, orphaned MoE impls (moe_layer, moe_integration). - rtx-distributed/parallel_old.rs; rtx-flash-attention/{core_full, lib_full}.rs; rtx-compress legacy_distillation + structured_pruner. - rtx-tensor/tensor_core.rs; rtx-runtime/{cuda_kernel_ops, cuda_backend_mock}.rs; rtx-memory/{gpu_pool_manager,allocator, pool_type}.rs; rtx-losses/{lib_minimal,lib_full}.rs. Docs honesty: - rtx-backend-sycl marked EXPERIMENTAL SKELETON in crate docs and CLAUDE.md backend table (all ops return NotImplemented). - docs/consolidation.md records canonical MoE (layers/mixture_of_experts) and flash-attention (rtx-flash-attention crate) implementations plus remaining duplicates to consolidate. - CLAUDE.md: meta-crate GPU features noted; simulation-only demos named; serving/streaming mock removal noted. Verified: cargo check --workspace clean (rtx-onnx-codegen pre-broken at HEAD, unrelated); lib tests pass for all touched crates (rtx-runtime's 4 failures pre-exist at HEAD). Co-Authored-By: Claude Fable 5 <[email protected]>	2026-07-09 19:32:21 -07:00