rustyverse/rustytorch
2
0
Fork 0
Code Issues Pull Requests Actions 6 Packages Projects Releases Wiki Activity
410 Commits 1 Branch 0 Tags
a2086a59decf4b76b06fc684e71d0c2da0ca759c
Commit Graph
2 Commits
Author SHA1 Message Date
osobhandClaude Fable 5 a0bf29461b fix(streaming): real inference backend wiring and lifecycle fixes; full suite green
Documentation / Build User Guide (push) Successful in 6s
Details
Documentation / Build API Documentation (push) Failing after 6s
Details
CI / Build (macos-latest) (push) Failing after 11s
Details
CI / Format Check (push) Failing after 12s
Details
Performance Benchmarks / Run Benchmarks (push) Successful in 45s
Details
CI / Build (ubuntu-latest) (push) Successful in 2m42s
Details
CI / Test (macos-latest) (push) Has been skipped
Details
CI / Test (ubuntu-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (macos-latest) (push) Has been skipped
Details
CI / Python Bindings (maturin) (ubuntu-latest) (push) Has been skipped
Details
CI / WASM Build + Size Check (push) Has been skipped
Details
CI / Distributed Training Tests (push) Has been skipped
Details
CI / Build CPU-Only (Explicit) (push) Failing after 2m58s
Details
CI / Clippy Check (push) Failing after 2m59s
Details
CI / CI Success (push) Failing after 0s
Details 
- token_generator: backend is now an optional real rtx-inference engine
  (RwLock<Option<Arc<InferenceEngine>>>) with ServingTokenizer support;
  set_backend/set_tokenizer plumbing through StreamingServer
- connection_manager: ConnectionPool::acquire no longer errors when the
  idle cache is full — creates fresh connections up to max_connections
- streaming_server: ServerState::Running on construction; stream_inference
  generates one token per step (chunk_size semantics)
- lifecycle bugs surfaced by the newly-compiling integration tests:
  * start(): broadcast control-channel send with zero subscribers was
    treated as fatal ("channel closed") in RealtimePipeline,
    EdgeComputingManager, MonitoringSystem — now tolerated
  * stop(): AdaptiveProcessor/EdgeComputingManager/MonitoringSystem
    awaited worker interval loops that never exit (test hung 5h) —
    workers are now aborted with cancellation-aware join
- integration_tests: removed stale .await on now-synchronous methods

cargo test -p rtx-streaming: 55 lib + 8 integration + 6 aux, all passing.

Co-Authored-By: Claude Fable 5 <[email protected]>
 2026-07-10 15:48:33 -07:00
redclawsystems 4d88dc0584 Initial commit 2026-03-04 00:08:42 +00:00