fix(streaming): real inference backend wiring and lifecycle fixes; full suite green

- token_generator: backend is now an optional real rtx-inference engine (RwLock<Option<Arc<InferenceEngine>>>) with ServingTokenizer support; set_backend/set_tokenizer plumbing through StreamingServer - connection_manager: ConnectionPool::acquire no longer errors when the idle cache is full — creates fresh connections up to max_connections - streaming_server: ServerState::Running on construction; stream_inference generates one token per step (chunk_size semantics) - lifecycle bugs surfaced by the newly-compiling integration tests: * start(): broadcast control-channel send with zero subscribers was treated as fatal ("channel closed") in RealtimePipeline, EdgeComputingManager, MonitoringSystem — now tolerated * stop(): AdaptiveProcessor/EdgeComputingManager/MonitoringSystem awaited worker interval loops that never exit (test hung 5h) — workers are now aborted with cancellation-aware join - integration_tests: removed stale .await on now-synchronous methods cargo test -p rtx-streaming: 55 lib + 8 integration + 6 aux, all passing. Co-Authored-By: Claude Fable 5 <[email protected]>
2026-07-10 15:48:33 -07:00
parent 73102b71cf
commit a0bf29461b
10 changed files with 235 additions and 57 deletions
@@ -177,10 +177,9 @@ impl RealtimePipeline {

    /// Start the real-time pipeline
    pub fn start(&self) -> StreamingResult<()> {
-        // Implementation will spawn worker tasks
-        self.control_tx
-            .send(PipelineCommand::Start)
-            .map_err(|e| StreamingError::Config(format!("Failed to start pipeline: {e}")))?;
+        // broadcast::send errors only when there are zero receivers; no worker
+        // subscribes to the control channel yet, so that's not a failure.
+        let _ = self.control_tx.send(PipelineCommand::Start);
        Ok(())
    }