clawsync

33 Commits 6 Branches 0 Tags

3 Commits

Include renames

Author	SHA1	Message	Date
Omar Sobh	47b90dd281	test(clawsync-transport): cover SyncPeer/PipeHalves via mmap backend SDLC-Coverage TDD pass: peer.rs went from 74.66% → 89.04% region coverage by adding 6 focused unit tests against the mmap variant of SyncPeer (and its split halves): - send/recv roundtrip on SyncPeer::Mmap - shutdown is a no-op Ok(()) - as_stream_peer / quic_conn_clone return None for non-matching variants - close_quic is a safe no-op for non-QUIC peers - into_pipe_halves yields Mmap halves that roundtrip a SyncMessage - PipeWriteHalf::shutdown and shutdown_push delegate cleanly TCP and QUIC variants of these paths are already exercised by the existing e2e_sync / e2e_quic_sync integration tests; the mmap variant had zero direct unit coverage. No production code changed; tests only.	2026-05-19 13:24:58 -07:00
osobhandClaude Sonnet 4.6	1c107fe58a	Apply rustfmt to entire workspace Runs cargo fmt --all; all 573 tests still passing, clippy still clean. No logic changes — formatting only. Co-Authored-By: Claude Sonnet 4.6 <[email protected]>	2026-04-04 20:31:33 -05:00
osobhandClaude Sonnet 4.6	260e15f5b6	Initial commit: ClawSync v0.1.0 8-crate pure-Rust workspace for revision-aware HDF5 sync. ## Crates - clawhdf5-onion: ClawOnion VFD — page-level versioned HDF5 storage, binary format, writer/reader, branch DAG, GC, snapshots, provenance - clawsync-core: BLAKE3, xxHash3, FastCDC (+ SIMD NEON), zstd/lz4 - clawsync-onion: IBLT sketch, Merkle tree differ, packet differ/merger, ClawSyncManifest, SyncSelector - clawsync-hdf5: dataset-level manifest, differ, patcher, wire payload reconstruction (apply_received_payloads) - clawsync-transport: TCP, QUIC (quinn 0.11/TLS 1.3), SyncPeer abstraction, length-prefixed rkyv wire protocol (21 SyncMessage variants) - clawsync-agent: OnionMemory, SyncScheduler, TcpSyncBackend, PeerCapabilities negotiation - clawsync-fs: CDC-based delta sync for any file type; FsSyncClient/Server, W=16 pipelining, atomic writes - clawsync-cli: push/pull/serve/hdf5-sync/serve-hdf5/sync/serve-fs + all local management commands; --quic on all network commands ## Key features - IBLT pre-flight: O(revision count) vs rsync's O(file size) - W=16 sliding-window push: 13–15x speedup over stop-and-wait at WAN RTT - Dataset-granular HDF5 sync: only modified datasets transferred - CDC delta for any file type: insertion-stable chunk boundaries - Full revision DAG: branch, merge, rollback, export, snapshot, GC - QUIC transport: TLS 1.3, per-message streams via quinn 0.11 ## Tests ~573 passing (default features); ~589 with --features simd-cdc ## Performance (Apple Silicon) - Reconstruct rev=100: 68 µs (target ≤ 1 ms) - BLAKE3 Rayon 1 MB: 10.3 GiB/s (target ≥ 5 GB/s) - GC 500 revisions: 20.6 µs (target ≤ 2 s) - W=16 vs W=1 at 5 ms RTT: 14.8x speedup - No-op pre-flight at 16 MB: 4 ms vs rsync 35 ms (7.8x) Co-Authored-By: Claude Sonnet 4.6 <[email protected]>	2026-04-04 18:41:22 -05:00

Author

SHA1

Message

Date

Omar Sobh

47b90dd281

test(clawsync-transport): cover SyncPeer/PipeHalves via mmap backend

SDLC-Coverage TDD pass: peer.rs went from 74.66% → 89.04% region
coverage by adding 6 focused unit tests against the mmap variant of
SyncPeer (and its split halves):

- send/recv roundtrip on SyncPeer::Mmap
- shutdown is a no-op Ok(())
- as_stream_peer / quic_conn_clone return None for non-matching variants
- close_quic is a safe no-op for non-QUIC peers
- into_pipe_halves yields Mmap halves that roundtrip a SyncMessage
- PipeWriteHalf::shutdown and shutdown_push delegate cleanly

TCP and QUIC variants of these paths are already exercised by the
existing e2e_sync / e2e_quic_sync integration tests; the mmap variant
had zero direct unit coverage.

No production code changed; tests only.

2026-05-19 13:24:58 -07:00

osobhandClaude Sonnet 4.6

1c107fe58a

Apply rustfmt to entire workspace

Runs cargo fmt --all; all 573 tests still passing, clippy still clean.
No logic changes — formatting only.

Co-Authored-By: Claude Sonnet 4.6 <[email protected]>

2026-04-04 20:31:33 -05:00

osobhandClaude Sonnet 4.6

260e15f5b6

Initial commit: ClawSync v0.1.0

8-crate pure-Rust workspace for revision-aware HDF5 sync.

## Crates
- clawhdf5-onion: ClawOnion VFD — page-level versioned HDF5 storage,
  binary format, writer/reader, branch DAG, GC, snapshots, provenance
- clawsync-core: BLAKE3, xxHash3, FastCDC (+ SIMD NEON), zstd/lz4
- clawsync-onion: IBLT sketch, Merkle tree differ, packet differ/merger,
  ClawSyncManifest, SyncSelector
- clawsync-hdf5: dataset-level manifest, differ, patcher, wire payload
  reconstruction (apply_received_payloads)
- clawsync-transport: TCP, QUIC (quinn 0.11/TLS 1.3), SyncPeer abstraction,
  length-prefixed rkyv wire protocol (21 SyncMessage variants)
- clawsync-agent: OnionMemory, SyncScheduler, TcpSyncBackend,
  PeerCapabilities negotiation
- clawsync-fs: CDC-based delta sync for any file type; FsSyncClient/Server,
  W=16 pipelining, atomic writes
- clawsync-cli: push/pull/serve/hdf5-sync/serve-hdf5/sync/serve-fs +
  all local management commands; --quic on all network commands

## Key features
- IBLT pre-flight: O(revision count) vs rsync's O(file size)
- W=16 sliding-window push: 13–15x speedup over stop-and-wait at WAN RTT
- Dataset-granular HDF5 sync: only modified datasets transferred
- CDC delta for any file type: insertion-stable chunk boundaries
- Full revision DAG: branch, merge, rollback, export, snapshot, GC
- QUIC transport: TLS 1.3, per-message streams via quinn 0.11

## Tests
~573 passing (default features); ~589 with --features simd-cdc

## Performance (Apple Silicon)
- Reconstruct rev=100: 68 µs (target ≤ 1 ms)
- BLAKE3 Rayon 1 MB: 10.3 GiB/s (target ≥ 5 GB/s)
- GC 500 revisions: 20.6 µs (target ≤ 2 s)
- W=16 vs W=1 at 5 ms RTT: 14.8x speedup
- No-op pre-flight at 16 MB: 4 ms vs rsync 35 ms (7.8x)

Co-Authored-By: Claude Sonnet 4.6 <[email protected]>

2026-04-04 18:41:22 -05:00