The M2 fetch bound gave every codec n + n/4 + 4096 stored bytes, but ZFP's fixed-rate mode stores up to 64 bits per value, doubling 4-byte types: 60 of the 2205 zfp_interop datasets (rate 64, f4/i4) failed with 'compressed stream ends early' once M2 and ZFP were merged. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
clawhdf5-format
Pure-Rust HDF5 binary format parsing and writing — no C dependencies.
Features
- Zero-copy superblock, object header, and B-tree parsing
- Chunked dataset read/write with filter pipelines
no_stdsupport (disablestdfeature)- Optional parallel reads via Rayon
- SHA-256 provenance tracking
Usage
use clawhdf5_format::Superblock;
let data = std::fs::read("data.h5").unwrap();
let sb = Superblock::from_bytes(&data).unwrap();
println!("HDF5 version {}.{}", sb.version_major(), sb.version_minor());
License
MIT