osobhandClaude Opus 5.5
e7a7951f1e
Blosc2 (32026) is out of reach for now: hdf5plugin's Blosc2 filter stores each HDF5 chunk as a Blosc2 super-chunk frame (msgpack header, a compressed chunk-offset index, trailer metalayers) and, for 2-D and larger chunks, as a B2ND array whose n-D blocks have to be reassembled - on top of the Blosc2 chunk format itself (extended header, filter pipeline, special-value chunks). ZFP (32013) is out of scope. Both keep failing with UnsupportedFilter, and the message now says what the ID is: "unsupported filter: 32026 (Blosc2, not implemented by clawhdf5)", or, for a filter this build left out, "... (Blosc; this build lacks the `blosc` feature)". filter_registry::known_filter exposes the table. tests/plugin_filters_interop.rs: hdf5plugin's Blosc2 and ZFP datasets read as an error naming the filter, never as data. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
clawhdf5
Pure-Rust HDF5 reader/writer — no C dependencies.
Features
- Read and write HDF5 files entirely in Rust
- Memory-mapped I/O for large files (
mmapfeature, enabled by default) - Parallel chunk reads via Rayon (
parallelfeature) - Lazy dataset access for minimal memory usage
- h5py-compatible file output
Usage
use clawhdf5::File;
let file = File::open("data.h5").unwrap();
let dataset = file.dataset("/group/data").unwrap();
let values: Vec<f64> = dataset.read_1d().unwrap();
License
MIT