Files

T

osobhandClaude Opus 5.5 6dfd239011 feat(format): bzip2 filter (307), read and write, pure Rust

hdf5plugin's BZip2 failed with UnsupportedFilter(307). The new `bzip2`
feature decodes the single bzip2 stream H5Zbzip2.c stores, bounded by the
chunk size (a truncated stream is an error, not short data), and encodes
at block size cd_values[0] (DatasetBuilder::with_bzip2(level)). It uses the
bzip2 crate's default backend, libbz2-rs-sys, a pure-Rust port of
libbzip2: `cargo tree` shows no cc/cmake, and nothing is compiled from C.

Interop: hdf5plugin writes block sizes 9, 1 and 5+shuffle over the
12-case matrix, read byte for byte; ours at 9 (shuffled) and 1 (not)
reads back through hdf5plugin. Both fail with the decoder removed.

Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>

2026-09-26 00:05:26 -05:00

benches

Merge pull request 'docs(clawhdf5): document DType variants, fix unresolved doc links' (#17 ) from sdlc-docs/clawhdf5-types-20260514-165210 into main

2026-05-14 23:54:48 +00:00

src

Merge branch 'fix/p1-vds' into fix/p1-read-gaps

2026-09-25 22:42:04 -05:00

tests

feat(format): bzip2 filter (307), read and write, pure Rust

2026-09-26 00:05:26 -05:00

Cargo.toml

feat(format): bzip2 filter (307), read and write, pure Rust

2026-09-26 00:05:26 -05:00

README.md

docs: fix stale package names, counts, and CLI subcommands

2026-06-03 11:17:04 +00:00

README.md

clawhdf5

Pure-Rust HDF5 reader/writer — no C dependencies.

Features

Read and write HDF5 files entirely in Rust
Memory-mapped I/O for large files (mmap feature, enabled by default)
Parallel chunk reads via Rayon (parallel feature)
Lazy dataset access for minimal memory usage
h5py-compatible file output

Usage

use clawhdf5::File;

let file = File::open("data.h5").unwrap();
let dataset = file.dataset("/group/data").unwrap();
let values: Vec<f64> = dataset.read_1d().unwrap();

License

MIT