clawhdf5

226 Commits 3 Branches 12 Tags

3 Commits

Include renames

Author SHA1 Message Date

Author	SHA1	Message	Date
osobhandClaude Opus 5.5	dce5559ff2	bench: re-run every stale BENCHMARKS.md section, dated and traced CI / test-arm64 (pull_request) Successful in 54s Details CI / test (pull_request) Successful in 5m6s Details Every undated or pre-September section re-run on one machine on one day (tank, AMD Ryzen 7 7800X3D, 2026-09-24, commit `5c8323c`), 24 commands run serially with the load average checked before each, with the command recorded for each section. A separate check traced every changed number back to the raw output; its corrections are applied (e.g. the on-disk ~820 B/record is float16 plus always-deflated text on a synthetic corpus of 40 distinct texts, not float16 alone). Two apparent regressions were isolated rather than published: - knowledge-graph traversal: a real bug, fixed in the previous commit; - the write path: v2.3.0 built and run on the same machine measures the same as today, so the old 18 us / 6.17 ms figures (undated, other hardware) are not reproducible; float16 adds ~2 us per save and the int8 index nothing (both isolated by switching the bench's config). Also: - new multimodal_bench: cross-modal search at 1K/10K records, which the README claimed but nothing measured; - footprint_bench reports whether it built float16 or f32 stores and takes --f32 (it kept printing "f32" after the default changed); - README: performance tables, the "Why" table figures and the SQLite migration section (from the previous migrate commit); - CHANGELOG for this branch. Not re-run: consolidation_efficiency's 100K row and its memory-reduction part (stopped for time), and cross_platform.sh. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>	2026-09-24 23:45:15 -05:00
osobhandClaude Fable 5.1	bbe1baa208	ci: lint all targets, run interop suites for real, compile benches - clippy --all-targets plus a clawhdf5-format feature matrix (parallel, lz4, zstd, pcodec, fast-checksum); fix the accumulated lint backlog in test, bench and feature-gated code (no behaviour changes). - Install python3 + h5py/numpy/netCDF4/xarray in the CI container and set CLAWHDF5_REQUIRE_INTEROP=1, which makes a missing interop dependency a test failure. Every h5py/netCDF4 interop test used to skip silently in CI. Run the #[ignore]d writer_h5py_tests suite explicitly. - cargo bench --no-run so benches can't rot; fix bench.rs and memory_bench.rs, which no longer compiled against the current strategy/consolidation APIs. - Optional fuzz smoke run via CLAWHDF5_FUZZ_SECONDS. - CHANGELOG and docs/known-issues.md updated. Co-Authored-By: Claude Fable 5.1 <[email protected]>	2026-09-19 05:36:22 -07:00
redclawsystems	3f222f6956	Merge pull request 'docs(clawhdf5): document DType variants, fix unresolved doc links' (#17 ) from sdlc-docs/clawhdf5-types-20260514-165210 into main	2026-05-14 23:54:48 +00:00

osobhandClaude Opus 5.5

dce5559ff2

bench: re-run every stale BENCHMARKS.md section, dated and traced

CI / test-arm64 (pull_request) Successful in 54s

Details

CI / test (pull_request) Successful in 5m6s

Details

Every undated or pre-September section re-run on one machine on one day
(tank, AMD Ryzen 7 7800X3D, 2026-09-24, commit 5c8323c), 24 commands run
serially with the load average checked before each, with the command
recorded for each section. A separate check traced every changed number
back to the raw output; its corrections are applied (e.g. the on-disk
~820 B/record is float16 plus always-deflated text on a synthetic corpus
of 40 distinct texts, not float16 alone).

Two apparent regressions were isolated rather than published:
- knowledge-graph traversal: a real bug, fixed in the previous commit;
- the write path: v2.3.0 built and run on the same machine measures the
  same as today, so the old 18 us / 6.17 ms figures (undated, other
  hardware) are not reproducible; float16 adds ~2 us per save and the
  int8 index nothing (both isolated by switching the bench's config).

Also:
- new multimodal_bench: cross-modal search at 1K/10K records, which the
  README claimed but nothing measured;
- footprint_bench reports whether it built float16 or f32 stores and
  takes --f32 (it kept printing "f32" after the default changed);
- README: performance tables, the "Why" table figures and the SQLite
  migration section (from the previous migrate commit);
- CHANGELOG for this branch.

Not re-run: consolidation_efficiency's 100K row and its memory-reduction
part (stopped for time), and cross_platform.sh.

Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>

2026-09-24 23:45:15 -05:00

osobhandClaude Fable 5.1

bbe1baa208

ci: lint all targets, run interop suites for real, compile benches

- clippy --all-targets plus a clawhdf5-format feature matrix (parallel, lz4,
  zstd, pcodec, fast-checksum); fix the accumulated lint backlog in test,
  bench and feature-gated code (no behaviour changes).
- Install python3 + h5py/numpy/netCDF4/xarray in the CI container and set
  CLAWHDF5_REQUIRE_INTEROP=1, which makes a missing interop dependency a test
  failure. Every h5py/netCDF4 interop test used to skip silently in CI. Run
  the #[ignore]d writer_h5py_tests suite explicitly.
- cargo bench --no-run so benches can't rot; fix bench.rs and memory_bench.rs,
  which no longer compiled against the current strategy/consolidation APIs.
- Optional fuzz smoke run via CLAWHDF5_FUZZ_SECONDS.
- CHANGELOG and docs/known-issues.md updated.

Co-Authored-By: Claude Fable 5.1 <[email protected]>

2026-09-19 05:36:22 -07:00

redclawsystems 3f222f6956 Merge pull request 'docs(clawhdf5): document DType variants, fix unresolved doc links' (#17 ) from sdlc-docs/clawhdf5-types-20260514-165210 into main 2026-05-14 23:54:48 +00:00