phase2-5 #336

Merged

fuzzy merged 8 commits from feat/rewrite into main

2026-04-19 13:31:29 +00:00

fuzzy commented

2026-04-19 13:24:02 +00:00

Owner

No description provided.

fuzzy added this to the Phase 2: Low-Level CGo Bindings milestone

2026-04-19 13:24:02 +00:00

fuzzy added the

type/feature

type/docs

priority/high

labels

2026-04-19 13:24:02 +00:00

fuzzy self-assigned this

2026-04-19 13:24:02 +00:00

fuzzy added 6 commits

2026-04-19 13:24:02 +00:00

Implement core bz2 wrapper functions e574fdc9ab

- Write C wrapper for BZ2_bzCompressInit (closes #0232)
- Write C wrapper for BZ2_bzCompress (closes #0233)
- Write C wrapper for BZ2_bzCompressEnd (closes #0234)
- Write C wrapper for BZ2_bzDecompressInit (closes #0235)
- Write C wrapper for BZ2_bzDecompress (closes #0236)
- Write C wrapper for BZ2_bzDecompressEnd (closes #0237)
- Implement core bz2 wrapper functions (closes #0238)

Create stream state management 69997c0be2

- Define bzStream struct with C.bz_stream (closes #0239)
- Implement stream allocator and finalizer (closes #0240)
- Add mutex protection for bzStream operations (closes #0241)
- Handle BZ2_bz* error codes consistently (closes #0242)
- Create stream state management (closes #0243)

Implement memory buffer management e1243cbe4b

- Create unsafe.Pointer buffer pool (closes #0244)
- Add buffer size calculation helpers (closes #0245)
- Implement buffer zero-copy where possible (closes #0246)
- Add finalizer cleanup for C allocations (closes #0247)
- Implement memory buffer management (closes #0248)

Build worker pool architecture and chunk-based parallel compression ea618a9aed

- Create WorkerPool struct with sync.WaitGroup (closes #0249)
- Implement work queue with buffered channels (closes #0250)
- Add graceful shutdown and context cancellation (closes #0251)
- Configure dynamic worker count (default: runtime.NumCPU) (closes #0252)
- Build worker pool architecture (closes #0253)
- Design chunk splitter for input io.Reader (closes #0254)
- Create compression job struct (input slice, output slice) (closes #0255)
- Implement parallel compression dispatcher (closes #0256)
- Add chunk reassembly with proper ordering (closes #0257)
- Implement chunk-based parallel compression (closes #0258)

Add stream compression (non-seekable inputs) a3286b075b

- Implement sliding window chunking (closes #0259)
- Create overlap handling for compression boundaries (closes #0260)
- Add metadata header for multi-chunk streams (closes #0261)
- Support single-stream fallback for small inputs (closes #0262)
- Add stream compression (non-seekable inputs) (closes #0263)

feat: implement parallel decompression and integrity validation with checksum support 027a62a744

# Previous message:
Implement parallel decompression and integrity validation

- Detect multi-chunk format header and fallback to single-chunk decompression
- Parallel chunk decompressor with ordered reassembly
- CRC32 and Adler‑32 checksum support with validation
- Update compression format to include checksums and version 2 header

closes: #0268
closes: #0264
closes: #0265
closes: #0266
closes: #0267
closes: #0273
closes: #0269
closes: #0270
closes: #0271
closes: #0272

fuzzy added 2 commits

2026-04-19 13:26:30 +00:00

refactor: simplify stream compression logic and remove parallel compressor usage 27eb87d418

feat: implement public compression API and streaming interfaces c4effca150

# Previous message:
Implement high-level public API and streaming interfaces

- Add NewCompressor/NewDecompressor constructors (closes #0279, closes #0280)
- Add Compress/Decompress methods (closes #0281, closes #0282)
- Add CompressBytes/DecompressBytes convenience functions (closes #0283, closes #0284)
- Complete high-level public interfaces (closes #0285)
- Implement io.Reader/io.Writer streaming interfaces (closes #0286, closes #0287, closes #0288, closes #0289)
- Complete streaming API (closes #0290)

Also close Phase 4 parent issues now that all sub‑tasks are done:
- Parallel decompression (closes #0268)
- Integrity validation (closes #0273)
- Error recovery strategies (closes #0278)