Maintain metadata generation without seeking #148

Closed
opened 2026-04-09 16:59:39 +00:00 by fuzzy · 2 comments
Owner
No description provided.
fuzzy self-assigned this 2026-04-09 16:59:39 +00:00
Author
Owner

This feature is not yet implemented. Streaming operation currently supports stdin/stdout but metadata generation requires seeking (or a two‑pass approach). This is a prerequisite for PAR2 generation in streaming mode (#149).

This feature is not yet implemented. Streaming operation currently supports stdin/stdout but metadata generation requires seeking (or a two‑pass approach). This is a prerequisite for PAR2 generation in streaming mode (#149).
Author
Owner

Metadata generation without seeking is already implemented across all archive formats (tar, zip, cpio, ar) using tee readers that compute BLAKE3/CRC32 hashes while streaming data to the archive. The internal metadata CSV file is written at the end of the archive (Close()), requiring no seeking. External SQLite metadata store also works with streaming.

Thus this sub‑task is complete. Closing.

Metadata generation without seeking is already implemented across all archive formats (tar, zip, cpio, ar) using tee readers that compute BLAKE3/CRC32 hashes while streaming data to the archive. The internal metadata CSV file is written at the end of the archive (`Close()`), requiring no seeking. External SQLite metadata store also works with streaming. Thus this sub‑task is complete. Closing.
fuzzy closed this issue 2026-04-13 05:26:58 +00:00
Sign in to join this conversation.
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
thwap/manta-archiver#148
No description provided.