aboutsummaryrefslogtreecommitdiff
path: root/src/zenremotestore/chunking/chunkedcontent.cpp
Commit message (Collapse)AuthorAgeFilesLines
* builds scanning cache (#727)v5.7.19-pre0Dan Engelbrecht2026-01-231-35/+62
| | | | - Feature: Added `--chunking-cache-path` option to `zen builds upload` and `zen builds diff` - Path to cache for chunking information of scanned files. Default is empty resulting in no caching
* various optimizations (#704)Dan Engelbrecht2026-01-091-1/+1
| | | | | | | | | - Improvement: Validate chunk hashes when dechunking files in oplog import - Improvement: Use stream decompression when dechunking files - Improvement: When assembling blocks for oplog export, make sure we keep under/at block size limit - Improvement: Make cancelling of oplog import more responsive - Improvement: Use decompress to composite to avoid allocating a new memory buffer for uncompressed chunks during oplog import - Improvement: Reduce memory buffer size and allocate it on demand when writing multiple chunks to block store - Improvement: Reduce lock contention when fetching/checking existence of chunks in block store
* optimize scavenge (#697)Dan Engelbrecht2025-12-191-43/+169
| | | | * optimize FindScavengeContent * optimize GetValidFolderContent
* update state when wildcard (#657)Dan Engelbrecht2025-11-241-139/+430
| | | * add --append option and improve state handling when using downloads for `zen builds download`
* loose chunk filtering bug when using wildcards (#654)Dan Engelbrecht2025-11-181-0/+461
| | | | | | | | | | * fix filtering of loose chunks when downloading with a filter add tests * changelog * move InlineRemoveUnusedHashes * remove extra braces
* merge 5.7.8 minimal release (#635)Dan Engelbrecht2025-11-061-0/+2
| | | merge back all the cherry-picks
* refactor MergeChunkedFolderContents to not reallocate ↵Dan Engelbrecht2025-11-041-9/+35
| | | | Result.ChunkedContent.ChunkOrders for each path added (#626)
* updated chunking strategy (#589)Dan Engelbrecht2025-10-201-17/+18
| | | | | | | | | | - Improvement: `zen builds`now split large files that are compress only into 64 MB chunks to avoiding very large files in Cloud Storage - Improvement: `zen builds` now treats `.msixvc` files as non-compressable Moved and cleaned up compactbinary_helpers functions Tweaked fixed chunking implementation for better performance Refactored so we have one list of "non-compressable" extensions Implemented new `StandardChunkingStrategy` and move the two existing to hidden legacy namespace Added `FilteredDownloadedBytesPerSecond.Start();` call that got lost during previous refactoring
* move builds state functions to buildsavedstate.h/cpp (#577)Dan Engelbrecht2025-10-151-0/+44
|
* remove zenutil dependency in zenremotestore (#547)Dan Engelbrecht2025-10-031-3/+1
| | | | | | | | | * remove dependency to zenutil/workerpools.h from remoteprojectstore.cpp * remove dependency to zenutil/workerpools.h from buildstoragecache.cpp * remove unneded include * move jupiter helpers to zenremotestore * move parallelwork to zencore * remove zenutil dependency from zenremotestore * clean up test project dependencies - use indirect dependencies
* move chunking code to zenremotestore lib (#545)Dan Engelbrecht2025-10-031-0/+953