aboutsummaryrefslogtreecommitdiff
path: root/src/zencore/basicfile.cpp
Commit message (Collapse)AuthorAgeFilesLines
* fixed size chunking for encrypted files (#410)Dan Engelbrecht2025-06-031-5/+5
| | | | | - Improvement: Use fixed size block chunking for know encrypted/compressed file types - Improvement: Skip trying to compress chunks that are sourced from files that are known to be encrypted/compressed - Improvement: Add global open file cache for written files increasing throughput during download by reducing overhead of open/close of file by 80%
* http client streaming upload (#413)Dan Engelbrecht2025-06-021-131/+18
| | | - Improvement: Add streaming upload from HttpClient to reduce I/O caused by excessive MMap usage
* optimize block store CompactBlocks (#384)Dan Engelbrecht2025-05-071-0/+29
| | | | | - Improvement: Optimize block compact reducing memcpy operations - Improvement: Handle padding of block store blocks when compacting to avoid excessive flusing of write buffer - Improvement: Handle padding when writing oplog index snapshot to avoid unnecessary flushing of write buffer
* long filename support (#330)Dan Engelbrecht2025-03-311-6/+6
| | | - Bugfix: Long file paths now works correctly on Windows
* collapse local writes (#310)Dan Engelbrecht2025-03-181-0/+6
| | | * collapse read/writes during local data copy
* pick up existing cache (#299)Dan Engelbrecht2025-03-101-13/+24
| | | | | | - Improvement: Scavenge .zen temp folders for existing data (downloaded, decompressed or written) from previous failed run - Improvement: Faster abort during stream compression - Improvement: Try to move downloaded blobs with rename if possible avoiding an extra disk write - Improvement: Only clean temp folders on successful or cancelled build - keep it if download fails
* improvements and infrastructure for upcoming builds api command line (#284)Dan Engelbrecht2025-02-251-19/+60
| | | | | | | | | | | | | | * add modification tick to filesystem traversal * add ShowDetails option to ProgressBar * log callstack if we terminate process * handle chunking if MaxSize > 1MB * BasicFile write helpers and WriteToTempFile simplifications * bugfix for CompositeBuffer::IterateRange when using DecompressToComposite for actually comrpessed data revert of earlier optimization * faster compress/decompress for large disk-based files * enable progress feedback in IoHash::HashBuffer * add payload validation in HttpClient::Get * fix range requests (range is including end byte) * remove BuildPartId for blob/block related operations in builds api
* move WriteToTempFile to basicfile.h (#283)Dan Engelbrecht2025-02-121-2/+62
| | | add helper constructors to BasicFile
* move basicfile.h/cpp -> zencore (#273)Dan Engelbrecht2025-01-161-0/+1033
move jupiter.h/cpp -> zenutil move packageformat.h/.cpp -> zenhttp zenutil now depends on zenhttp instead of the inverse