aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* | Initialize sentry after command line parsing is done (#420)Stefan Boberg2025-06-042-24/+26
| | | | | | | | Previously the option variables were used before options parsing had a chance to set them according to command line options
* | builds download url (#419)Dan Engelbrecht2025-06-045-66/+157
| | | | | | | | * RemoveQuotes helper * `--url` option for `zen builds` command has been reworked to accept a "Cloud Artifact URL", removing the need to specify "host", "namespace" and "bucket" separately
* | new builds search (#418)Dan Engelbrecht2025-06-043-19/+33
| | | | | | * don't require bucket for search operations to allow multi-bucket search
* | faster scavenge (#417)Dan Engelbrecht2025-06-045-104/+258
| | | | | | | | - Improvement: Multithreaded scavenge pass for zen builds download - Improvement: Optimized check for modified files when verifying state of scavenged paths
* | fixed size chunking for encrypted files (#410)Dan Engelbrecht2025-06-0315-429/+876
| | | | | | | | | | - Improvement: Use fixed size block chunking for know encrypted/compressed file types - Improvement: Skip trying to compress chunks that are sourced from files that are known to be encrypted/compressed - Improvement: Add global open file cache for written files increasing throughput during download by reducing overhead of open/close of file by 80%
* | minor: fix unused variable warning on some compilersStefan Boberg2025-06-031-4/+4
| |
* | 5.6.9v5.6.9zousar2025-06-021-1/+1
| |
* | http client streaming upload (#413)Dan Engelbrecht2025-06-026-200/+439
| | | | | | - Improvement: Add streaming upload from HttpClient to reduce I/O caused by excessive MMap usage
* | fix cachbucket mem hit count (#415)Dan Engelbrecht2025-06-022-4/+8
| | | | | | | | | | * Don't count a miss twice for memory stats if the entry can't be found * changelog
* | streaming none compressor (#414)Dan Engelbrecht2025-06-022-3/+37
| | | | | | * add proper streaming to none compressor type
* | use system temp dir (#412)Dan Engelbrecht2025-06-022-21/+25
| | | | | | * use system temp dir when uploading builds
* | Update README.mdStefan Boberg2025-06-021-5/+2
| |
* | 5.6.9-pre0v5.6.9-pre0zousar2025-05-301-1/+1
| |
* | add missing flush inblockstore compact (#411)Dan Engelbrecht2025-05-306-17/+132
| | | | | | | | - Bugfix: Flush the last block before closing the last new block written to during blockstore compact. UE-291196 - Feature: Drop unreachable CAS data during GC pass. UE-291196
* | faster oplog validate (#408)Dan Engelbrecht2025-05-307-20/+87
| | | | | | Improvement: Faster oplog validate to reduce GC wall time and disk I/O pressure
* | frequent disk space check (#407)Dan Engelbrecht2025-05-273-26/+90
| | | | | | | | * check low disk space condition more frequently and trigger GC when low water mark is reached * show waited time when waiting for zenserver instance to exit
* | made fmt use of format_context more consistent (#409)Stefan Boberg2025-05-262-4/+8
| | | | | | fixes compilation issues on Linux in some cases
* | unblock cache bucket drop (#406)Dan Engelbrecht2025-05-265-54/+127
| | | | | | | | * don't hold exclusive locks while deleting files from a dropped bucket/namespace * cleaner detection of missing namespace when issuing a drop
* | 5.6.8v5.6.8Dan Engelbrecht2025-05-211-1/+1
| |
* | enable build store in config (#405)Dan Engelbrecht2025-05-201-0/+3
| |
* | 5.6.8-pre2v5.6.8-pre2Dan Engelbrecht2025-05-201-1/+1
| |
* | use explicit capture for lambdas (#404)Dan Engelbrecht2025-05-202-896/+1254
| |
* | Merge pull request #402 from ue-foundation/zs/fix-oplog-import-oplog-creationZousar Shaker2025-05-202-6/+1
|\ \ | | | | | | Zs/fix oplog import oplog creation
| * | Changelogzousar2025-05-171-0/+1
| | |
| * | Fix oplog creation during oplog-importzousar2025-05-171-6/+0
| | |
* | | replace copy file (#403)Dan Engelbrecht2025-05-202-6/+35
| | | | | | | | | Custom CopyFile in zen builds command increasing throughput by 50% on Windows and give better progress update
* | | handle exception with batch work (#401)Dan Engelbrecht2025-05-1910-424/+464
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | * use ParallelWork in rpc playback * use ParallelWork in projectstore * use ParallelWork in buildstore * use ParallelWork in cachedisklayer * use ParallelWork in compactcas * use ParallelWork in filecas * don't set abort flag in ParallelWork destructor * add PrepareFileForScatteredWrite for temp files in httpclient * Use PrepareFileForScatteredWrite when stream-decompressing files * be more relaxed when deleting temp files * allow explicit zen-cache when using direct host url without resolving * fix lambda capture when writing loose chunks * no delay when attempting to remove temp files
* | parallel work handle dispatch exception (#400)Dan Engelbrecht2025-05-1612-1372/+1445
| | | | | | - Bugfix: Wait for async threads if dispatching of work using ParallellWork throws exception
* | validate custom fields (#399)Stefan Boberg2025-05-162-1/+45
| | | | | | | | * implemented validation of compact binary custom fields
* | sparse win file write (#398)Dan Engelbrecht2025-05-165-1/+52
| | | | | | * Added `--use-sparse-files` option to `zen builds` command improving write performance of large files. Enabled by default.
* | Merge pull request #396 from ue-foundation/zs/config-retention-8daysZousar Shaker2025-05-151-2/+2
|\ \ | | | | | | Change retention to 8 days in default config
| * | Change retention to 8 days in default configzousar2025-05-141-2/+2
| | |
* | | make sure tests initialize trace so we don't end up allocating tons of ↵Stefan Boberg2025-05-157-2/+13
|/ / | | | | | | memory for no reason (#397)
* | `zen oplog-import` and `zen oplog-export` now supports ↵Dan Engelbrecht2025-05-142-0/+13
| | | | | | | | `--oidctoken-exe-path` option (#395)
* | extend log on failed httpsys response (#394)Dan Engelbrecht2025-05-133-9/+24
| | | | | | | | | | * extend log on failed httpsys response * fix formatting for "Desired port is in use, retrying" * add warning log if port is remapped
* | skip empty or single-space command line arguments (#393)Dan Engelbrecht2025-05-132-2/+7
| |
* | 5.6.8-pre1v5.6.8-pre1Dan Engelbrecht2025-05-121-1/+1
| |
* | keep snapshot on log delete fail (#391)Dan Engelbrecht2025-05-127-158/+88
| | | | | | | | | | - Improvement: Cleaned up snapshot writing for CompactCAS/FileCas/Cache/Project stores - Improvement: Safer recovery when failing to delete log for CompactCAS/FileCas/Cache/Project stores - Improvement: Added log file reset when writing snapshot at startup for FileCas
* | enable per bucket config (#388)Dan Engelbrecht2025-05-126-16/+231
| | | | | | | | Feature: Add per bucket cache configuration (Lua options file only) Improvement: --cache-memlayer-sizethreshold is now deprecated and has a new name: --cache-bucket-memlayer-sizethreshold to line up with per cache bucket configuration
* | tweak iterate block parameters (#390)Dan Engelbrecht2025-05-123-34/+51
| | | | | | * tweak block iteration chunk sizes
* | handle exception in oplog mirror (#389)Dan Engelbrecht2025-05-122-46/+69
| | | | | | * gracefully handle errors in threaded part of oplog-mirror
* | 5.6.8-pre0v5.6.8-pre0Dan Engelbrecht2025-05-091-1/+1
| |
* | flush cas log file (#387)Dan Engelbrecht2025-05-093-47/+35
| | | | | | * make sure we remove the cas log file when writing full index at startup
* | Merge pull request #386 from ue-foundation/zs/plugin-config-hardeningZousar Shaker2025-05-082-8/+9
|\ \ | | | | | | Zs/plugin config hardening
| * | Changelogzousar2025-05-071-0/+1
| | |
| * | Change plugin config parsing to warn instead of throwzousar2025-05-071-8/+8
|/ /
* | 5.6.7v5.6.7Dan Engelbrecht2025-05-071-1/+1
| |
* | 5.6.7-pre1v5.6.7-pre1Dan Engelbrecht2025-05-071-1/+1
| |
* | make RemoveExpiredData and PreCache serial to reduce CPU overhead / lock ↵Dan Engelbrecht2025-05-072-85/+62
| | | | | | | | | | contention (#385) * make RemoveExpiredData and PreCache serial to reduce CPU overhead / lock contention
* | optimize block store CompactBlocks (#384)Dan Engelbrecht2025-05-075-33/+64
| | | | | | | | | | - Improvement: Optimize block compact reducing memcpy operations - Improvement: Handle padding of block store blocks when compacting to avoid excessive flusing of write buffer - Improvement: Handle padding when writing oplog index snapshot to avoid unnecessary flushing of write buffer