aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'origin/main' into sb/build-cachesb/build-cacheDan Engelbrecht2025-03-1819-890/+1499
|\
| * improved reporting on async error (#312)Dan Engelbrecht2025-03-182-8/+17
| | | | | | * report async errors as individual errors
| * If a chunk or block write operation results in more than one completed chunk ↵Dan Engelbrecht2025-03-181-88/+155
| | | | | | | | sequence, do the additional verifications as async work (#311)
| * collapse local writes (#310)Dan Engelbrecht2025-03-182-156/+199
| | | | | | * collapse read/writes during local data copy
| * Reduced disk I/O when writing out chunk blocks during download (#309)Dan Engelbrecht2025-03-181-70/+81
| |
| * improved post upload/download summary (#308)Dan Engelbrecht2025-03-183-420/+690
| | | | | | | | | | | | | | | | | | * added ValidateStatistics and improved post upload summary * improved download statistics * smoother stats update when compressing * better feedback during stream compresss/decompress * don't capture TotalPartWriteCount by reference * disk stats cleanup * multi-test-download overall timer
| * fix quoted command lines arguments (#306)Dan Engelbrecht2025-03-1215-182/+391
| | | | | | Handling of quotes and quotes with leading backslash for command line parsing - UE-231677
| * Remove spurious '4' in conditional code blockStefan Boberg2025-03-121-12/+12
| |
* | Merge branch 'main' into sb/build-cacheStefan Boberg2025-03-122-2/+30
|\|
| * ProgressBar improvements (#305)Stefan Boberg2025-03-122-2/+42
| | | | | | | | | | * changed ProgressBar so it doesn't use printf. printf by default is very slow on Windows due to weird buffering behaviour. During a 2 minute build download I profiled 35 CPU seconds inside printf * changed so ProgressBar uses plain output mode if stdout is not a console/tty
| * fixes for log timestamps (#304)Stefan Boberg2025-03-125-3/+26
| | | | | | | | | | | | * add GetTimeSinceProcessStart returning time since process start. implemented using https://github.com/maxliani/GetTimeSinceProcessStart/tree/main * fix fractions when using epoch mode. Previously it would show the fraction from the absolute time stamp and not relative to epoch * used GetTimeSinceProcessStart to offset the epoch so that it represents the process spawn time
* | fix log timestampsStefan Boberg2025-03-122-3/+10
| | | | | | | | | | - fix fractions when using epoch mode. Previously it would show the fraction from the absolute time stamp and not relative to epoch - used GetTimeSinceProcessStart to offset the epoch so that it represents the process spawn time
* | add GetTimeSinceProcessStart returning time since process startStefan Boberg2025-03-123-0/+16
| | | | | | | | implemented using https://github.com/maxliani/GetTimeSinceProcessStart/tree/main
* | Merge remote-tracking branch 'origin/main' into sb/build-cacheStefan Boberg2025-03-127-514/+696
|\|
| * fix mac/linux builds command (#303)Dan Engelbrecht2025-03-121-15/+20
| | | | | | * fix linux/mac version of GetModificationTickFromPath and CopyFile
| * improved block gen logic (#302)Dan Engelbrecht2025-03-127-457/+599
| | | | | | | | | | | | | | - Improvement: Reduced memory usage during upload and part upload validation - Improvement: Reduced I/O usage during upload and download - Improvement: Faster block regeneration when uploading in response to PutBuild/FinalizeBuild - Improvement: More trace scopes for build upload operations - Bugfix: Fixed crash during download when trying to write outside a file range
| * async find blocks (#300)Dan Engelbrecht2025-03-111-42/+80
| | | | | | | | | | | | | | * put/get build and find blocks while scanning local folder when uploading * changelog * remove redundant move
* | Remove spurious '4' in conditional code blockStefan Boberg2025-03-121-12/+12
| |
* | changed ReadDeltaArray to return the number of entries in the input arrayStefan Boberg2025-03-121-3/+6
| |
* | Further tweaks to build part manifest encodingStefan Boberg2025-03-112-13/+119
| | | | | | | | Brings down the size of the build part manifest to 144KB from the original 5.3MB (and further down from the previous delta encoding @ 1.8MB)
* | added support for delta-encoding of main manifestStefan Boberg2025-03-112-2/+51
| | | | | | | | | | | | reduces size of test data to less than half of the non-delta version after compression the delta version is less than 20% of the original representation
* | eligeble -> eligibleStefan Boberg2025-03-111-1/+1
| |
* | Misc changes to make logging more compactStefan Boberg2025-03-111-11/+12
| | | | | | | | also introduces ZEN_CLOUD_STORAGE to make it easier to alter product name once it's settled
* | change ProgressBar so it doesn't use printfStefan Boberg2025-03-111-1/+13
| | | | | | | | printf by default is very slow on Windows due to weird buffering behaviour. During a 2 minute build download I profiled 35 CPU seconds inside printf
* | add support for `--malloc=<...>` in zen CLIStefan Boberg2025-03-111-0/+3
| |
* | fix namespace scoping so it works in release tooStefan Boberg2025-03-111-1/+2
| |
* | remove redundant `ZEN_MEMSCOPE`Stefan Boberg2025-03-111-1/+0
| |
* | Merge remote-tracking branch 'origin/main' into sb/build-cacheStefan Boberg2025-03-1113-939/+1700
|\|
| * Build command tweaks (#301)Stefan Boberg2025-03-117-59/+83
| | | | | | | | | | | | - Improvement: Don't chunk up .mp4 files as they generally won't benefit from deduplication or partial in-place-updates - Improvement: Emit build name to console output when downloading a build - Improvement: Added some debug logging - Bugfix: Logging setup would previously not function correctly when not logging to file
| * pick up existing cache (#299)Dan Engelbrecht2025-03-109-887/+1651
| | | | | | | | | | | | - Improvement: Scavenge .zen temp folders for existing data (downloaded, decompressed or written) from previous failed run - Improvement: Faster abort during stream compression - Improvement: Try to move downloaded blobs with rename if possible avoiding an extra disk write - Improvement: Only clean temp folders on successful or cancelled build - keep it if download fails
* | added fmt formatter for CbObjectView to make it easier to log compact binary ↵Stefan Boberg2025-03-101-0/+23
| | | | | | | | objects
* | buildstore build fixStefan Boberg2025-03-101-0/+2
| |
* | added LoggingOptions::AllowAsync to manage use of async loggingStefan Boberg2025-03-102-1/+2
| |
* | test stuffStefan Boberg2025-03-105-22/+107
| |
* | Fix problem in FinishInitializeLogging when not logging to fileStefan Boberg2025-03-101-6/+9
| |
* | minor: renamesStefan Boberg2025-03-103-3/+2
| |
* | Merge remote-tracking branch 'origin/main' into sb/build-cacheStefan Boberg2025-03-0734-601/+1284
|\|
| * partial block fetch (#298)Dan Engelbrecht2025-03-078-402/+907
| | | | | | | | | | - Improvement: Do partial requests of blocks if not all of the block is needed - Improvement: Better progress/statistics on download - Bugfix: Ensure that temporary folder for Jupiter downloads exists during verify phase
| * reduced memory churn using fixed_xxx containers (#236)Stefan Boberg2025-03-0626-199/+377
| | | | | | | | | | | | * Added EASTL to help with eliminating memory allocations * Applied EASTL to eliminate memory allocations, primarily by using `fixed_vector` et al to use stack allocations / inline struct allocations Reduces memory events in traces by close to a factor of 10 in test scenario (starting editor for project F)
| * Add trace support for zen CLI command (#296)Stefan Boberg2025-03-054-37/+210
| | | | | | | | - This change adds support for `--trace`, `--tracehost` and `--tracefile` command arguments to enable and control tracing to Insights - It also adds profiling scopes primarily to build download command related code
* | Tactical check-in to simplify merge from old branchStefan Boberg2025-03-072-0/+20
| |
* | Merge branch 'main' into sb/build-cacheStefan Boberg2025-03-053-38/+289
|\|
| * streaming compress (#295)Dan Engelbrecht2025-03-053-37/+289
| | | | | | | | - Improvement: Validate hash of decompressed data inline with streaming decompression - Improvement: Do streaming compression of large blobs to improve memory and I/O performance
* | Merge branch 'main' into sb/build-cacheStefan Boberg2025-03-053-75/+344
|\|
| * do direct update of stats numbers (#294)Dan Engelbrecht2025-03-041-24/+13
| |
| * stream decompress (#293)Dan Engelbrecht2025-03-043-57/+337
| | | | | | | | * clean up latency parameters and slow down rate updates * add DecompressToStream
* | stub out build store/cache serviceStefan Boberg2025-03-055-0/+67
| |
* | ZEN_TRACE_CPU annotations for builds commandStefan Boberg2025-03-053-40/+160
| |
* | added tracing support for zen CLIStefan Boberg2025-03-041-0/+54
|/
* limit and validate responses before logging the text (#292)Stefan Boberg2025-03-044-1/+110
| | | Improvement: When logging HTTP responses, the body is now sanity checked to ensure it is human readable, and the length of the output is capped to prevent inadvertent log bloat
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-26 14:59:34 +0000