aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| | * | Fixed missing trailing quote when converting binary data from compact binary ↵Florent Devillechabrol2025-03-242-0/+2
| | | | | | | | | | | | | | | | to json
* | | | Merge branch 'main' of https://github.ol.epicgames.net/ue-foundation/zenzousar2025-04-029-13/+38
|\| | |
| * | | added --find-max-block-count option to builds upload (#337)Dan Engelbrecht2025-04-029-13/+38
| | | |
* | | | Updating frontend archivezousar2025-04-011-0/+0
|/ / /
* | | 5.6.1v5.6.1Dan Engelbrecht2025-04-011-1/+1
| | |
* | | 5.6.1-pre3v5.6.1-pre3Dan Engelbrecht2025-04-011-1/+1
| | |
* | | builds url discovery (#334)Dan Engelbrecht2025-04-0116-77/+348
| | | | | | | | | | | | | | | - Feature: Added `--host` option to use Jupiters list of cloud host and zen servers to resolve best hosts - Feature: Use local zenserver as builds cache if it has the `builds` service enabled and `--cloud-discovery-host` is provided and no remote zenserver cache hosts can be found - Improvement: Added `--override-host` option as a replacement for `--url` (`--url` still works, but `--override-host` is preferred)
* | | reduce disk io during gc (#335)Dan Engelbrecht2025-04-012-20/+9
| | | | | | | | | * do cache bucket flush/write snapshot as part of compact to reduce disk I/O
* | | verify that we can read input files that are only hashed (#333)Dan Engelbrecht2025-04-013-7/+125
| | | | | | | | | | | | | | | * output build and part details by default * output executable and version at start of builds command * verify that we can read files we do not chunk
* | | logging improvement (#332)Dan Engelbrecht2025-03-311-17/+20
| | | | | | | | | | | | * Cache -> Download cache * cleaned up info regarding local cache/state and remote cache
* | | 5.6.1-pre2v5.6.1-pre2Dan Engelbrecht2025-03-311-1/+1
| | |
* | | multithreaded clean (#331)Dan Engelbrecht2025-03-314-92/+395
| | | | | | | | | | | | - Improvement: Faster cleaning of directories - Improvement: Faster initial scanning of local state
* | | long filename support (#330)Dan Engelbrecht2025-03-3142-519/+1271
| | | | | | | | | - Bugfix: Long file paths now works correctly on Windows
* | | check file from local track state during download (#329)Dan Engelbrecht2025-03-301-118/+147
| | |
* | | 5.6.1-pre1v5.6.1-pre1Dan Engelbrecht2025-03-281-1/+1
| | |
* | | temp path options and reduced scanning of target folder (#328)Dan Engelbrecht2025-03-284-252/+583
| | | | | | | | | | | | | | | | | | - Feature: zen: `--zen-folder-path` added to `builds` command, `list`, `upload`, `download`, `fetch-blob`, `validate-part` to control where `.zen` folder is placed and named - Improvement: Only check known files from remote state when downloading to a target folder with no local state file - Improvement: Don't move existing local to cache and back if they are untouched
* | | build cache prime (#327)Dan Engelbrecht2025-03-277-454/+724
| | | | | | | | | | | | - Feature: zen `--boost-workers` option to builds `upload`, `download` and `validate-part` that will increase the number of worker threads, may cause computer to be less responsive - Feature: zen `--cache-prime-only` that uploads referenced data from a part to `--zen-cache-host` if it is not already present. Target folder will be untouched.
* | | Merge pull request #317 from ue-foundation/zs/ui-show-cook-artifactsZousar Shaker2025-03-275-29/+126
|\ \ \ | | | | | | | | Zs/UI show cook artifacts
| * \ \ Merge branch 'main' into zs/ui-show-cook-artifactsZousar Shaker2025-03-278-67/+221
| |\ \ \ | |/ / / |/| | |
* | | | optional compress of block chunks (#326)Dan Engelbrecht2025-03-278-67/+221
| | | | | | | | | | | | | | | | | | | | | | | | - Feature: zenserver: Add command line option `--gc-buildstore-duration-seconds` to control GC life time of build store data - Improvement: ELF and MachO executable files are no longer chunked - Improvement: Compress chunks in blocks that encloses a full file (such as small executables) - Bugfix: Strip path delimiter at end of string in StringToPath
| * | | Merge branch 'main' into zs/ui-show-cook-artifactsZousar Shaker2025-03-2634-959/+4002
| |\ \ \ | |/ / / |/| | |
* | | | zen build cache service (#318)Dan Engelbrecht2025-03-2634-959/+4002
| |/ / |/| | | | | | | | | | | | | | | | | | | | | | | - **EXPERIMENTAL** `zen builds` - Feature: `--zen-cache-host` option for `upload` and `download` operations to use a zenserver host `/builds` endpoint for storing build blob and blob metadata - Feature: New `/builds` endpoint for caching build blobs and blob metadata - `/builds/{namespace}/{bucket}/{buildid}/blobs/{hash}` `GET` and `PUT` method for storing and fetching blobs - `/builds/{namespace}/{bucket}/{buildid}/blobs/putBlobMetadata` `POST` method for storing metadata about blobs - `/builds/{namespace}/{bucket}/{buildid}/blobs/getBlobMetadata` `POST` method for fetching metadata about blobs - `/builds/{namespace}/{bucket}/{buildid}/blobs/exists` `POST` method for checking existance of blobs
| * | Descriptive type conversion messageszousar2025-03-261-15/+39
| | | | | | | | | | | | Handling decompression or validation errors with more descriptive messages
| * | Removed do_nothing from entry.jszousar2025-03-251-2/+0
| | |
| * | Moved AcceptType Handling From ProjectStore To HttpProjectStorezousar2025-03-253-61/+35
| | |
| * | Changelogzousar2025-03-211-0/+1
| | |
| * | Add CookPackageArtifacts attachment to web uizousar2025-03-212-6/+106
|/ /
* | don't let auth env argument block other auth options (#316)Dan Engelbrecht2025-03-192-8/+13
| | | | | | * prioritize actual options over implicit env variable for auth token
* | jupiter builds stats upload (#315)Dan Engelbrecht2025-03-197-15/+108
| | | | | | | | | | | | | | | | | | | | | | | | | | - Improvement: At end of build upload we post statistics to the Jupiter build stats endpoint: - `totalSize` - `reusedRatio` - `reusedBlockCount` - `reusedBlockByteCount` - `newBlockCount` - `newBlockByteCount` - `uploadedCount` - `uploadedByteCount` - `elapsedTimeSec` - `uploadedBytesPerSec`
* | build list filters (#313)Dan Engelbrecht2025-03-196-35/+99
| | | | | | | | | | - Feature: `zen builds list` command has new options - `--query-path` - path to a .json (json format) or .cbo (compact binary object format) with the search query to use - `--result-path` - path to a .json (json format) or .cbo (compact binary object format) to write output result to, if omitted json format will be output to console
* | Missing import statment on dashboard's start page (#314)Martin Ridgers2025-03-192-0/+1
| |
* | improved reporting on async error (#312)Dan Engelbrecht2025-03-183-8/+18
| | | | | | * report async errors as individual errors
* | If a chunk or block write operation results in more than one completed chunk ↵Dan Engelbrecht2025-03-182-88/+156
| | | | | | | | sequence, do the additional verifications as async work (#311)
* | collapse local writes (#310)Dan Engelbrecht2025-03-183-156/+200
| | | | | | * collapse read/writes during local data copy
* | Reduced disk I/O when writing out chunk blocks during download (#309)Dan Engelbrecht2025-03-182-70/+82
| |
* | improved post upload/download summary (#308)Dan Engelbrecht2025-03-184-421/+692
| | | | | | | | | | | | | | | | | | * added ValidateStatistics and improved post upload summary * improved download statistics * smoother stats update when compressing * better feedback during stream compresss/decompress * don't capture TotalPartWriteCount by reference * disk stats cleanup * multi-test-download overall timer
* | fix quoted command lines arguments (#306)Dan Engelbrecht2025-03-1216-182/+392
| | | | | | Handling of quotes and quotes with leading backslash for command line parsing - UE-231677
* | Remove spurious '4' in conditional code blockStefan Boberg2025-03-121-12/+12
| |
* | ProgressBar improvements (#305)Stefan Boberg2025-03-123-2/+44
| | | | | | | | | | * changed ProgressBar so it doesn't use printf. printf by default is very slow on Windows due to weird buffering behaviour. During a 2 minute build download I profiled 35 CPU seconds inside printf * changed so ProgressBar uses plain output mode if stdout is not a console/tty
* | fixes for log timestamps (#304)Stefan Boberg2025-03-129-3/+379
| | | | | | | | | | | | * add GetTimeSinceProcessStart returning time since process start. implemented using https://github.com/maxliani/GetTimeSinceProcessStart/tree/main * fix fractions when using epoch mode. Previously it would show the fraction from the absolute time stamp and not relative to epoch * used GetTimeSinceProcessStart to offset the epoch so that it represents the process spawn time
* | 5.6.1-pre0v5.6.1-pre0Dan Engelbrecht2025-03-121-1/+1
| |
* | fix mac/linux builds command (#303)Dan Engelbrecht2025-03-122-15/+22
| | | | | | * fix linux/mac version of GetModificationTickFromPath and CopyFile
* | improved block gen logic (#302)Dan Engelbrecht2025-03-128-458/+606
| | | | | | | | | | | | | | - Improvement: Reduced memory usage during upload and part upload validation - Improvement: Reduced I/O usage during upload and download - Improvement: Faster block regeneration when uploading in response to PutBuild/FinalizeBuild - Improvement: More trace scopes for build upload operations - Bugfix: Fixed crash during download when trying to write outside a file range
* | async find blocks (#300)Dan Engelbrecht2025-03-112-42/+81
| | | | | | | | | | | | | | * put/get build and find blocks while scanning local folder when uploading * changelog * remove redundant move
* | Build command tweaks (#301)Stefan Boberg2025-03-118-59/+85
| | | | | | | | | | | | - Improvement: Don't chunk up .mp4 files as they generally won't benefit from deduplication or partial in-place-updates - Improvement: Emit build name to console output when downloading a build - Improvement: Added some debug logging - Bugfix: Logging setup would previously not function correctly when not logging to file
* | pick up existing cache (#299)Dan Engelbrecht2025-03-1010-888/+1655
| | | | | | | | | | | | - Improvement: Scavenge .zen temp folders for existing data (downloaded, decompressed or written) from previous failed run - Improvement: Faster abort during stream compression - Improvement: Try to move downloaded blobs with rename if possible avoiding an extra disk write - Improvement: Only clean temp folders on successful or cancelled build - keep it if download fails
* | partial block fetch (#298)Dan Engelbrecht2025-03-079-402/+913
| | | | | | | | | | - Improvement: Do partial requests of blocks if not all of the block is needed - Improvement: Better progress/statistics on download - Bugfix: Ensure that temporary folder for Jupiter downloads exists during verify phase
* | reduced memory churn using fixed_xxx containers (#236)Stefan Boberg2025-03-0627-199/+380
| | | | | | | | | | | | * Added EASTL to help with eliminating memory allocations * Applied EASTL to eliminate memory allocations, primarily by using `fixed_vector` et al to use stack allocations / inline struct allocations Reduces memory events in traces by close to a factor of 10 in test scenario (starting editor for project F)
* | 5.6.0v5.6.0Dan Engelbrecht2025-03-061-1/+1
| |
* | 5.6.0-pre0v5.6.0-pre0Dan Engelbrecht2025-03-051-1/+1
| |