aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* make sure we properly shut down any pending http requests at exitDan Engelbrecht2025-08-201-0/+1
|
* per namespace/project cas prep refactor (#470)Dan Engelbrecht2025-08-2024-480/+703
| | | | | | | - Refactor so we can have more than one cas store for project store and cache. - Refactor `UpstreamCacheClient` so it is not tied to a specific CidStore - Refactor scrub to keep the GC interface ScrubStorage function separate from scrub accessor functions (renamed to Scrub). - Refactor storage size to keep GC interface StorageSize function separate from size accessor functions (renamed to TotalSize) - Refactor cache storage so `ZenCacheDiskLayer::CacheBucket` implements GcStorage interface rather than `ZenCacheNamespace`
* zen print fixes/improvements (#469)Dan Engelbrecht2025-08-1911-40/+223
| | | | | - Improvement: `zen print` now allows output of compact binary content even if they are in non-optimal format (Unifom vs Non-Uniform arrays and objects) - Feature: `zen print` now has a `--show-type-info` option to add type information to output of compact binary content - Bugfix: Stats information for Build Store (Zen Store Cache) no longer throws exception and outputs invalid state information
* Ensure that FinalizeContainer finalizes both part and buildzousar2025-08-141-0/+31
|
* New frontend zip.Florent Devillechabrol2025-08-141-0/+0
|
* If the oplog has no packagestoreentry then show the raw json.Florent Devillechabrol2025-08-141-2/+5
|
* New frontend zip.Florent Devillechabrol2025-08-141-0/+0
|
* Do not skip oplog without package data.Florent Devillechabrol2025-08-142-36/+39
|
* add limitoverwrites option per bucket (#466)Dan Engelbrecht2025-08-124-17/+22
| | | | | | | | | | | | | | | - Feature: Added global zenserver option `--cache-bucket-limit-overwrites` controlling Whether to require policy flag pattern before allowing overwrites or not. Default `false` = overwrites always allowed - Feature: Add per bucket cache configuration option `limitoverwrites` (Lua options file only) cache = { bucket = { -- This is the default for all namespaces limitoverwrites = true }, buckets = { -- Here you can add matching per bucket name (matches accross namespaces) iostorecompression = { limitoverwrites = false }, }, }
* reduce lock contention when checking for disk cache put reject (#465)Dan Engelbrecht2025-08-122-105/+91
| | | | keep rawsize and rawhash if available when using batch for inline puts keep rawsize and rawhash of input value if we have calculated it for validation already
* use new builds api for oplogs (#464)Dan Engelbrecht2025-08-1215-471/+665
| | | | - Improvement: Refactored jupiter oplog export code to reuse builds jupiter wrapper classes - Improvement: If `zen builds`, `zen oplog-import` or `zen oplog-import` command fails due to a http error, the return code for the program will be set to the error/status code
* add filtering to builds download (#463)Dan Engelbrecht2025-08-111-54/+210
| | | | | | - Feature: Added wildcard options for `zen build download` - `--wildcard` windows style wildcard (using * and ?) to match file paths to include - `--exclude-wildcard` windows style wildcard (using * and ?) to match file paths to exclude. Applied after --wildcard include filter - Improvement: Remove early wipe of target folder for `zen download` to allow for scavenging useful data
* list build part content (#462)Dan Engelbrecht2025-08-1113-307/+832
| | | | | | | | | | | - Feature: Added `zen build ls` option to list the content of a build part(s) - Build source is specified using one of the following options - `--cloud-url` cloud artifact URL to build - `--host` or `--override-host`, `--namespace`, `--bucket` and `--buildid` - `--filestorage`, `--namespace`, `--bucket` and `--buildid` - `--build-part-name` to specify a particular build part(s) in the build - `--wildcard` windows style wildcard (using * and ?) to match file paths to include - `--exclude-wildcard` windows style wildcard (using * and ?) to match file paths to exclude. Applied after --wildcard include filter - Improvement: Added `--quiet` option to zen `builds` commands to suppress non-essential output
* Merge branch 'main' into zs/put-overwrite-policyZousar Shaker2025-08-0810-586/+864
|\
| * skip query for metada if no blocks are referenced (#460)Dan Engelbrecht2025-08-071-1/+1
| |
| * Merge pull request #450 from ue-foundation/lm/double-quotes-fixLiam Mitchell2025-08-061-1/+2
| |\ | | | | | | Don't add quotes to arguments which are already quoted
| | * Don't add quotes to arguments which are already quotedLiam Mitchell2025-07-151-1/+2
| | |
| * | add the correct set of references hashes in batched inline mode (#459)Dan Engelbrecht2025-08-061-3/+3
| | |
| * | retry finalize if we get a "needs" on a blob we did not create (#461)Dan Engelbrecht2025-08-061-2/+4
| | |
| * | refactor blobstore (#458)Dan Engelbrecht2025-08-066-568/+825
| | | | | | | | | | | | | | | | | | - Improvement: Refactored build store cache to use existing CidStore implementation instead of implementation specific blob storage - **CAUTION** This will clear any existing cache when updating as the manifest version and storage strategy has changed - Bugfix: BuildStorage cache return "true" for metadata existance for all blobs that had payloads regardless of actual existance for metadata
| * | more details in parallel work when wait fails/destructor has inconsistent ↵Dan Engelbrecht2025-08-061-12/+30
| | | | | | | | | | | | state (#457)
* | | precommitzousar2025-08-071-9/+4
| | |
* | | Avoid committing chunks for batch rejected putszousar2025-08-071-42/+35
| | | | | | | | | | | | Previously rejected puts would put the chunks, but not write them to the index, which was wrong.
* | | Moving put rejections to happen in batch handlingzousar2025-08-052-41/+101
| | |
* | | Merge branch 'main' into zs/put-overwrite-policyzousar2025-08-057-36/+85
|\| |
| * | de/stringbuilder safety (#456)Dan Engelbrecht2025-08-054-15/+31
| | | | | | | | | | | | | | | | | | - Improvement: Safeguard FormatCallstack to not throw exceptions when building the callstack string - Improvement: Limit thread name length when setting it for debugger use - Improvemnet: Don't allow assert callbacks to throw exception - Improvement: When formatting log output for malformed attachments in a package message, allow the string buffer to grow instead of throwing exception
| * | Don't set m_DispatchComplete in ParallelWork until after pending work ↵Dan Engelbrecht2025-08-041-4/+4
| | | | | | | | | | | | countdown succeeds (#455)
| * | add hardening for legacy cache bucket manifests (#454)Dan Engelbrecht2025-08-041-11/+40
| | |
| * | Set ready event when reusing an existing server instance. (#448)Martin Ridgers2025-08-041-6/+10
| |/ | | | | | | | | * Moved firing of child-id event into a lambda * Fire notify event to parent after attaching to an existing instance * Updated changelog
* | xmake precommitzousar2025-06-242-7/+7
| |
* | Merge branch 'main' into zs/put-overwrite-policyzousar2025-06-24191-3036/+28786
|\|
| * move nodiscard to proper location (#447)Dan Engelbrecht2025-06-191-1/+1
| |
| * add retry for failed block metadata upload (#445)Dan Engelbrecht2025-06-194-32/+60
| | | | | | * add retry for failed block metadata upload
| * make sure we unregister from GC before we drop bucket/namespaces (#443)Dan Engelbrecht2025-06-192-1/+4
| |
| * Surfaced basic z$ information to self-hosted dashboard (#441)Martin Ridgers2025-06-183-0/+124
| | | | | | | | | | | | - Namespaces are listed on the start page. - Namespaces can be dropped. - New page to show details of a namespace and list its buckets. - Buckets can be dropped.
| * `--output-path` option added to `zen version` command (#440)Dan Engelbrecht2025-06-183-20/+41
| | | | | | * `--output-path` option added to `zen version` command
| * accept Cloud urls without the api/v2/builds/ part (#439)Dan Engelbrecht2025-06-171-25/+45
| |
| * graceful wait in parallelwork destructor (#438)Dan Engelbrecht2025-06-169-244/+359
| | | | | | | | | | * exception safety when issuing ParallelWork * add asserts to Latch usage to catch usage errors * extended error messaging and recovery handling in ParallelWork destructor to help find issues
| * fix build store range check (#437)Dan Engelbrecht2025-06-162-3/+10
| | | | | | | | | | * fix range check for blob store fetch * don't try to parse blockdesriptions if empty result is returned * add range to log when fetching blob range fails
| * sentry config (#430)Dan Engelbrecht2025-06-129-56/+311
| | | | | | | | | | | | | | | | | | | | - Feature: Added `--sentry-environment` to `zen` and `zenserver` - Feature: Added `--sentry-debug` to `zen` and `zenserver` - Feature: Added environment variable parsing for the following options: - `UE_ZEN_SENTRY_ENABLED`: `--no-sentry` (inverted) - `UE_ZEN_SENTRY_DEBUG`: `--sentry-debug` - `UE_ZEN_SENTRY_ALLOWPERSONALINFO`: `--sentry-allow-personal-info` - `UE_ZEN_SENTRY_DSN`: `--sentry-dsn` - `UE_ZEN_SENTRY_ENVIRONMENT`: `--sentry-environment`
| * make sure we finish progress at 100% if not done (#432)Dan Engelbrecht2025-06-101-1/+1
| | | | | | | | | | * make sure we finish progress at 100% if not done * fix condition
| * crash in composite buffer stream (#431)Dan Engelbrecht2025-06-101-1/+1
| | | | | | * fix BufferedReadFileStream calculating buffer end wrong
| * revert 61b4a88f and cadaad63Dan Engelbrecht2025-06-109-311/+56
| |
| * add sentry configurations options for debug/environmentDan Engelbrecht2025-06-107-56/+135
| | | | | | | | | | add env-variable parsing for sentry option
| * add EnvironmentOptions helperDan Engelbrecht2025-06-102-0/+176
| |
| * Don't require `--namespace` option when using `zen list-namespaces` command ↵Dan Engelbrecht2025-06-101-19/+44
| | | | | | | | (#429)
| * restore legacy --url option for builds download (#428)Dan Engelbrecht2025-06-101-1/+7
| |
| * `--sentry-dsn` option for zen command line and zenserver to control Sentry ↵Dan Engelbrecht2025-06-096-37/+59
| | | | | | | | | | reporting endpoint (#427) moved sentry database path to temporary directory for zen commandline
| * use unique tmp name for auth token file (#426)Dan Engelbrecht2025-06-091-3/+3
| | | | | | * use Oid to generate unique name since std::tmpnam is not good practice
| * fix namespace picking up wrong argument (#425)Dan Engelbrecht2025-06-091-1/+1
| |
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-11 15:39:59 +0000