| Commit message (Collapse) | Author | Age | Files | Lines |
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
| |
* fix lambda capture during multipart-download
|
| |
|
|
| |
- Improvement: `zen builds` now scavenges previous download locations for data to reduce download size, enabled by default, disable with `--enable-scavenge=false`
- Bugfix: Failing to rename a file during download sometimes reported an error when it succeeded when retrying
|
| | |
|
| | |
|
| |
|
|
| |
* save global download info file for scavenging
* don't let test code write to official state folder
|
| | |
|
| | |
|
| | |
|
| |\
| |
| | |
Oplog search improvements
|
| | |\ |
|
| | | |
| | |
| | |
| | |
| | |
| | | |
- Case insensitive search
- Allow search of 1 or 2 character strings
- Reset table when doing a null search
|
| |\ \ \
| | |/
| |/| |
|
| | | |
| | |
| | |
| | | |
* hide ETA until at least 5% is complete
* dynamically adjust progres output length
|
| | |/
| |
| | |
- Feature: zenserver option `--buildstore-disksizelimit` to set an soft upper limit for build storage data. Defaults to 1TB.
|
| | | |
|
| | |
| |
| |
| | |
Required to refresh db contents after ID fix.
|
| |/
|
|
|
|
| |
ID was getting extended and left shifted if we encountered multiple package data items in a single entry. So instead of the ID being 0x0c6500b7fb8dbe2e, it was 0x0C6500B7FB8DBE2E0C6500B7FB8DBE2E. When we went to look up an imported package by ID, it would not be found and the import would be presented as a blank string.
Addressing this by making the first package data the only referenceable one. Second package datas are currently used for optional data blobs, and will not be imported or referenced. They are sidecar data.
|
| |
|
|
|
| |
* save payload size in log for buildstore
* read/write access times and manifest for buldstore
* use retry when removing temporary files
|
| |
|
|
| |
(builds) option now has `--oidctoken-exe-path` to let zen run the OidcToken executable to get and refresh authentication token (#340)
|
| |
|
| |
- Feature: `zen builds` auth option `--oidctoken-exe-path` to let zen run the OidcToken executable to get and refresh authentication token
|
| |\ |
|
| | |
| |
| | |
* fix macos/linux path resolving
|
| | |\ |
|
| | | |
| | |
| | |
| | | |
to json
|
| |\ \ \
| | |/
| |/| |
|
| | | | |
|
| |/ / |
|
| | |
| |
| |
| |
| | |
- Feature: Added `--host` option to use Jupiters list of cloud host and zen servers to resolve best hosts
- Feature: Use local zenserver as builds cache if it has the `builds` service enabled and `--cloud-discovery-host` is provided and no remote zenserver cache hosts can be found
- Improvement: Added `--override-host` option as a replacement for `--url` (`--url` still works, but `--override-host` is preferred)
|
| | |
| |
| | |
* do cache bucket flush/write snapshot as part of compact to reduce disk I/O
|
| | |
| |
| |
| |
| | |
* output build and part details by default
* output executable and version at start of builds command
* verify that we can read files we do not chunk
|
| | |
| |
| |
| | |
* Cache -> Download cache
* cleaned up info regarding local cache/state and remote cache
|
| | |
| |
| |
| | |
- Improvement: Faster cleaning of directories
- Improvement: Faster initial scanning of local state
|
| | |
| |
| | |
- Bugfix: Long file paths now works correctly on Windows
|
| | | |
|
| | |
| |
| |
| |
| |
| | |
- Feature: zen: `--zen-folder-path` added to `builds` command, `list`, `upload`, `download`, `fetch-blob`, `validate-part` to control where `.zen` folder is placed and named
- Improvement: Only check known files from remote state when downloading to a target folder with no local state file
- Improvement: Don't move existing local to cache and back if they are untouched
|
| | |
| |
| |
| | |
- Feature: zen `--boost-workers` option to builds `upload`, `download` and `validate-part` that will increase the number of worker threads, may cause computer to be less responsive
- Feature: zen `--cache-prime-only` that uploads referenced data from a part to `--zen-cache-host` if it is not already present. Target folder will be untouched.
|
| |\ \ |
|
| | | |
| | |
| | |
| | |
| | |
| | | |
- Feature: zenserver: Add command line option `--gc-buildstore-duration-seconds` to control GC life time of build store data
- Improvement: ELF and MachO executable files are no longer chunked
- Improvement: Compress chunks in blocks that encloses a full file (such as small executables)
- Bugfix: Strip path delimiter at end of string in StringToPath
|
| |\| | |
|
| | |/
| |
| |
| |
| |
| |
| |
| |
| | |
- **EXPERIMENTAL** `zen builds`
- Feature: `--zen-cache-host` option for `upload` and `download` operations to use a zenserver host `/builds` endpoint for storing build blob and blob metadata
- Feature: New `/builds` endpoint for caching build blobs and blob metadata
- `/builds/{namespace}/{bucket}/{buildid}/blobs/{hash}` `GET` and `PUT` method for storing and fetching blobs
- `/builds/{namespace}/{bucket}/{buildid}/blobs/putBlobMetadata` `POST` method for storing metadata about blobs
- `/builds/{namespace}/{bucket}/{buildid}/blobs/getBlobMetadata` `POST` method for fetching metadata about blobs
- `/builds/{namespace}/{bucket}/{buildid}/blobs/exists` `POST` method for checking existance of blobs
|
| | |
| |
| |
| | |
Handling decompression or validation errors with more descriptive messages
|
| | | |
|
| | | |
|
| |/ |
|
| |
|
| |
* prioritize actual options over implicit env variable for auth token
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
- Improvement: At end of build upload we post statistics to the Jupiter build stats endpoint:
- `totalSize`
- `reusedRatio`
- `reusedBlockCount`
- `reusedBlockByteCount`
- `newBlockCount`
- `newBlockByteCount`
- `uploadedCount`
- `uploadedByteCount`
- `elapsedTimeSec`
- `uploadedBytesPerSec`
|