aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'main' of https://github.ol.epicgames.net/ue-foundation/zen ↵tb/dockerEPICGAMES\thierry.begin2024-04-0857-493/+938
|\ | | | | | | into tb/docker
| * Merge pull request #41 from ue-foundation/zs/import-oplog-cleanZousar Shaker2024-04-053-5/+19
| |\ | | | | | | Zs/import oplog clean
| | * Update changelogzousar2024-04-051-0/+1
| | |
| | * precommitzousar2024-04-041-1/+6
| | |
| | * Add optional gcpath param to import-oplog cmdzousar2024-04-042-2/+10
| | |
| | * Categorize the clean argument on oplog-import as a general argzousar2024-04-042-3/+3
| |/
| * 5.4.4-pre0v5.4.4-pre0Dan Engelbrecht2024-04-041-1/+1
| |
| * fix changelogDan Engelbrecht2024-04-041-3/+13
| |
| * improved assert (#37)Dan Engelbrecht2024-04-0446-167/+594
| | | | | | | | - Improvement: Add file and line to ASSERT exceptions - Improvement: Catch call stack when throwing assert exceptions and log/output call stack at important places to provide more context to caller
| * hardening parsepackagemessage (#38)Dan Engelbrecht2024-04-043-37/+75
| | | | | | * hardening of ParsePackageMessage and extended details when malformed attachments are detected
| * validate rpc chunk responses (#36)Dan Engelbrecht2024-04-035-20/+35
| | | | | | * Validate size of found chunks in cas/cache
| * zenremoteprojectstore with httpclient (#35)Dan Engelbrecht2024-04-038-211/+117
| | | | | | | | | | | | - Bugfix: Fix log of Success/Failure for oplog import - Improvement: Use HttpClient when doing oplog export/import with a zenserver as a remote target. Includes retry logic - Improvement: Increase the retry count to 4 (5 attempts in total) when talking to Jupiter for oplog export/import
| * compressed header reading opt (#33)Dan Engelbrecht2024-04-032-53/+88
| | | | | | * refactor so we don't have to re-read data from source to get block sizes
* | Add docker supportEPICGAMES\thierry.begin2024-04-084-0/+118
|/
* 5.4.3v5.4.3Dan Engelbrecht2024-03-281-1/+1
|
* 5.4.3-pre0v5.4.3-pre0Dan Engelbrecht2024-03-281-1/+1
|
* Fix sentry using wrong folder path when data path contains non-anscii ↵Dan Engelbrecht2024-03-282-3/+4
| | | | | characters (#32) * Fix sentry using wrong folder path when data path contains non-ascii characters
* Use multithreading to fetch size/rawsize of entries in ↵Dan Engelbrecht2024-03-289-68/+200
| | | | | | `/prj/{project}/oplog/{log}/chunkinfos` and `/prj/{project}/oplog/{log}/files` (#30) - Improvement: Use multithreading to fetch size/rawsize of entries in `/prj/{project}/oplog/{log}/chunkinfos` and `/prj/{project}/oplog/{log}/files` - Improvement: Add `GetMediumWorkerPool()` in addition to `LargeWorkerPool()` and `SmallWorkerPool()`
* add "fieldnames" query param for GetProjectFiles/GetProjectChunkInfos (#29)Dan Engelbrecht2024-03-284-23/+143
| | | | | | | | - Improvement: It is now possible to control which fields to include in `/prj/{project}/oplog/{log}/chunkinfos` request by adding a comma delimited list of filed names for `fieldnames` parameter - Default fields are: `id`, `rawhash` and `rawsize` (translates to `?fieldnames=id,rawhash,rawsize`) - Use `?fieldnames=*` to get all the fields - Improvement: It is now possible to control which fields to include in `/prj/{project}/oplog/{log}/files` request by adding a comma delimited list of filed names for `fieldnames` parameter - Default fields are: `id`, `clientpath` and `serverpath` (translates to `?fieldnames=id,clientpath,serverpath`), `filter=client` only applies if `fieldnames` is not given as a parameter - Use `?fieldnames=*` to get all the fields
* Faster reading of compressed buffer headers by not materializing entire ↵Dan Engelbrecht2024-03-282-22/+53
| | | | source buffer (#28)
* Get raw size for compressed chunks correctly for ↵Dan Engelbrecht2024-03-272-1/+10
| | | | `/prj/{project}/oplog/{log}/chunkinfos` (#27)
* 5.4.2v5.4.2Dan Engelbrecht2024-03-261-1/+1
|
* make existing block log clearerDan Engelbrecht2024-03-261-1/+1
|
* 5.4.2-pre17v5.4.2-pre17Dan Engelbrecht2024-03-261-1/+1
|
* fix order of parameters in block check result message (#26)Dan Engelbrecht2024-03-261-1/+1
| | | * fix order of parametes in block check result message
* add yaml serialization support (#3)Stefan Boberg2024-03-2611-783/+1250
| | | | | | | this change adds serialization of payloads as YAML, but not parsing. The implementation is somewhat based on the JSON path, and may be collapsed eventually as it is possible to serialize JSON format using the same code it also separates out the JSON serialization into a separate file for ease of maintenance any HTTP request response may be formatted as yaml by using a `.yaml` suffix or an `Accept: text/yaml` header
* add filter to projectstore entries request (#25)Dan Engelbrecht2024-03-264-6/+105
| | | | | | | * Add HttpServerRequest::Decode to decode http request parameters * Add support to filter projectstore `entries` request using the `fieldfilter` where the wanted fields are comma (,) delimited * Add support for responding with compressed payloads for projectstore `entries` requests by adding AcceptType `compressed-binary` to the request header * Add support for responding with compressed payloads for projectstore `files` requests by adding AcceptType `compressed-binary` to the request header * Add support for responding with compressed payloads for projectstore `chunkinfo` requests by adding AcceptType `compressed-binary` to the request header
* remove redundant json11 includesStefan Boberg2024-03-262-2/+0
|
* 5.4.2-pre16v5.4.2-pre16Dan Engelbrecht2024-03-251-1/+1
|
* consistent paths encoding (#24)Dan Engelbrecht2024-03-256-50/+53
| | | | * Don't encode filesystem path to UTF8 unless stored in compactbinary string * Be consistent where we encode/decode paths to UTF8
* add a limit to the number of times we attempt to finalize (#22)Dan Engelbrecht2024-03-257-95/+157
| | | | | | - Improvement: Add limit to the number of times we attempt to finalize and exported oplog - Improvement: Switch to large thread pool when executing oplog export/import - Improvement: Clean up reporting of missing attachments in oplog export/import - Improvement: Remove double-reporting of abort reason for oplog export/import
* use batch request for checking existing blocks as Jupiter is now fixed (#20)v5.4.2-pre15v5.4.2-pre14Dan Engelbrecht2024-03-231-41/+10
|
* re-enable partial cache chunks (#21)v5.4.2-pre9v5.4.2-pre12v5.4.2-pre11v5.4.2-pre10Dan Engelbrecht2024-03-224-28/+40
| | | | * Separate chunk raw hash from section hash (how to find the fragment attachment) * fix partial get cache value tests
* 5.4.2-pre7v5.4.2-pre7Dan Engelbrecht2024-03-221-1/+1
|
* check existance of reused blocks (#18)Dan Engelbrecht2024-03-226-43/+168
| | | | | * Add HasAttachments to RemoteProjectStore so we can query if attachment blocks actually exist * use individual requests for compressed blob check in Jupiter * remove weird 1000.5 to 1000.0 when converting seconds to milliseconds
* disable partial getcachechunk responses (#19)Dan Engelbrecht2024-03-222-2/+7
|
* Edit action name for brevityStefan Boberg2024-03-211-1/+1
|
* added action to mirror repo to github.com (#17)Stefan Boberg2024-03-212-1/+22
|
* harden attach sponsor process (#14)Dan Engelbrecht2024-03-218-47/+74
| | | | | - Improvement: Delay exiting due to no sponsor processes by one second to handle race conditions - Improvement: Safer IsProcessRunning check - Improvement: make sure we can RequestApplicationExit safely from any thread
* 5.4.2-pre6v5.4.2-pre6Dan Engelbrecht2024-03-211-1/+1
|
* locking action-cond to 1.1.1Dan Engelbrecht2024-03-211-1/+1
|
* add support for responding with partial cache chunks (#11)Dan Engelbrecht2024-03-217-17/+269
| | | * add support for responding with partial cache chunks
* improved process monitoring behaviour with invalid pids (#16)Stefan Boberg2024-03-214-14/+42
|
* 5.4.2-pre5Dan Engelbrecht2024-03-211-1/+1
|
* use [email protected] to avoid node20 problemsStefan Boberg2024-03-211-2/+2
|
* 5.4.2-pre4Dan Engelbrecht2024-03-201-1/+1
|
* re-enable macos signing (#15)Dan Engelbrecht2024-03-202-4/+2
|
* 5.4.2-pre3Dan Engelbrecht2024-03-201-1/+1
|
* non memory copy compressed range (#13)Dan Engelbrecht2024-03-207-44/+278
| | | | | * Add CompressedBuffer::GetRange that references source data rather than make a memory copy * Use Compressed.CopyRange in project store GetChunkRange * docs for CompressedBuffer::CopyRange and CompressedBuffer::GetRange
* remove hv tags on actions since they are no longer usefulStefan Boberg2024-03-202-9/+9
| | | | we use `zen` tags to discriminate now instead