aboutsummaryrefslogtreecommitdiff
path: root/zenserver/cache
Commit message (Collapse)AuthorAgeFilesLines
* bump cache large object size limit to 128Kb (#191)Dan Engelbrecht2022-11-211-1/+1
| | | | * bump cache large object size limit to 128Kb * changelog
* Add `import-project` and `export-project` (#183)Dan Engelbrecht2022-11-181-6/+9
| | | * Add `import-project` and `export-project` command line parsing
* move BasicFile to zenutil to remove zenstore dependency from zen command (#190)Dan Engelbrecht2022-11-171-1/+0
|
* Support file reference in package message (#184)Dan Engelbrecht2022-11-073-9/+29
| | | | | | | | * Fix packed message parsing for absolute path * Always enable are sharing when opening files as IoBuffers. * Allow control over sending partial files as localfile ref * Check "AcceptFlags" field in RPC message for allowing localfile ref in reply * make oplog entry add operations ZEN_DEBUG level logs * changelog
* Add "Accept" field in RPC request to gracefully handle requests from older ↵Dan Engelbrecht2022-10-132-23/+101
| | | | instances (#180)
* Format all rpc package responses using `FormatPackageMessageBuffer` to avoid ↵Dan Engelbrecht2022-09-291-26/+10
| | | | | memory copy (#174) When reading upstream, fall back to old rpc response to handle older instances.
* De/more upstream details (#168)v0.1.6-pre9v0.1.6-pre10Dan Engelbrecht2022-09-221-93/+166
| | | | | | * Pass along endpoint info for each upstream request * Add more timing details in log * more log details for single item upstream fetch * DISABLEDQUERY over SKIP
* rename URI chunk requests from value -> chunk (#166)Dan Engelbrecht2022-09-192-10/+10
|
* Adjust errors vs warnings messages (#160)Dan Engelbrecht2022-09-081-1/+1
| | | | * demote a number of ZEN_ERROR to ZEN_WARN * changelog
* Remove legacy code (#161)Dan Engelbrecht2022-09-081-12/+10
| | | | * changelog * remove obsolete legacy code
* Implement proper GetCacheValues upstream (#155)Dan Engelbrecht2022-09-061-17/+34
| | | | * Implement proper GetCacheValues upstream * changelog
* Use "\\?\" prefixed paths and fix hardcoded path delimiters (#149)Dan Engelbrecht2022-08-261-1/+3
| | | | | | * use "\\?\" prefix for windows paths * fix path delimiters * disable vcpkg caching * Workaround for spdlog not being able to create directories prefixed with `\\?\`
* Make cas storage an hidden implementation detail of CidStore (#130)v0.1.4-pre6v0.1.4-pre5Dan Engelbrecht2022-06-173-563/+193
| | | | | | | | | | | | | | | | | | - Bumped ZEN_SCHEMA_VERSION - CasStore no longer a public API, it is hidden behind CidStore - Moved cas.h from public header folder - CidStore no longer maps from Cid -> Cas, we store entries in Cas under RawHash - CasStore now decompresses data to validate content (matching against RawHash) - CasChunkSet renames to HashKeySet and put in separate header/cpp file - Disabled "Chunk" command for now as it relied on CAS being exposed as a service - Changed CAS http service to Cid http server - Moved "Run" command completely inside ZEN_WITH_EXEC_SERVICES define - Removed "cas.basic" test - Uncommented ".exec.basic" test and added return-skip at start of test - Moved ScrubContext to separate header file - Renamed CasGC to GcManager - Cleaned up configuration passing in cas store classes - Removed CAS stuff from GcContext and clarified naming in class - Remove migration code
* merged from mainStefan Boberg2022-06-161-24/+116
|
* removed unnecessary CasStore forward declarationsStefan Boberg2022-06-132-2/+0
|
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2022-06-111-5/+7
|\
| * namespace/bucket validation now uses AsciiSet for more efficient validation ↵Stefan Boberg2022-06-101-5/+7
| | | | | | | | (#127)
* | fixed mac build ("unused" variable)Stefan Boberg2022-06-111-0/+2
|/
* Corrected some typos in log messagesStefan Boberg2022-06-081-3/+5
|
* Merge branch 'main' into de/add-log-for-invalid-namesDan Engelbrecht2022-06-081-2/+2
|\
| * Use m_BucketDir for cache key contextDan Engelbrecht2022-06-081-2/+2
| | | | | | | | Easier to debug and no conflicts
| * We need to make each Cache Key contribution per bucket unique even across ↵Dan Engelbrecht2022-06-071-2/+2
| | | | | | | | namespaces
* | add warnings on illegal namespace/bucket namesDan Engelbrecht2022-06-081-0/+5
|/
* Don't hold index lock while reading standalone valuesDan Engelbrecht2022-06-031-0/+2
| | | | Can cause deadlock
* hardening of ZenCacheDiskLayer::CacheBucket::PutStandaloneCacheValueDan Engelbrecht2022-06-031-13/+36
|
* add comment about removing filesDan Engelbrecht2022-05-301-0/+1
|
* Enable FILE_SHARE_DELETE on standalone files in disk bucketsDan Engelbrecht2022-05-281-107/+77
| | | | | | | | This allows us to delete the file even if it is open for read. We do a delete, the rename since we are not allowed to do a rename-overwrite, only delete. As we have the shard lock for the file we want to replace we can safely do a delete+rename. In the rare case that we fail to rename the file into place the old data is lost. As this is a *cache* and it should be very rare this is OK.
* NameSpaceMap -> NamespaceMapDan Engelbrecht2022-05-251-2/+2
|
* bugfixes and test for namespace dropDan Engelbrecht2022-05-251-15/+92
|
* clean up namespace foldersDan Engelbrecht2022-05-251-36/+42
|
* namespace dropDan Engelbrecht2022-05-253-12/+38
|
* Make sure ZenCacheMemoryLayer handles dropped buckets correctly (just like ↵Dan Engelbrecht2022-05-252-36/+95
| | | | ZenCacheDiskLayer)
* dropIndex -> DropIndexDan Engelbrecht2022-05-251-3/+3
|
* If a bucket is in m_BucketMap it is OK, no need for separate flagDan Engelbrecht2022-05-252-59/+22
|
* drop bucket testDan Engelbrecht2022-05-241-0/+73
|
* Use rename/delete and keep pointer for dropped bucketsDan Engelbrecht2022-05-242-77/+129
|
* Make sure to hold exclusive lock over index and all shard locks.Dan Engelbrecht2022-05-241-1/+9
| | | | Clear index on drop.
* Merge pull request #102 from EpicGames/de/auto-create-namespacesDan Engelbrecht2022-05-242-20/+62
|\ | | | | Automatically create namespaces on requests (if enabled via configuration)
| * Automatically create namespaces on requests (if enabled via configuration)Dan Engelbrecht2022-05-202-20/+62
| |
* | De/fix namespace folder scanning (#103)Dan Engelbrecht2022-05-231-1/+1
|/
* fix mac compilation errorDan Engelbrecht2022-05-191-1/+1
|
* Merge pull request #99 from EpicGames/de/move-namespace-fieldDan Engelbrecht2022-05-194-112/+163
|\ | | | | Keep Namespace out of CacheKey and store it on request level
| * fix testsDan Engelbrecht2022-05-191-5/+5
| |
| * migrate legacy cache folders to ue4.ddc namespaceDan Engelbrecht2022-05-192-6/+21
| | | | | | | | | | map default namespace to at runtime ue4.ddc use a non-valid name for the default namespace so we avoid any collision or accidental creation of folder for that
| * Keep Namespace out of CacheKey and store it on request levelDan Engelbrecht2022-05-192-101/+137
| | | | | | | | | | RPC requests now has a Namespace field under Params instead of one Namespace per cache key Fall back to legacy upstream HTTP URI format if default namespace is requested
* | Fix and retry count and add an extra iteration to give more time for successDan Engelbrecht2022-05-191-5/+5
|/
* align bucket naming rules with UE code baseDan Engelbrecht2022-05-181-3/+4
|
* fix release build, misplaced namespace bracketsDan Engelbrecht2022-05-171-4/+0
|
* review feedbackDan Engelbrecht2022-05-162-32/+31
|
* drop api/v2 prefix for non-legacy requestsDan Engelbrecht2022-05-161-112/+172
|