aboutsummaryrefslogtreecommitdiff
path: root/zenserver/cache
Commit message (Collapse)AuthorAgeFilesLines
...
* | | Add /vsxmake* to .gitignoreStefan Boberg2021-11-032-3/+36
| | |
* | | projectstore: added validation of oplog data during initializationStefan Boberg2021-11-011-4/+21
| | | | | | | | | | | | also added validation during writing
* | | Merged from mainStefan Boberg2021-10-294-16/+70
|\ \ \ | | |/ | |/|
| * | Minor cleanupStefan Boberg2021-10-291-37/+2
| | |
| * | z$: hooked up bucket traversal for gcStefan Boberg2021-10-292-14/+121
| | | | | | | | | | | | | | | added some tests added "test" mode for zenserver, to run any tests embedded in the zenserver (example: `zenserver test -tx=z$.*`)
| * | Removed unused source filesStefan Boberg2021-10-292-14/+0
| |/
* | general: Fixed up some vcxproj files which had a warning level setStefan Boberg2021-10-241-3/+2
| | | | | | | | | | | | Thus they did not get the same settings as all other projects which made it easy to introduce warnings which would trigger in xmake builds Cleaned up some #include usage to use third-party include brackets
* | clang-formatStefan Boberg2021-10-231-2/+2
| |
* | z$: Removed CasStoreStefan Boberg2021-10-212-13/+2
| |
* | gc: Added GcStorage base class and hooked it up to CasGcStefan Boberg2021-10-212-13/+13
| |
* | gc: Made ref tracking optional on `ZEN_USE_REF_TRACKING`Stefan Boberg2021-10-191-1/+1
| | | | | | | | Ref tracking is not fully functional anyway
* | cas: Hooked up GC to structured cacheStefan Boberg2021-10-192-27/+51
| |
* | gc: moved GcContect from CAS into gc filesStefan Boberg2021-10-181-1/+7
|/
* structured cache: Implemented GarbageCollect() for disk and memory bucketsStefan Boberg2021-10-161-26/+87
|
* structured cache: fixed mistake in back-off logicStefan Boberg2021-10-151-9/+14
| | | | this bug would make PUTs to clean zen instances very slow
* clang-formatStefan Boberg2021-10-151-1/+1
|
* structuredcache: add code to handle conflict which can occur when multiple ↵Stefan Boberg2021-10-131-8/+27
| | | | PUTs of the same value occur close enough to cause issues due to file system races
* Ratios should not be percentages (this should be done in presentation)Stefan Boberg2021-10-111-2/+2
|
* stats: Added support for handler unregistrationStefan Boberg2021-10-111-2/+6
|
* structured cache: Added locking around large cache value updates to prevent ↵Stefan Boberg2021-10-061-13/+37
| | | | races leading to file sharing violations
* Support for asynchronous HTTP response processing (#19)Stefan Boberg2021-10-062-120/+120
| | | | | | | | This change introduces WriteResponseAsync which can be used to move potentially slow request handler code (like upstream lookups) off the I/O service thread to ensure we are always able to serve as many HTTP requests as possible. The current implementation defaults to 16 async worker threads and there is currently no back-pressure. - Added RequestStats - Metrics for network requests. Aggregates tracking of duration, payload sizes into a single class for ease of use - Added some metrics on upstream communication Co-authored-by: Per Larsson <[email protected]>
* Merged from upstreamStefan Boberg2021-10-054-71/+201
|
* http: Moved logic for body suppression to a more central locationStefan Boberg2021-10-031-8/+0
| | | | this should prevent some mistake-induced bugs hopefully
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2021-10-031-4/+27
|\
| * Merged from upstreamStefan Boberg2021-10-031-3/+24
| |\
| | * Added support for SkipData cache policy.Per Larsson2021-10-031-3/+24
| | |
| * | structurec cache: Added ad hoc special case for /z$/stats.json requestStefan Boberg2021-10-031-1/+3
| |/
* / structured cache: Added some more stats (hits/misses/upstream_hits)Stefan Boberg2021-10-021-0/+2
|/
* cas: added some GC stubsStefan Boberg2021-10-012-33/+25
|
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2021-10-012-0/+35
|\
| * Added cache HIT/MISS stat counters.Per Larsson2021-10-012-0/+35
| |
* | structured cache: Fixed package payload endpoint handling of HEADStefan Boberg2021-10-011-1/+1
|/
* Improved error handling for upstream endpoints.Per Larsson2021-10-011-1/+1
|
* Added upstream cache perf metrics.Per Larsson2021-10-011-0/+6
|
* structured cache: fixed how HEAD requests are handledStefan Boberg2021-09-301-1/+1
| | | | | | the SetSuppressResponseBody() is currently sensitive to ordering and would end up getting called too late to apply fixes UE-129788, UE-129793
* structured cache: Rewrote metrics tracking using OperationTimingStefan Boberg2021-09-302-9/+3
|
* structured cache: added request meter and stats reportingStefan Boberg2021-09-302-1/+7
|
* structured cache: Added stats test code (needs additional work / metrics)Stefan Boberg2021-09-302-0/+23
|
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2021-09-281-30/+50
|\
| * Removed using the bucket name to detect binary cache records and store ↵Per Larsson2021-09-281-30/+50
| | | | | | | | content type in cache.
* | Removed MemoryOutStream, MemoryInStreamStefan Boberg2021-09-281-6/+4
|/ | | | | | | | BinaryWriter/BinaryReader now implements memory buffer functionality which previously needed two chained instances of a Buffer/Reader. This was originally expected to be an abstraction for file and other stream access but this is not going to be useful so may as well collapse the functionality. This also eliminates the need for stack-aware ref-counting which is the real reason for wanting to get rid of this code. This was a very old experimental feature which turned out to be a bad idea. This also removes the /cas/batch endpoint
* Removed unused KV cache related codeStefan Boberg2021-09-262-336/+0
|
* Eliminated use of ATL in StructuredCacheStore implementationStefan Boberg2021-09-261-41/+39
|
* Added scrubbing logic to ZenCacheDiskLayer/ZenCacheMemoryLayerStefan Boberg2021-09-232-49/+153
| | | | This currently only goes through the motions of hashing the data to verify it, but does not perform recovery nor does it validate referential integrity
* Fixed unused variable warningStefan Boberg2021-09-221-1/+0
|
* Refactored get/set cache pyload.Per Larsson2021-09-212-98/+87
|
* Merge branch 'main' of https://github.com/EpicGames/zenPer Larsson2021-09-214-1/+19
|\
| * Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2021-09-211-1/+1
| |\
| * | Wired up scrubbing to more higher level servicesStefan Boberg2021-09-214-1/+19
| | | | | | | | | | | | Also moved sharding logic for filecas into a function to redduce cut/pasta
* | | Refactored out get/set cache record.Per Larsson2021-09-212-348/+300
| |/ |/|