aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* 0.2.39-pre0v0.2.39-pre0Stefan Boberg2023-12-201-1/+1
|
* release RPC recording memory early (#627)Stefan Boberg2023-12-201-2/+7
| | | previously the segment would call `clear()` on the `m_Entries` vector but this does not release the backing memory so we have to do the `swap` dance
* separate RPC processing from HTTP processing (#626)Stefan Boberg2023-12-2032-1790/+2006
| | | | | | * moved all RPC processing from HttpStructuredCacheService into separate CacheRpcHandler class in zenstore * move package marshaling to zenutil. was previously in zenhttp/httpshared but it's useful in other contexts as well where we don't want to depend on zenhttp * introduced UpstreamCacheClient, this provides a subset of functions on UpstreamCache and lives in zenstore
* move cachedisklayer and structuredcachestore into zenstore (#624)Stefan Boberg2023-12-1912-28/+27
|
* 0.2.38v0.2.38Dan Engelbrecht2023-12-191-1/+1
|
* 0.2.38-pre2v0.2.38-pre2Dan Engelbrecht2023-12-191-1/+1
|
* Don't capture local variables in loop by reference (#623)Dan Engelbrecht2023-12-192-27/+28
| | | * Don't capture local variables in loop by reference
* ensure we can build without trace (#619)Stefan Boberg2023-12-196-2/+14
| | | | `xmake config -zentrace=n` would previously not build cleanly
* various TSAN/ASAN/LeakAnalyzer fixes (#622)Stefan Boberg2023-12-197-11/+34
| | | | | | | | | * fix JobQueue test threading issue. The inner job queued with `QueueJob` would reference `I` from inside the captured closure which would subsequently disappear * made sure application exit is thread safe * don't try to access string data out of bounds * keep-alive flag is accessed from multiple threads * fix memory leaks in Zen upstream client code * TSAN fixes for Event
* fix ChunkIndexToChunkHash indexing (#621)Stefan Boberg2023-12-192-2/+2
| | | would previously index into a reserved-but-not-sized vector which is bad but not crash-inducing bad
* fix leak in IoBuffer for manifested small chunk (#618)Stefan Boberg2023-12-192-2/+3
| | | | * fix leak in IoBuffer for manifested small chunk. previously it would null out the `m_DataPtr` member on every path from `IoBufferExtendedCore::~IoBufferExtendedCore()` but it only really makes sense to null it out when the buffer has been memory mapped
* cache RPC recorder threading fixes (#617)Stefan Boberg2023-12-194-54/+111
| | | | | * ensure all access to m_Entries is done while holding lock * RPC recorder concurrency fixes - setup/teardown of recorder needs to be done while holding an exclusive lock. Calls into recorder should be done while holding a shared lock.
* Fix crash bug when trying to inspect non-open block file in GC (#614)Dan Engelbrecht2023-12-183-7/+21
|
* Make sure we initialize the pattern of FileSink before it is added as a ↵Dan Engelbrecht2023-12-182-12/+9
| | | | usable logger (#615)
* 0.2.38-pre1v0.2.38-pre1Dan Engelbrecht2023-12-151-1/+1
|
* add signing identity when creating release (windows)Dan Engelbrecht2023-12-151-1/+1
|
* log each block that is compacted (#613)Dan Engelbrecht2023-12-152-0/+6
|
* 0.2.38-pre0v0.2.38-pre0Stefan Boberg2023-12-151-1/+1
|
* fixed v2 rpc recording issue with >4GB data per segment (#612)Stefan Boberg2023-12-155-146/+326
| | | | | | | | | * fixed v2 rpc recording issue with >4GB data per segment * implemented recovery logic to deal with partial RPC recordings * added check for invalid/null requests in RPC replay * also made sure at least one worker thread is configured * fix problem where "null" requests would cause infinite loop! * added basic RPC recorder tests
* windows executable signing (#566)Dan Engelbrecht2023-12-153-3/+31
| | | Windows executables are now signed with official cert when creating a release
* changelogDan Engelbrecht2023-12-141-1/+3
|
* implement cache recording segment split by age (#611)Stefan Boberg2023-12-144-17/+111
| | | - also fixes weird DateTime/TimeSpan comparison operator
* 0.2.37v0.2.37Dan Engelbrecht2023-12-141-1/+1
|
* 0.2.37-pre2v0.2.37-pre2Dan Engelbrecht2023-12-141-1/+1
|
* Make sure IoBuffer is a valid null-buffer after move operation (#610)Dan Engelbrecht2023-12-143-4/+16
|
* 0.2.37-pre1v0.2.37-pre1Dan Engelbrecht2023-12-131-1/+1
|
* Don't use copy of Payloads array when fetching memcached payload in GC (#609)Dan Engelbrecht2023-12-132-1/+2
| | | * Don't use copy of Payloads array when fetching memcached payload in GC
* 0.2.37-pre0v0.2.37-pre0Dan Engelbrecht2023-12-131-1/+1
|
* spelling in changelogDan Engelbrecht2023-12-131-1/+1
|
* fix peak disk load in gc status (#608)Dan Engelbrecht2023-12-132-12/+12
| | | * MaxLoad is max load per monitor slot, not the MaxLoad for the entire graph
* skip invalid chunks when reclaiming space in block store (#607)Dan Engelbrecht2023-12-132-0/+14
| | | * skip invalid chunks when reclaiming space in block store
* improve trace (#606)Dan Engelbrecht2023-12-136-37/+66
| | | | | * Adding some more trace scopes for better visiblity * Removed spammy trace scope when replaying oplogs * Remove "::Disk" from trace scopes - redundant now that we have merge disk and memory layers
* fix crash at log exit (#605)Dan Engelbrecht2023-12-132-7/+6
| | | * keep g_FileSink alive until spdlog has shut down
* changelogDan Engelbrecht2023-12-121-1/+3
|
* use mimalloc where available (#601)Stefan Boberg2023-12-121-15/+11
| | | enabling mimalloc path for `Memory::Alloc` and `Memory::Free`
* Adding an info command to display a top-level summary of disk space etc (#602)Stefan Boberg2023-12-128-31/+336
| | | | | this also adds a central, shared folder for storing information which may be found by any instance on the host. The directory is currently located alongside the default install and state directory. Initially this is used to store a collection of known `root_manifest` locations and a copy of the latest manifest version which allow us to find all known locations where zen state is present.
* premature logging shutdown fix (#603)v0.2.36Stefan Boberg2023-12-122-0/+10
|
* 0.2.36Dan Engelbrecht2023-12-121-1/+1
|
* header only compressed buffers are valid (#604)Dan Engelbrecht2023-12-122-2/+3
| | | - Bugfix: Allow attachments that contains a raw size of zero
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2023-12-111-1/+1
|\
| * 0.2.36-pre4v0.2.36-pre4Dan Engelbrecht2023-12-111-1/+1
| |
* | Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2023-12-11126-5259/+9299
|\|
| * Make sure that PathFromHandle don't hide true error when throwing exceptions ↵Dan Engelbrecht2023-12-114-16/+32
| | | | | | | | | | | | | | | | | | (#600) * Make sure that PathFromHandle don't hide true error when throwing exceptions * changelog * return error info in PathFromHandle if path fails to resolve
| * mem cache perf improvements (#592)Dan Engelbrecht2023-12-113-120/+170
| | | | | | | | | | | | | | | | - Improvement: Refactor memory cache for faster trimming and correct trim reporting - Improvement: Added trace scopes for memory cache trimming Adding a link back to the cache item payload on the memory cache item allows us to iterate over only the items cached in memory instead of over the entire index. This also allows us to do efficient compact of the memory cache array when trimming. It adds 4 bytes of overhead to each item cached in memory.
| * Update CHANGELOG.mdStefan Boberg2023-12-111-0/+4
| | | | | | failed to push my edit to CHANGELOG.md before merging to main...
| * added details to trace initialization (#588)Stefan Boberg2023-12-115-11/+18
| | | | | | this adds information on program name and command line to trace initialization
| * improved scrubbing of oplogs and filecas (#596)Stefan Boberg2023-12-1117-137/+439
| | | | | | | | | | | | - Improvement: Scrub command now validates compressed buffer hashes in filecas storage (used for large chunks) - Improvement: Added --dry, --no-gc and --no-cas options to zen scrub command - Improvement: Implemented oplog scrubbing (previously was a no-op) - Improvement: Implemented support for running scrubbint at startup with --scrub=<options>
| * multi-line logging improvements (#597)Stefan Boberg2023-12-115-78/+128
| | | | | | | | | | | | * added ZEN_SCOPED_WARN and implemented multi-line logging * changed so file log also uses `fullformatter` for consistency and to get the multi-line support across the board
| * SuppressConsoleLog now removes any existing console logger (#599)Stefan Boberg2023-12-111-0/+5
| | | | | | SuppressConsoleLog now removes any existing console logger to avoid exceptions in spdlog
| * fix deadlock at bucket creation (#598)Dan Engelbrecht2023-12-113-177/+209
| | | | | | | | | | | | - Make sure we don't hold the namespace bucket lock when we create buckets to avoid deadlock - Pass lock scope to helper functions to clarify locking rules - Block flush and gc operations for a bucket that is not yet initialized - Add ZenCacheDiskLayer::GetOrCreateBucket to avoid code duplication