aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'main' into 273-integrated-memory-tracking273-integrated-memory-trackingStefan Boberg2023-12-1944-487/+1280
|\
| * ensure we can build without trace (#619)Stefan Boberg2023-12-195-2/+13
| | | | | | | | `xmake config -zentrace=n` would previously not build cleanly
| * various TSAN/ASAN/LeakAnalyzer fixes (#622)Stefan Boberg2023-12-196-10/+32
| | | | | | | | | | | | | | | | | | * fix JobQueue test threading issue. The inner job queued with `QueueJob` would reference `I` from inside the captured closure which would subsequently disappear * made sure application exit is thread safe * don't try to access string data out of bounds * keep-alive flag is accessed from multiple threads * fix memory leaks in Zen upstream client code * TSAN fixes for Event
| * fix ChunkIndexToChunkHash indexing (#621)Stefan Boberg2023-12-192-2/+2
| | | | | | would previously index into a reserved-but-not-sized vector which is bad but not crash-inducing bad
| * fix leak in IoBuffer for manifested small chunk (#618)Stefan Boberg2023-12-191-2/+2
| | | | | | | | * fix leak in IoBuffer for manifested small chunk. previously it would null out the `m_DataPtr` member on every path from `IoBufferExtendedCore::~IoBufferExtendedCore()` but it only really makes sense to null it out when the buffer has been memory mapped
| * cache RPC recorder threading fixes (#617)Stefan Boberg2023-12-193-54/+110
| | | | | | | | | | * ensure all access to m_Entries is done while holding lock * RPC recorder concurrency fixes - setup/teardown of recorder needs to be done while holding an exclusive lock. Calls into recorder should be done while holding a shared lock.
| * Fix crash bug when trying to inspect non-open block file in GC (#614)Dan Engelbrecht2023-12-182-7/+20
| |
| * Make sure we initialize the pattern of FileSink before it is added as a ↵Dan Engelbrecht2023-12-181-12/+8
| | | | | | | | usable logger (#615)
| * log each block that is compacted (#613)Dan Engelbrecht2023-12-151-0/+5
| |
| * fixed v2 rpc recording issue with >4GB data per segment (#612)Stefan Boberg2023-12-154-146/+323
| | | | | | | | | | | | | | | | | | * fixed v2 rpc recording issue with >4GB data per segment * implemented recovery logic to deal with partial RPC recordings * added check for invalid/null requests in RPC replay * also made sure at least one worker thread is configured * fix problem where "null" requests would cause infinite loop! * added basic RPC recorder tests
| * implement cache recording segment split by age (#611)Stefan Boberg2023-12-143-17/+110
| | | | | | - also fixes weird DateTime/TimeSpan comparison operator
| * Make sure IoBuffer is a valid null-buffer after move operation (#610)Dan Engelbrecht2023-12-142-4/+15
| |
| * Don't use copy of Payloads array when fetching memcached payload in GC (#609)Dan Engelbrecht2023-12-131-1/+1
| | | | | | * Don't use copy of Payloads array when fetching memcached payload in GC
| * fix peak disk load in gc status (#608)Dan Engelbrecht2023-12-131-12/+11
| | | | | | * MaxLoad is max load per monitor slot, not the MaxLoad for the entire graph
| * skip invalid chunks when reclaiming space in block store (#607)Dan Engelbrecht2023-12-131-0/+13
| | | | | | * skip invalid chunks when reclaiming space in block store
| * improve trace (#606)Dan Engelbrecht2023-12-135-37/+65
| | | | | | | | | | * Adding some more trace scopes for better visiblity * Removed spammy trace scope when replaying oplogs * Remove "::Disk" from trace scopes - redundant now that we have merge disk and memory layers
| * fix crash at log exit (#605)Dan Engelbrecht2023-12-131-7/+5
| | | | | | * keep g_FileSink alive until spdlog has shut down
| * use mimalloc where available (#601)Stefan Boberg2023-12-121-15/+11
| | | | | | enabling mimalloc path for `Memory::Alloc` and `Memory::Free`
| * Adding an info command to display a top-level summary of disk space etc (#602)Stefan Boberg2023-12-128-31/+336
| | | | | | | | | | this also adds a central, shared folder for storing information which may be found by any instance on the host. The directory is currently located alongside the default install and state directory. Initially this is used to store a collection of known `root_manifest` locations and a copy of the latest manifest version which allow us to find all known locations where zen state is present.
| * premature logging shutdown fix (#603)v0.2.36Stefan Boberg2023-12-121-0/+9
| |
| * header only compressed buffers are valid (#604)Dan Engelbrecht2023-12-121-2/+2
| | | | | | - Bugfix: Allow attachments that contains a raw size of zero
| * Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2023-12-11117-5211/+9027
| |\
| | * Make sure that PathFromHandle don't hide true error when throwing exceptions ↵Dan Engelbrecht2023-12-113-16/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | | (#600) * Make sure that PathFromHandle don't hide true error when throwing exceptions * changelog * return error info in PathFromHandle if path fails to resolve
| | * mem cache perf improvements (#592)Dan Engelbrecht2023-12-112-120/+168
| | | | | | | | | | | | | | | | | | | | | | | | - Improvement: Refactor memory cache for faster trimming and correct trim reporting - Improvement: Added trace scopes for memory cache trimming Adding a link back to the cache item payload on the memory cache item allows us to iterate over only the items cached in memory instead of over the entire index. This also allows us to do efficient compact of the memory cache array when trimming. It adds 4 bytes of overhead to each item cached in memory.
| * | removed unnecessary SHA1 referencesStefan Boberg2023-12-112-2/+0
| | |
* | | added mimalloc_hooksStefan Boberg2023-12-111-0/+32
| | |
* | | Merge remote-tracking branch 'origin/main' into 273-integrated-memory-trackingStefan Boberg2023-12-1119-148/+456
|\ \ \ | | |/ | |/|
| * | added details to trace initialization (#588)Stefan Boberg2023-12-114-11/+17
| | | | | | | | | this adds information on program name and command line to trace initialization
| * | improved scrubbing of oplogs and filecas (#596)Stefan Boberg2023-12-1117-137/+439
| | | | | | | | | | | | | | | | | | - Improvement: Scrub command now validates compressed buffer hashes in filecas storage (used for large chunks) - Improvement: Added --dry, --no-gc and --no-cas options to zen scrub command - Improvement: Implemented oplog scrubbing (previously was a no-op) - Improvement: Implemented support for running scrubbint at startup with --scrub=<options>
* | | Merge remote-tracking branch 'origin/main' into 273-integrated-memory-trackingStefan Boberg2023-12-115-78/+132
|\| |
| * | multi-line logging improvements (#597)Stefan Boberg2023-12-114-78/+127
| | | | | | | | | | | | | | | | | | * added ZEN_SCOPED_WARN and implemented multi-line logging * changed so file log also uses `fullformatter` for consistency and to get the multi-line support across the board
| * | SuppressConsoleLog now removes any existing console logger (#599)Stefan Boberg2023-12-111-0/+5
| | | | | | | | | SuppressConsoleLog now removes any existing console logger to avoid exceptions in spdlog
* | | Merge remote-tracking branch 'origin/main' into 273-integrated-memory-trackingStefan Boberg2023-12-1113-206/+400
|\| |
| * | fix deadlock at bucket creation (#598)Dan Engelbrecht2023-12-112-177/+205
| | | | | | | | | | | | | | | | | | - Make sure we don't hold the namespace bucket lock when we create buckets to avoid deadlock - Pass lock scope to helper functions to clarify locking rules - Block flush and gc operations for a bucket that is not yet initialized - Add ZenCacheDiskLayer::GetOrCreateBucket to avoid code duplication
| * | Merge branch 'main' into zs/get-all-chunk-infoszs/get-all-chunk-infoszousar2023-12-0731-209/+512
| |\ \
| | * | fixed bug in CasContainerStrategy::ReadIndexFile (#595)Stefan Boberg2023-12-071-1/+3
| | | | | | | | | | | | this was introduced in a recent optimization and would cause CAS items to not be found after a shutdown/restart cycle
| | * | logging configuration via command line options (#589)Stefan Boberg2023-12-066-7/+114
| | | | | | | | | | | | | | | | | | | | | | | | | | | | with these changes it is possible to configure loggers on the command line. For instance: `xmake run zenserver --log-trace=http_requests,http` will configure the system so that the `http_request` and `http` loggers are set to TRACE level
| | * | Use correct iterator index when looking up memcached payload in ↵Dan Engelbrecht2023-12-051-5/+4
| | | | | | | | | | | | | | | | | | | | GatherReferences (#591) * Use correct iterator index when looking up memcached payload in gatherreferences
| * | | Change naming to ChunkInfos instead of Chunkszousar2023-12-064-12/+12
| | | |
| * | | Ran precommitzousar2023-12-052-7/+3
| | | |
| * | | Get hash when retrieving chunkszousar2023-12-052-7/+32
| | | | | | | | | | | | | | | | Also changes the returned fields for each chunk from size->rawsize. Backwards compatibility is not a concern as this was unused in past zenserver releases.
| * | | Add endpoint for all chunk infoszousar2023-12-013-8/+45
| | | | | | | | | | | | | | | | Add endpoint for querying all chunk infos in an oplog.
* | | | hide Windows stuffStefan Boberg2023-12-081-0/+4
| | | |
* | | | stubStefan Boberg2023-12-071-0/+3
| | | |
* | | | cleaned up some namingStefan Boberg2023-12-071-3/+3
| | | |
* | | | implemented FlushDataOnly for MacOSStefan Boberg2023-12-071-1/+29
| | | | | | | | | | | | | | | | also added handling of NtFlushBuffersFileEx for certain SDK versions
* | | | ClangFormatStefan Boberg2023-12-071-1/+1
| | | |
* | | | added BasicFile::FlushDataOnlyStefan Boberg2023-12-072-0/+39
| | | |
* | | | minor editsStefan Boberg2023-12-071-1/+5
| | | |
* | | | linux/mac build fixStefan Boberg2023-12-061-2/+5
| | | |
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-05 09:39:15 +0000