aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* add ignore-missing-attachments option to oplog export (debugging tool) (#641)Dan Engelbrecht2024-01-258-39/+70
| | | | | | | * add ignore-missing-attachments option to oplog export (debugging tool) * add more status codes to do retry for in http client * add missing X-Jupiter-IoHash header for jupiter PutRef * reduce oplog block size to reduce amount of redundant chunks to download * improved logging
* 0.2.39-pre2v0.2.39-pre2Dan Engelbrecht2024-01-241-1/+1
|
* Use proper format for range request header (#640)Dan Engelbrecht2024-01-241-4/+10
| | | | Clear header callback after use Use separate temp-vector for headers
* 0.2.39-pre1v0.2.39-pre1Dan Engelbrecht2024-01-241-1/+1
|
* Add retry with optional resume logic to HttpClient::Download (#639)Dan Engelbrecht2024-01-2410-1258/+693
| | | | | | | - Improvement: Refactored Jupiter upstream to use HttpClient - Improvement: Added retry and resume logic to HttpClient - Improvement: Added authentication support to HttpClient - Improvement: Clearer logging in GCV2 compact of FileCas/BlockStore - Improvement: Size details in oplog import logging
* oplog import/export improvements (#634)Dan Engelbrecht2024-01-235-226/+373
| | | | * improve feedback from oplog import/export * improve oplog save performance
* add --ignore-missing-attachments to oplog-import command (#637)Dan Engelbrecht2024-01-226-53/+99
|
* improved errors from jupiter upstream (#636)Dan Engelbrecht2024-01-224-6/+83
| | | * get more detailed error messages from jupiter upstream
* jobqueue - allow multiple threads to report progress/messages (#635)Dan Engelbrecht2024-01-225-19/+39
| | | jobqueue - add AbortReason and properly propagate error when running async command
* make sure to advance read buffer pointer in BasicFileWriter::Write (#633)Dan Engelbrecht2024-01-222-1/+4
|
* Use correct HTTP range values. (#632)Per Larsson2024-01-171-1/+1
|
* reinstate formatter settings for file sink (#631)Stefan Boberg2024-01-172-0/+10
| | | fixes issue introduced in #615
* remove use of <random> in stats (#628)Stefan Boberg2024-01-103-6/+46
| | | | the previous implementation was quite slow due to use of mt and uniform_distribution.
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2023-12-201-1/+1
|\
| * 0.2.39-pre0v0.2.39-pre0Stefan Boberg2023-12-201-1/+1
| |
* | added change log entry which I failed to push earlierStefan Boberg2023-12-201-0/+1
|/
* release RPC recording memory early (#627)Stefan Boberg2023-12-201-2/+7
| | | previously the segment would call `clear()` on the `m_Entries` vector but this does not release the backing memory so we have to do the `swap` dance
* separate RPC processing from HTTP processing (#626)Stefan Boberg2023-12-2032-1790/+2006
| | | | | | * moved all RPC processing from HttpStructuredCacheService into separate CacheRpcHandler class in zenstore * move package marshaling to zenutil. was previously in zenhttp/httpshared but it's useful in other contexts as well where we don't want to depend on zenhttp * introduced UpstreamCacheClient, this provides a subset of functions on UpstreamCache and lives in zenstore
* move cachedisklayer and structuredcachestore into zenstore (#624)Stefan Boberg2023-12-1912-28/+27
|
* 0.2.38v0.2.38Dan Engelbrecht2023-12-191-1/+1
|
* 0.2.38-pre2v0.2.38-pre2Dan Engelbrecht2023-12-191-1/+1
|
* Don't capture local variables in loop by reference (#623)Dan Engelbrecht2023-12-192-27/+28
| | | * Don't capture local variables in loop by reference
* ensure we can build without trace (#619)Stefan Boberg2023-12-196-2/+14
| | | | `xmake config -zentrace=n` would previously not build cleanly
* various TSAN/ASAN/LeakAnalyzer fixes (#622)Stefan Boberg2023-12-197-11/+34
| | | | | | | | | * fix JobQueue test threading issue. The inner job queued with `QueueJob` would reference `I` from inside the captured closure which would subsequently disappear * made sure application exit is thread safe * don't try to access string data out of bounds * keep-alive flag is accessed from multiple threads * fix memory leaks in Zen upstream client code * TSAN fixes for Event
* fix ChunkIndexToChunkHash indexing (#621)Stefan Boberg2023-12-192-2/+2
| | | would previously index into a reserved-but-not-sized vector which is bad but not crash-inducing bad
* fix leak in IoBuffer for manifested small chunk (#618)Stefan Boberg2023-12-192-2/+3
| | | | * fix leak in IoBuffer for manifested small chunk. previously it would null out the `m_DataPtr` member on every path from `IoBufferExtendedCore::~IoBufferExtendedCore()` but it only really makes sense to null it out when the buffer has been memory mapped
* cache RPC recorder threading fixes (#617)Stefan Boberg2023-12-194-54/+111
| | | | | * ensure all access to m_Entries is done while holding lock * RPC recorder concurrency fixes - setup/teardown of recorder needs to be done while holding an exclusive lock. Calls into recorder should be done while holding a shared lock.
* Fix crash bug when trying to inspect non-open block file in GC (#614)Dan Engelbrecht2023-12-183-7/+21
|
* Make sure we initialize the pattern of FileSink before it is added as a ↵Dan Engelbrecht2023-12-182-12/+9
| | | | usable logger (#615)
* 0.2.38-pre1v0.2.38-pre1Dan Engelbrecht2023-12-151-1/+1
|
* add signing identity when creating release (windows)Dan Engelbrecht2023-12-151-1/+1
|
* log each block that is compacted (#613)Dan Engelbrecht2023-12-152-0/+6
|
* 0.2.38-pre0v0.2.38-pre0Stefan Boberg2023-12-151-1/+1
|
* fixed v2 rpc recording issue with >4GB data per segment (#612)Stefan Boberg2023-12-155-146/+326
| | | | | | | | | * fixed v2 rpc recording issue with >4GB data per segment * implemented recovery logic to deal with partial RPC recordings * added check for invalid/null requests in RPC replay * also made sure at least one worker thread is configured * fix problem where "null" requests would cause infinite loop! * added basic RPC recorder tests
* windows executable signing (#566)Dan Engelbrecht2023-12-153-3/+31
| | | Windows executables are now signed with official cert when creating a release
* changelogDan Engelbrecht2023-12-141-1/+3
|
* implement cache recording segment split by age (#611)Stefan Boberg2023-12-144-17/+111
| | | - also fixes weird DateTime/TimeSpan comparison operator
* 0.2.37v0.2.37Dan Engelbrecht2023-12-141-1/+1
|
* 0.2.37-pre2v0.2.37-pre2Dan Engelbrecht2023-12-141-1/+1
|
* Make sure IoBuffer is a valid null-buffer after move operation (#610)Dan Engelbrecht2023-12-143-4/+16
|
* 0.2.37-pre1v0.2.37-pre1Dan Engelbrecht2023-12-131-1/+1
|
* Don't use copy of Payloads array when fetching memcached payload in GC (#609)Dan Engelbrecht2023-12-132-1/+2
| | | * Don't use copy of Payloads array when fetching memcached payload in GC
* 0.2.37-pre0v0.2.37-pre0Dan Engelbrecht2023-12-131-1/+1
|
* spelling in changelogDan Engelbrecht2023-12-131-1/+1
|
* fix peak disk load in gc status (#608)Dan Engelbrecht2023-12-132-12/+12
| | | * MaxLoad is max load per monitor slot, not the MaxLoad for the entire graph
* skip invalid chunks when reclaiming space in block store (#607)Dan Engelbrecht2023-12-132-0/+14
| | | * skip invalid chunks when reclaiming space in block store
* improve trace (#606)Dan Engelbrecht2023-12-136-37/+66
| | | | | * Adding some more trace scopes for better visiblity * Removed spammy trace scope when replaying oplogs * Remove "::Disk" from trace scopes - redundant now that we have merge disk and memory layers
* fix crash at log exit (#605)Dan Engelbrecht2023-12-132-7/+6
| | | * keep g_FileSink alive until spdlog has shut down
* changelogDan Engelbrecht2023-12-121-1/+3
|
* use mimalloc where available (#601)Stefan Boberg2023-12-121-15/+11
| | | enabling mimalloc path for `Memory::Alloc` and `Memory::Free`