aboutsummaryrefslogtreecommitdiff
path: root/src/zenserver
Commit message (Collapse)AuthorAgeFilesLines
...
* Add `--assume-http2` option to cloud style import/export command to use a ↵Dan Engelbrecht2023-08-095-4/+15
| | | | HTTP/2 endpoint without without HTTP/1.1 upgrade (#347)
* use streaming read for PutCompressedBlob if source is single file (#338)Dan Engelbrecht2023-08-091-1/+18
| | | | * use streaming read for PutCompressedBlob if source is single file * changelog
* add more logging on jupiter fail (#345)Dan Engelbrecht2023-08-081-0/+124
| | | | * add more details in log if jupiter operations fail * changelog
* fix asserts and exceptions (#344)Dan Engelbrecht2023-08-083-3/+23
| | | | | | * Send proper error to caller of GetChunkInfo instead of assert * catch and handle exceptions when checking for state_marker * properly wait for background tasks if oplop-export fails * changelog
* add requested item in oplog remote op (#340)Dan Engelbrecht2023-08-013-53/+155
| | | * add more context for oplog import/export errors
* removed unnecessary cpr referenceStefan Boberg2023-06-301-4/+0
|
* clang-format :(Stefan Boberg2023-06-301-12/+12
|
* build fix for ZEN_WITH_TESTSStefan Boberg2023-06-301-1/+6
|
* file share support (#328)Stefan Boberg2023-06-163-38/+47
| | | | | | | | | | | | this change adds a serve command to the zen CLI. This can be used to establish links to a set of files which may be served to clients via the project store interface: ```cmd> zen serve Lyra/WindowsClient d:\temp_share\StagedBuilds\WindowsClient``` with the appropriate changes in UE you may then start an instance of the runtime and have it load all files via the remote file connection: ``` Lyra\Binaries\LyraClient.exe ../../../Lyra/Lyra.uproject -pak -basedir=D:\temp_share\StagedBuilds\WindowsClient/Lyra/Binaries/Win64 -Mount=Lyra/WindowsClient ```
* make sure to set error code to zero on successDan Engelbrecht2023-06-161-1/+1
|
* Improve resonse messages from jupiter upstream (#333)Dan Engelbrecht2023-06-152-210/+81
| | | | | | * Improve resonse messages from jupiter upstream changelog * simplify response parsing in jupiter upstream * changelog
* fix jupiter access token for oplog upload (#330)Dan Engelbrecht2023-06-121-1/+1
| | | | * make sure to prefix auth token correctly when provided with a raw token * changelog
* changed ZEN_ERROR to ZEN_WARN to reduce Sentry noiseStefan Boberg2023-06-081-3/+8
| | | | addresses ZEN-SERVER-W5. This should not be logged as an error since the failure is propagated to the client and the failure is typically due to invalid input
* added thread names to timer, upstream monitorStefan Boberg2023-06-072-1/+9
| | | | also altered http-asio thread naming scheme
* Increase retry logic (#325)Dan Engelbrecht2023-06-051-13/+19
| | | | * Increase timeout and number of retries in CacheBucket::PutStandaloneCacheValue when moving temporary file into place * changelog
* Enable front-end serving in release modeStefan Boberg2023-05-312-26/+40
| | | | Front-end can now be served from a development directory in release mode as well as debug if there's no zipfs attached
* fix for Linux/sentry build issueStefan Boberg2023-05-261-3/+0
|
* oplog snapshot (#317)Stefan Boberg2023-05-251-6/+154
| | | | | Added "snapshot" oplog RPC this may be used to bring referenced files into the local store instead of referencing them by filename, thus making the project/oplog transportable
* minor: refcount bump eliminationStefan Boberg2023-05-251-1/+1
|
* named oplog upload worker pool threadsStefan Boberg2023-05-251-1/+12
|
* minor: comment fixStefan Boberg2023-05-251-1/+1
|
* added defaults to remote project store option definitionsStefan Boberg2023-05-253-5/+6
|
* fix for random uint32 -> uint32_tStefan Boberg2023-05-251-1/+1
|
* block destructors from throwing exceptions (#321)Dan Engelbrecht2023-05-241-5/+5
| | | | | | * ~FileMapping() is not allowed to throw exceptions * ~ScopedActivityBase() should not call ZEN_ASSERT (which causes SIGABORT on error) * ProjectStore::Project::WriteAccessTimes() which is called from ProjectStore::~Project() must not throw exceptions * changelog
* cache log sessionid (#297)Stefan Boberg2023-05-236-169/+246
| | | | | | | | | | | * implemented structured cache logging to be used as audit trail to help analyse potential cache pollution/corruption * added common header to all known log targets * made Oid::operator bool explicit to avoid logging/text format mishaps * HttpClient::operator bool -> explicit * changed cache logs to not rotate on start in order to retain more history * added CacheRequestContext * properly initialize request context * log session id and request id on zencacehstore get/put * changelog
* minor: fixed typos in log output (PUTCACEHRECORD -> PUTCACHERECORD)Stefan Boberg2023-05-221-2/+2
|
* fixed bug where an oplog delete would not actually delete the oplogStefan Boberg2023-05-191-2/+9
| | | | this would manifest itself if an oplog delete was attempted right after zenserver startup, when the oplog has not yet been instantiated. This fix checks for on-disk state as well as in-memory
* fix for commented-out code which was never meant to be checked inStefan Boberg2023-05-171-6/+6
|
* project store refactor (#316)Stefan Boberg2023-05-175-1518/+1560
| | | moved HttpProjectService into own file to improve maintainability
* fix for redundant define checkStefan Boberg2023-05-171-5/+3
|
* Restructured structured cache store (#314)Stefan Boberg2023-05-1711-2811/+2884
| | | | This change separates out the disk and memory storage strategies into separate cpp/h files to improve maintainability.
* Content scrubbing (#271)Stefan Boberg2023-05-163-136/+309
| | | Added zen scrub command which may be triggered via the zen CLI helper. This traverses storage and validates contents either by content hash and/or by structure. If unexpected data is encountered it is invalidated.
* demote state_marker deletion detection to warningDan Engelbrecht2023-05-161-1/+1
|
* exit without SIGABRT if exception is thrown during startup (#313)Dan Engelbrecht2023-05-161-7/+41
| | | | | * Safeguard ZenServer::RequestExit() and ZenServer::Cleanup() when partially initialized * Set exit code to non-zero if exception is thrown in ZenEntryPoint::Run() * changelog
* Additional trace instrumentation (#312)Stefan Boberg2023-05-162-8/+54
| | | | | | | | | * added trace instrumentation to upstreamcache * added asio trace instrumentation * added trace annotations for project store * added trace annotations for BlockStore * added trace annotations for HttpClient * added trace annotations for CAS/GC
* Moved EnableVTMode function into zencore (#311)Stefan Boberg2023-05-161-28/+1
|
* Add `--gc-projectstore-duration-seconds` option (#281)Dan Engelbrecht2023-05-166-52/+57
| | | | | | * Add `--gc-projectstore-duration-seconds` option * Cleanup lua gc options parsing * Remove dead configuration values * changelog
* removed RefCounted from ZenCacheNamespaceStefan Boberg2023-05-151-2/+13
| | | | also added some class comments
* zenserver does not support test mode in releaseStefan Boberg2023-05-151-0/+5
|
* removed remnants of ZEN_USE_REF_TRACKINGStefan Boberg2023-05-151-19/+0
| | | | this code was originally meant to be used for GC but is no longer needed
* MaxOS build fix: ScrubStorage must be overrideStefan Boberg2023-05-151-10/+16
|
* added ScrubStorage to GcStorage base classStefan Boberg2023-05-152-3/+4
|
* added scrubbing related loggingStefan Boberg2023-05-152-0/+6
|
* minor GC API cleanupStefan Boberg2023-05-158-38/+38
| | | | | Scrub -> ScrubStorage Trigger -> TriggerGc (to make relationship to TriggerScrub clearer)
* Remove ZEN_CACHE_TRACKER etcStefan Boberg2023-05-154-437/+0
| | | this was code which was originally intended for use with GC but it's no longer useful
* Remove ATL header usage (#306)Stefan Boberg2023-05-151-0/+1
| | | ATL has been used here and there as a convenience. Given that this is a legacy component and not always something which gets installed along with the compiler we hereby remove the dependency altogether in favour of our own simple wrappers
* all threads should be named (#304)Stefan Boberg2023-05-152-4/+7
| | | | | | | * added WorkerThreadPool naming, packaged_task support * name the http.sys thread pool service threads * added http.sys I/O threadpool naming * upstream cache I/O thread naming
* wipe cache buckets block store that may contain invalid state (#300)Dan Engelbrecht2023-05-121-0/+14
| | | | * wipe cache buckets block store that may contain invalid state * Update CHANGELOG.md
* fix gc bucket index compaction (#299)Dan Engelbrecht2023-05-121-4/+5
| | | | * fix compaction of m_Payloads and m_AccessTimes in ZenCacheDiskLayer::CacheBucket * changelog
* implemented structured cache logging (#296)Stefan Boberg2023-05-123-9/+107
| | | | | | | | may be used as audit trail to help analyse potential cache pollution/corruption * also added common header with timestamp to all known log targets * made `Oid::operator bool` explicit to avoid logging/text format mishaps * made `HttpClient::operator bool` explicit