aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* | removed experimental mesh codeStefan Boberg2023-01-267-421/+0
|/ | | | should be replaced with a proper implementation later
* fix gc logging (#213)Dan Engelbrecht2023-01-133-30/+43
| | | | | | * Don't output time to next GC if time is "infinite". * Do immediate check of GC status on thread startup instead of waiting montior intervall first. * set up reasonable gc defaults * changelog
* zen command line tool improvements (#212)Dan Engelbrecht2023-01-1331-99/+519
| | | | | | | | | | | | - Feature: zen command line tool `cache-info` to show cache, namespace or bucket info - Feature: zen command line tool `project-info` to show store, project or oplog info - Feature: zen command line tool `project-drop` to drop project or oplog - Feature: zen command line tool `gc` to trigger a GC run - Feature: zen command line tool `gc-info` to check status of GC - Improvement: zen command line tool now fails on any unrecognized arguments - Improvement: zen command line tool now displays extra help for all sub-commands - Improvement: host address can now be configured for zen command line tool `drop` command changelog
* Add info (GET) endpoints for structured cache (#211)Dan Engelbrecht2023-01-117-60/+424
| | | | | | | * Add GET requests on cache/namespace/bucket level * Add root route for project store requests (same as /list) * Add markerpath to oplog info object * Add totalsize, opcount and expired to oplog info * Changelog
* 0.2.1v0.2.1Dan Engelbrecht2022-12-161-1/+1
|
* Fix log index snapshot (#210)Dan Engelbrecht2022-12-166-26/+40
| | | | | | * Fix log reading for structured cache store Make sure cache is flushed at exit * dont flush index to disk unless new entries have been written * changelog
* oplog level GC (#209)Dan Engelbrecht2022-12-143-43/+212
| | | | | | | | Adds check for marker file supplied by UE to see if an oplog is expired (user has deleted the corresponding cooked folder). Fixed concurrency vulnerabilities is project store related to oplogs. * fix concurrency vulnerabilities * propagate lifetime file path * oplog level gc * changelog
* Changed so CompressedBuffer::DecodeRawHash returns IoHash just like on the ↵Stefan Boberg2022-12-129-51/+47
| | | | | | UE side (#208) removed all use of IoHash::FromBLAKE3() caused by interactions with CompressedBuffer APIs
* added [[fallthrough]] annotations to silence static analysisStefan Boberg2022-12-121-0/+20
|
* Update README.mdStefan Boberg2022-12-101-1/+1
|
* version 0.2.0v0.2.0Dan Engelbrecht2022-12-081-1/+1
|
* 0.2.0-pre2v0.2.0-pre2Dan Engelbrecht2022-12-081-1/+1
|
* Path from handle perf improvement (#206)Dan Engelbrecht2022-12-082-10/+22
| | | | | | * Read recorded requests to memory before parsing This will more accurately simulate how requests comes in from a client * Make a fast path for GetFinalPathNameByHandleW Try to get the path with a fixes size buffer first to avoid always doing two calls to GetFinalPathNameByHandleW
* Fix http parsing crash (#205)Dan Engelbrecht2022-12-082-29/+37
| | | | * Don't continue parsing http requests if we get an error. * changelog
* Fix logging of number of read entries from log/index file for stores (#204)Dan Engelbrecht2022-12-083-7/+7
| | | | * Fix logging of number of read entries from log/index file for stores * changelog
* 0.2.0-pre1v0.2.0-pre1Dan Engelbrecht2022-12-071-1/+1
|
* Fix asio port sharing options (#203)Dan Engelbrecht2022-12-072-9/+32
| | | | * Windows: explicitly set the special SO_EXCLUSIVEADDRUSE flag * changelog
* 0.2.0-pre0v0.2.0-pre0Dan Engelbrecht2022-12-071-1/+1
|
* Zen cmd fixes (#201)Dan Engelbrecht2022-12-0714-81/+112
| | | | | | | * updated drop command to support namespaces * fixed hash command error message * fix output of status (and top) command * Use ZEN_CONSOLE for output in zen commands * changelog
* optimizations (#200)Dan Engelbrecht2022-12-0727-350/+539
| | | | | | | | | | | | | * Use direct file read and direct buffer allocation for small IoBuffer materalization * Reduce range of materialized data in CompositeBuffer reading CompressedBuffer header reading often only need a small part and not the whole file * reduce lock contention in IoBuffer::Materialize * Reduce parsing of compressed headers Validate header type at decompression * faster CreateDirectories - start from leaf going up and recurse back * optimized BufferHeader::IsValid * Add ValidateCompressedHeader to use when we don't need the actual compressed data Validate that we always get compressed data in CidStore::AddChunk * changelog
* Cache request record/replay (#198)Dan Engelbrecht2022-12-076-219/+490
| | | | | | | | | This adds recording and playback of cache request with full data - both get and put operations can be replayed. Invoke via web request. `<host>/z$/exec$/start-recording?<disk-storage-path>` `<host>/z$/exec$/stop-recording` `<host>/z$/exec$/replay-recording?<thread-count>&<disk-storage-path>`
* Use Iso8601 format for logging start and end message (#202)Dan Engelbrecht2022-12-072-2/+4
| | | | * Use Iso8601 format for logging start and end message * changelog
* Size based gc trigger (#197)Dan Engelbrecht2022-12-0211-141/+554
| | | | | - Feature: Disk size triggered GC, a soft disk usage limit for cache data. - Feature: New option `--gc-disk-size-soft-limit` (command line), `gc.cache.disksizesoftlimit` (lua config) controlling limit for soft disk usage limit. Defaults to zero which disables soft disk usage limit. - Improvement: Disk write pressure in GC log and cleaned up clutter in GC logging.
* reduce gc log spam (INFO -> DEBUG) (#199)Dan Engelbrecht2022-12-025-56/+57
|
* Make sure we always store record/op before attachments (#195)Dan Engelbrecht2022-12-014-118/+208
| | | | | | | | * Make sure we always store record/op before attachments We don't want to store attachments first - a GC operation could then remove attachments if triggered before storing record/op * zen::Latch * Use latch to wait for attachments to be stored * use zen::latch when adding attachments from project oplog import * changelog
* 0.1.9v0.1.9Dan Engelbrecht2022-11-251-1/+1
|
* changelogDan Engelbrecht2022-11-241-1/+1
|
* 0.1.9-pre4v0.1.9-pre4Dan Engelbrecht2022-11-241-1/+1
|
* Fix disk usage stats (#194)Dan Engelbrecht2022-11-2412-171/+357
| | | | | | | | * Improve tracking of used disk space for filecas and compactcas Add tracking of used disk space for project store Remove ZenCacheStore as GcStorage/GcContributor - underlying ZenCacheNamespace instances register themselves directly - removing this also fixes double reporting of GcStorageSize for namespaces * changelog
* Don't resize block store block file to max size at creation (#193)Dan Engelbrecht2022-11-232-6/+8
| | | | * Don't resize block store block file to max size at creation * changelog
* 0.1.9-pre3v0.1.9-pre3Dan Engelbrecht2022-11-211-1/+1
|
* add "version" command with "detailed" option (#192)Dan Engelbrecht2022-11-215-0/+122
| | | specify host url to query running service version, otherwise you get zen command version
* bump cache large object size limit to 128Kb (#191)Dan Engelbrecht2022-11-212-1/+2
| | | | * bump cache large object size limit to 128Kb * changelog
* 0.1.9-pre2v0.1.9-pre2Dan Engelbrecht2022-11-181-1/+1
|
* changelog and removed obsolete commentDan Engelbrecht2022-11-182-2/+6
|
* Add `import-project` and `export-project` (#183)Dan Engelbrecht2022-11-1829-405/+1807
| | | * Add `import-project` and `export-project` command line parsing
* move BasicFile to zenutil to remove zenstore dependency from zen command (#190)Dan Engelbrecht2022-11-1711-12/+9
|
* actions/[email protected] -> actions/checkout@v3Dan Engelbrecht2022-11-142-8/+8
|
* update github actions versions to avoid node js warningsDan Engelbrecht2022-11-142-9/+9
|
* Configure OpenID providers from cmd line and Lua cfg. (#189)Per Larsson2022-11-145-6/+75
|
* Include zen cmd in release (#188)Dan Engelbrecht2022-11-093-4/+34
| | | | | * make sure we build the zen command line as well in bundle * include zen command line executable * changelog
* update action cancel old build to 0.11.0 (#186)v0.1.9-pre1Dan Engelbrecht2022-11-081-1/+1
|
* Support file reference in package message (#184)Dan Engelbrecht2022-11-079-52/+76
| | | | | | | | * Fix packed message parsing for absolute path * Always enable are sharing when opening files as IoBuffers. * Allow control over sending partial files as localfile ref * Check "AcceptFlags" field in RPC message for allowing localfile ref in reply * make oplog entry add operations ZEN_DEBUG level logs * changelog
* 0.1.8v0.1.8Dan Engelbrecht2022-10-171-1/+1
|
* fix concurrency issues in projectstore and enable GC (#181)Dan Engelbrecht2022-10-173-277/+648
| | | | | | | | | | | | | | * Fix concurreny issues when deleting projects/oplogs * remove rocksdb test code * project store unit tests * safer deletion of oplogs/projects * reference count ProjectStore::Project to handle lifetime during GC * Don't open all project oplogs unless we need them * Don't scrub expired projects * Don't gather references from expired projects * added logging details for GC * release lock as soon as folder is moved * more tests for project store * changelog
* Add "Accept" field in RPC request to gracefully handle requests from older ↵Dan Engelbrecht2022-10-137-33/+160
| | | | instances (#180)
* disable project store GC (#179)Dan Engelbrecht2022-10-121-1/+2
|
* De/oplog gc lifetime (#178)Dan Engelbrecht2022-10-103-47/+144
| | | | | | | * Make sure we don't use invalidated iterators in projectstore.cpp * project store keeps track of project file and will garbage collect data for a project if the project file no longer exist * Implement GC of projects in project store - still need to fix lifetime issues for Project instances * Add INFO log if project file path is empty in projectstore * changelog
* 0.1.7 (removed duplicate line)v0.1.7Dan Engelbrecht2022-10-041-2/+1
|
* 0.1.7 (again)Dan Engelbrecht2022-10-041-1/+1
|