aboutsummaryrefslogtreecommitdiff
path: root/zenstore/cidstore.cpp
Commit message (Collapse)AuthorAgeFilesLines
* Add `import-project` and `export-project` (#183)Dan Engelbrecht2022-11-181-4/+4
| | | * Add `import-project` and `export-project` command line parsing
* Make cas storage an hidden implementation detail of CidStore (#130)v0.1.4-pre6v0.1.4-pre5Dan Engelbrecht2022-06-171-232/+29
| | | | | | | | | | | | | | | | | | - Bumped ZEN_SCHEMA_VERSION - CasStore no longer a public API, it is hidden behind CidStore - Moved cas.h from public header folder - CidStore no longer maps from Cid -> Cas, we store entries in Cas under RawHash - CasStore now decompresses data to validate content (matching against RawHash) - CasChunkSet renames to HashKeySet and put in separate header/cpp file - Disabled "Chunk" command for now as it relied on CAS being exposed as a service - Changed CAS http service to Cid http server - Moved "Run" command completely inside ZEN_WITH_EXEC_SERVICES define - Removed "cas.basic" test - Uncommented ".exec.basic" test and added return-skip at start of test - Moved ScrubContext to separate header file - Renamed CasGC to GcManager - Cleaned up configuration passing in cas store classes - Removed CAS stuff from GcContext and clarified naming in class - Remove migration code
* cidstore: propagate the correct content typeStefan Boberg2022-06-101-0/+2
|
* Batch log removal of Cid and take proper lock when modifying m_CidMap (#80)v1.0.0.4Dan Engelbrecht2022-04-261-12/+11
| | | | | | | * Batch log removal of Cid and take proper lock when modifying m_CidMap * variable name casing * Don't access m_Buckets without a lock
* always keep full log but read from index snapshot location if availableDan Engelbrecht2022-04-041-17/+19
|
* rename EMode to ModeDan Engelbrecht2022-04-011-1/+1
|
* Migration now works in larger disk IO chunksDan Engelbrecht2022-03-311-1/+1
| | | | BasicFile and CasLogFile now has new explicit modes instead of create true/false
* Merged main.Per Larsson2021-12-141-1/+1
|\
| * CAS.cpp/h -> cas.cpp/h to keep Zen's file casing consistentMartin Ridgers2021-10-291-1/+1
| |
* | Fixed bug in z$ service returning partial cache records and enable small ↵Per Larsson2021-12-141-10/+7
| | | | | | | | object GC by default.
* | Remove Cid to CAS chunk mapping after GC.Per Larsson2021-12-131-0/+27
| |
* | Added CacheStore and CAS store sizes to status endpoint.Per Larsson2021-11-301-0/+6
| |
* | cid: Added RemapCid() for use in GCStefan Boberg2021-11-011-0/+17
| |
* | cidstore: implemented validation of data during index initializationStefan Boberg2021-11-011-9/+24
|/
* Merged from upstreamStefan Boberg2021-10-051-1/+1
|
* clang-formatStefan Boberg2021-09-271-1/+1
|
* cidstore: made all updates log using LogMapping()Stefan Boberg2021-09-231-7/+23
| | | | also fixed issue with FindChunkByCid() which would assert when it should not
* Encapsulated containers in CasChunkSet to allow for more efficient ↵Stefan Boberg2021-09-211-4/+4
| | | | udpates/queries
* Wired up scrubbing to more higher level servicesStefan Boberg2021-09-211-11/+40
| | | | Also moved sharding logic for filecas into a function to redduce cut/pasta
* Implemented CID store scrubbingStefan Boberg2021-09-201-2/+73
| | | | Added support for tombstones in commit log to support scrubbing
* Added more scrub stubs in higher level servicesStefan Boberg2021-09-201-0/+7
|
* Moved more code into zen namespace, for consistencyStefan Boberg2021-09-201-1/+1
| | | | Also removed snapshot_manifest (remnants of vfs prototype)
* Compact binary package caching support (#9)Per Larsson2021-09-161-6/+7
|
* Changed logging implementationStefan Boberg2021-09-151-2/+2
| | | | | | * Code should no longer directly `#include spdlog/spdlog.h`, instead use `#include <zencore/logging.h>` * Instead of explicit calls to `spdlog::info(...)` and such please use the logging macros defined in `zencore/logging.h`. I.e `ZEN_INFO`, `ZEN_DEBUG`, `ZEN_TRACE`, `ZEN_ERROR`, `ZEN_CRITITCAL` * The macros will pick up the "most local" logger via a `Log()` call to retrieve a logger instance. To override the default logger in a class please implement your own `Log()` function
* Changed direct includes of spdlog/spdlog.h into zencore/logging.h to make it ↵Stefan Boberg2021-09-151-1/+1
| | | | easier to tweak implementation
* Extended CidStore implementation with some helper functionsStefan Boberg2021-09-141-0/+22
|
* Asynchronous upstream caching to JupiterPer Larsson2021-08-311-2/+23
| | | | Co-authored-by: Stefan Boberg <[email protected]>
* clang-formatStefan Boberg2021-08-121-1/+2
|
* Implemented Flush() operation for CID/CAS store interfacesStefan Boberg2021-08-111-0/+7
|
* Implemented simple persistence for CidStore, which stores CID->CAS mappingsStefan Boberg2021-05-241-9/+61
|
* Added CidStore, currently used to track relationships between compressed and ↵Stefan Boberg2021-05-241-0/+33
uncompressed chunk hashes This first implementation is in-memory only, persistence is next