aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* oplog capture new attachments for gc (#210)Dan Engelbrecht2024-11-063-7/+12
| | | * make sure we track added attachments properly in oplogs
* project details cmd resolve prj oplog (#209)Dan Engelbrecht2024-11-064-35/+25
| | | | | * auto-resolve project name if only one project exist * always try to resolve project and oplog name in project-details command * project-details -> project-op-details
* Improved oplog import/export progress indicator at commandline (#206)Dan Engelbrecht2024-11-0613-150/+460
| | | | Nicer progress bar during oplog import/export Verify that oplog has not been deleted from disk behind our back
* sponsor process attach hardening (#208)Dan Engelbrecht2024-11-044-6/+14
| | | * make sure to clear sponsor slot if pickup does not happen
* Enabled statsd reporting (#207)Joakim Lindqvist2024-10-281-0/+4
| | | Datadog is already configured to accept this for us
* 5.5.9v5.5.9Dan Engelbrecht2024-10-251-1/+1
|
* 5.5.9-pre10v5.5.9-pre10Dan Engelbrecht2024-10-231-1/+1
|
* workspace share security (#192)Dan Engelbrecht2024-10-2315-654/+1693
| | | | | | | - Improvement: Reworked workspace shares to be more secure. Workspaces and workspace shares can only be created using the `zen workspace` command, the http endpoint is disabled unless zenserver is started with the `--workspaces-allow-changes` option enabled. - Each workspace are now configured via a `zenworkspaceconfig.json` file in the root of each workspace - A workspace can allow shares to be created via the http interface if the workspace is created with the `--allow-share-create-from-http` option enabled - A new http endpoint at `/ws` - issuing a `Get` operation will get you a list of workspaces - A new http endpoint at `/ws/refresh` - issuing a `Get` will make zenserver scan for edits in workspaces and workspace shares
* fix gc date (#204)Dan Engelbrecht2024-10-222-3/+4
| | | * fix month conversion in ToDateTime
* Use a smaller thread pool during pre-cache phase of GC to reduce memory ↵Dan Engelbrecht2024-10-222-7/+12
| | | | pressure (#205)
* bucket size queries (#203)Dan Engelbrecht2024-10-2110-15/+260
| | | - Feature: Added options --bucketsize and --bucketsizes to zen cache-info to get data sizes in cache buckets and attachments
* 5.5.9-pre8v5.5.9-pre9v5.5.9-pre8Dan Engelbrecht2024-10-161-1/+1
|
* validate compact binary rpc requests before trying to parse them (#200)Dan Engelbrecht2024-10-161-1/+10
|
* 5.5.9-pre2Dan Engelbrecht2024-10-161-1/+1
|
* safer path from handle (#195)Dan Engelbrecht2024-10-169-65/+104
| | | * remove PathFromHandle that throws to give better context on failures
* upload linux mac exe to sentry (#196)Dan Engelbrecht2024-10-162-6/+10
| | | | * upload mac/linux executables to sentry using `debug-files bundle-sources` on all platforms * update sentry-cli to latest on windows
* add --dryrun instructions to projectstore drop (#199)Dan Engelbrecht2024-10-162-9/+16
|
* make sure to initialize stats in file, jupiter and zen remote stores (#198)Dan Engelbrecht2024-10-164-21/+22
| | | * make sure to initialize stats in file, jupiter and zen remote stores
* Mirror command: fix utf8 paths mapping to native code page (#197)Matt Peters2024-10-151-2/+2
| | | | | * Mirror command: need to keep n unordered_set of filesystem::path rather than converting to string(), because string() does not work for unicode paths. * Mirror: Store files in unordered_set as u8string rather than std::filesystem::path; std::filesystem::path does not support unordered_sest hashing on linux.
* Dashboard: oplog entry data download, more detail, styling tweaks. (#194)Martin Ridgers2024-10-147-104/+221
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * MSVC's std::fs::path doesn't like appending '/' separated path components * Redirect '/dashboard' to '/dashboard/' * Missed a few copyright headers * Moved unescaped logo somewhere more suitable * More robust catching and displaying of errors * No need for the guard now or for waiting * Formal access to a component's style * Style tables explicitly without instead of via a CSS variable * Highlight a row under the cursor to guide user's eye * Not using css_var() so it was removed * Add more detail to a project's list of oplogs * Disabled test page's CbObject testing * Consider all fields ending in "importedpackageids" as dependencies * Don't wrap sector headers * Package ids were derived with endianess back to front * Moved oplog marker column further left * Adopt a vararg-style to Table.add_row() for cell contents * List and hotlink oplog entries' package data * Modest control over how a table's columns are arranged * Added tables to test column spacing * Keep stat filter input box correctly up to date * A clang-format run * Updated html.zip * validate found oplog directories when doing discover pass --------- Co-authored-by: Dan Engelbrecht <[email protected]>
* Add ability to read the oplog's ReferencedSet, as written by the cook… (#190)v5.5.9-pre7Matt Peters2024-10-118-37/+412
| | | | Add ability to read the oplog's ReferencedSet, as written by the cooker, from the ReferencedSet op. Filter oplog entries requests by the ReferencedSet, if trim_by_referencedset parameter is present.. Add -trim=true/false parameter to oplog-mirror command, default to true, to request the trimmed/not trimmed oplog. Helper functions: Add paging to IterateOpLogWithKey. Add unit tests for IterateOpLog functions. Move OpKeyStringAsOid from httpprojectstore into projectstore.
* 5.5.9-pre1v5.5.9-pre2v5.5.9-pre1Dan Engelbrecht2024-10-111-1/+1
|
* oplog mirror and vfs utf8 paths (#189)Dan Engelbrecht2024-10-103-7/+8
| | | * assume "filename" fields in oplog entries are utf8 paths
* Dashboard: alignment of complex stats & logo goes home (#187)Martin Ridgers2024-10-103-57/+78
| | | | | | | * Unselectable logo text * Revisit alignment of complex request/bytes stats * ZenStore logo takes you home
* Revert "remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY ↵Dan Engelbrecht2024-10-102-2/+7
| | | | | (#191)" (#193) This reverts commit e809931618b443809e9740edb70a62d0cab01f87.
* don't read chunks into memory during cache batch fetch unless we may cache ↵Dan Engelbrecht2024-10-093-13/+15
| | | | | them in memory (#188) * Don't read chunks into memory during cache batch fetch unless we may cache them in memory
* remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY (#191)Stefan Boberg2024-10-082-7/+2
| | | | | | * remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY * temp disable signing on Mac this change should be revisited once we have resumed regular service wrt MacOS runners
* Mrp/referencedset (#174)Matt Peters2024-10-048-16/+16
| | | | * zen.exe commands: Add initializers for all POD types; this fixes incorrect behavior for flags in debug * README.md: Fix typo in --no-dry-run line
* add automatic decompression to cache-get (default on) and oplog-mirror ↵Dan Engelbrecht2024-10-044-3/+35
| | | | (default off) (#186)
* improve naming and feedback in zen commands (#185)Dan Engelbrecht2024-10-033-13/+18
| | | | * rename cache-get opton attachmentid -> attachmenthash for improved clarity * add help info for --dry-run in DropProjectCommand
* remove gc v1 (#121)Dan Engelbrecht2024-10-0321-3120/+116
| | | | | * kill gc v1 * block use of gc v1 from zen command line * warn and flip to gcv2 if --gc-v2=false is specified for zenserver
* 5.5.9-pre0v5.5.9-pre0Dan Engelbrecht2024-10-031-1/+1
|
* Reinstated a line that was moved instead of duplicated (#184)Martin Ridgers2024-10-031-0/+1
|
* - Improvement: Self-hosted dashboard (#181)Martin Ridgers2024-10-036-161/+1164
| | | Self-hosted dashboard gets oplog entry view and a stats browser
* cache get command (#183)Dan Engelbrecht2024-10-039-45/+203
| | | | * move TryParseObjectId and TryParseIoHash to Oid::TryParse and IoHash::TryParse respectively * zen cache-get command
* simplified CleanDirectory implementation (#182)Stefan Boberg2024-10-031-26/+8
| | | we use the std implementation for all normal cases now. The Windows-only path still exists for VFS cleanup
* 5.5.8v5.5.8Dan Engelbrecht2024-10-021-1/+1
|
* changelogDan Engelbrecht2024-10-021-7/+7
|
* 5.5.8-pre7v5.5.8-pre7Dan Engelbrecht2024-10-021-1/+1
|
* gc block size target max size (#180)Dan Engelbrecht2024-10-025-42/+68
| | | | | | * If a block is small (less than half max size) we add it to blocks to compact Sort blocks when iterating over them * do compact of block stores even if no new unused are found * do compact phase even if bucket is empty
* Porject -> ProjectStefan Boberg2024-10-021-1/+1
|
* 5.5.8-pre6v5.5.8-pre6Dan Engelbrecht2024-10-011-1/+1
|
* optimize gc reference sort (#179)Dan Engelbrecht2024-10-013-38/+41
| | | | | - Do a single call to mempcy when fetching attachments from the meta store in GC - Use small lambda when calling std::sort in FilterReferences (enables inlining of the comparision function) - Use a single function for < and == comparision in KeepUnusedReferences
* Separate UTF-8 flags by platform (#178)Dmytro Ivanov2024-10-011-2/+5
| | | | | | | Fixes the following warnings ``` 1>cl : Command line warning D9002: ignoring unknown option '-source-charset=utf-8' 1>cl : Command line warning D9002: ignoring unknown option '-execution-charset=utf-8' ```
* use alternate IoHash comparision function (#177)v5.5.8-pre5Dan Engelbrecht2024-09-301-4/+23
| | | * Use alternate IoHash comparision function - reduces KeepUnusedReferences execution time by ~20%
* 5.5.8-pre4v5.5.8-pre4Dan Engelbrecht2024-09-301-1/+1
|
* gc command attachment options (#176)Dan Engelbrecht2024-09-3013-42/+101
| | | * zen command - add options to control meta data cache when triggering gc
* optimize startup time (#175)Dan Engelbrecht2024-09-307-41/+33
| | | | | | * use tsl::robin_set for BlockIndexSet don't calculate full block location when only block index is needed * don't copy visitor function * reserve space for attachments
* Fixing compilation errors with fmt v11 (#172)Dmytro Ivanov2024-09-272-0/+5
|
* work around issues compiling fmt::join call on mac (#170)Stefan Boberg2024-09-271-1/+9
|