aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* fix crash on corrupt oplog block (#223)Dan Engelbrecht2024-11-212-0/+19
| | | | * bail attachment import on corrupt attachment block * changelog
* memory/string support cleanup and additions (#220)Stefan Boberg2024-11-199-181/+188
| | | | | | | | | * removed unused memory classes * added align.h alignment helpers used in upcoming changes * added char16_t StringLength * avoid memory alloc in SetCurrentThreadName * added command line parsing helpers to zencore/commandline.h * removed IoBuffer direct VirtualAlloc path
* 5.5.12v5.5.12Dan Engelbrecht2024-11-181-1/+1
|
* some fixes to timestamp caching in logging (#219)Stefan Boberg2024-11-183-7/+14
| | | * some fixes to timestamp caching in logging
* fix oplog chunk batch get (#221)Dan Engelbrecht2024-11-182-5/+9
| | | | * fix batch request not handling missing chunks correctly * fix CorrelationId in oplog batch chunk fetch
* 5.5.12-pre1v5.5.12-pre1Dan Engelbrecht2024-11-181-1/+1
|
* Dashboard: oplog tree view (#217)Martin Ridgers2024-11-1817-1385/+1683
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Turned tables and progress bars and friends into "widgets!" * A step to abstracting away a page's the internal DOM structure * Folded sector creation into Page and pivoted it to a widget host * Try and keep start/count as numbers regardless of input * No need for the entry table to be defined up front now * Add op count and log sixe to oplog list page * Cache left side toolbar object * Bounds count page start when building list of oplog entrie * Start/end navigation tools * Build rest of entry page while waiting for indexer to load * Consistent naming with other pages * Spacially consolidate fetching code * Hide fetch latency to speed up index generation workers * Extract dashboard structure from zen.js monolith * Fix breadcrumbs after restructuring * Add view link to actions cell of oplogs list * Generator to enumerate names of entries in indexer * Methods for simple traversal of component relations * is() to check if a component is of a certain type * Extend attr() to get and unset a component's attributes * Unsetting all styles of anchor tags was underisrable * Restore page name as id of container element * A tree view of an oplog * Move helper class out to private module scope * Small tweak to use left var that already exists * Changelog update * Updated frontend .zip archive
* oplog prep gc fix (#216)Dan Engelbrecht2024-11-1520-454/+1499
| | | | | | - Added option gc-validation to zenserver that does a check for missing references in all oplog post full GC. Enabled by default. - Feature: Added option gc-validation to zen gc command to control reference validation. Enabled by default. - Added more details in post GC log. - Fixed race condition in oplog writes which could cause used attachments to be incorrectly removed by GC
* fixed some issues with ZenServerInstance::SpawnServer (#218)Stefan Boberg2024-11-143-17/+30
| | | | * previously it would assign a child identifier twice in some cases, which would lead to confusing log output * added pid as context in debug logging when launching a process
* Self-hosted dashboard: Searchable oplog and links between oplog entry ↵v5.5.12-pre0Martin Ridgers2024-11-1111-372/+1003
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dependencies (#213) * Consistent use of semicolons * Added fallback if oplog entry assumptions do not hold * 'marker' and 'expired' cells were incorrectly friendly * Two spaces when there should only be one * Robustness against .text(undefined) calls * A single step into JavaScript modules * Turned Fetcher into a module * Friendly into a module * Specialise Cbo field name comparison as TextDecoder() is very slow * Prefer is_named() over get_name() * Incorrect logic checking if a server reply was okay * Try and make sure it's always numbers that flow through Friendly * Added a progress bar component * Swap key and package hash columns * CbObject cloning * Dark and light themes depending on browser settings * Adjust styling of input boxes * Add theme swatches to test page * Turns out one can nest CSS selectors * Separate swatch for links/actions * Generate theme by lerping intermediate colours * Clearer progress bar * Chromium was complaining about label-less input elements * Promise-based cache using an IndexedDb * WebWorker for generating map of package ids to names * Indexer class for building, loading, and saving map of ids to names * Added links to oplog entries of an entry's dependencies * This doesn't need to be decorated as async any longer * Implemented oplog searching * View and drop make no sense on package data payloads * Rudimentary search result truncation * Updated changelog * Updated HTML zip archive
* Update VERSION.txtv5.5.11Stefan Boberg2024-11-111-1/+1
|
* changelogDan Engelbrecht2024-11-111-1/+3
|
* memory leak fix (GetBatchHandle) (#215)Stefan Boberg2024-11-082-0/+5
| | | This fixes a memory leak which would cause stale handles to accumulate until process shutdown. Each cache get operation would therefore leak some memory.
* 5.5.10v5.5.10Dan Engelbrecht2024-11-061-1/+1
|
* 5.5.10-pre0v5.5.10-pre0Dan Engelbrecht2024-11-061-1/+1
|
* Make op key and file path matching in `zen oplog-mirror` case insensitive (#212)Dan Engelbrecht2024-11-062-3/+19
|
* project name list improvement (#211)Dan Engelbrecht2024-11-062-3/+34
| | | * provide shorter project store name in list when not conflicting
* oplog capture new attachments for gc (#210)Dan Engelbrecht2024-11-063-7/+12
| | | * make sure we track added attachments properly in oplogs
* project details cmd resolve prj oplog (#209)Dan Engelbrecht2024-11-064-35/+25
| | | | | * auto-resolve project name if only one project exist * always try to resolve project and oplog name in project-details command * project-details -> project-op-details
* Improved oplog import/export progress indicator at commandline (#206)Dan Engelbrecht2024-11-0613-150/+460
| | | | Nicer progress bar during oplog import/export Verify that oplog has not been deleted from disk behind our back
* sponsor process attach hardening (#208)Dan Engelbrecht2024-11-044-6/+14
| | | * make sure to clear sponsor slot if pickup does not happen
* Enabled statsd reporting (#207)Joakim Lindqvist2024-10-281-0/+4
| | | Datadog is already configured to accept this for us
* 5.5.9v5.5.9Dan Engelbrecht2024-10-251-1/+1
|
* 5.5.9-pre10v5.5.9-pre10Dan Engelbrecht2024-10-231-1/+1
|
* workspace share security (#192)Dan Engelbrecht2024-10-2315-654/+1693
| | | | | | | - Improvement: Reworked workspace shares to be more secure. Workspaces and workspace shares can only be created using the `zen workspace` command, the http endpoint is disabled unless zenserver is started with the `--workspaces-allow-changes` option enabled. - Each workspace are now configured via a `zenworkspaceconfig.json` file in the root of each workspace - A workspace can allow shares to be created via the http interface if the workspace is created with the `--allow-share-create-from-http` option enabled - A new http endpoint at `/ws` - issuing a `Get` operation will get you a list of workspaces - A new http endpoint at `/ws/refresh` - issuing a `Get` will make zenserver scan for edits in workspaces and workspace shares
* fix gc date (#204)Dan Engelbrecht2024-10-222-3/+4
| | | * fix month conversion in ToDateTime
* Use a smaller thread pool during pre-cache phase of GC to reduce memory ↵Dan Engelbrecht2024-10-222-7/+12
| | | | pressure (#205)
* bucket size queries (#203)Dan Engelbrecht2024-10-2110-15/+260
| | | - Feature: Added options --bucketsize and --bucketsizes to zen cache-info to get data sizes in cache buckets and attachments
* 5.5.9-pre8v5.5.9-pre9v5.5.9-pre8Dan Engelbrecht2024-10-161-1/+1
|
* validate compact binary rpc requests before trying to parse them (#200)Dan Engelbrecht2024-10-161-1/+10
|
* 5.5.9-pre2Dan Engelbrecht2024-10-161-1/+1
|
* safer path from handle (#195)Dan Engelbrecht2024-10-169-65/+104
| | | * remove PathFromHandle that throws to give better context on failures
* upload linux mac exe to sentry (#196)Dan Engelbrecht2024-10-162-6/+10
| | | | * upload mac/linux executables to sentry using `debug-files bundle-sources` on all platforms * update sentry-cli to latest on windows
* add --dryrun instructions to projectstore drop (#199)Dan Engelbrecht2024-10-162-9/+16
|
* make sure to initialize stats in file, jupiter and zen remote stores (#198)Dan Engelbrecht2024-10-164-21/+22
| | | * make sure to initialize stats in file, jupiter and zen remote stores
* Mirror command: fix utf8 paths mapping to native code page (#197)Matt Peters2024-10-151-2/+2
| | | | | * Mirror command: need to keep n unordered_set of filesystem::path rather than converting to string(), because string() does not work for unicode paths. * Mirror: Store files in unordered_set as u8string rather than std::filesystem::path; std::filesystem::path does not support unordered_sest hashing on linux.
* Dashboard: oplog entry data download, more detail, styling tweaks. (#194)Martin Ridgers2024-10-147-104/+221
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * MSVC's std::fs::path doesn't like appending '/' separated path components * Redirect '/dashboard' to '/dashboard/' * Missed a few copyright headers * Moved unescaped logo somewhere more suitable * More robust catching and displaying of errors * No need for the guard now or for waiting * Formal access to a component's style * Style tables explicitly without instead of via a CSS variable * Highlight a row under the cursor to guide user's eye * Not using css_var() so it was removed * Add more detail to a project's list of oplogs * Disabled test page's CbObject testing * Consider all fields ending in "importedpackageids" as dependencies * Don't wrap sector headers * Package ids were derived with endianess back to front * Moved oplog marker column further left * Adopt a vararg-style to Table.add_row() for cell contents * List and hotlink oplog entries' package data * Modest control over how a table's columns are arranged * Added tables to test column spacing * Keep stat filter input box correctly up to date * A clang-format run * Updated html.zip * validate found oplog directories when doing discover pass --------- Co-authored-by: Dan Engelbrecht <[email protected]>
* Add ability to read the oplog's ReferencedSet, as written by the cook… (#190)v5.5.9-pre7Matt Peters2024-10-118-37/+412
| | | | Add ability to read the oplog's ReferencedSet, as written by the cooker, from the ReferencedSet op. Filter oplog entries requests by the ReferencedSet, if trim_by_referencedset parameter is present.. Add -trim=true/false parameter to oplog-mirror command, default to true, to request the trimmed/not trimmed oplog. Helper functions: Add paging to IterateOpLogWithKey. Add unit tests for IterateOpLog functions. Move OpKeyStringAsOid from httpprojectstore into projectstore.
* 5.5.9-pre1v5.5.9-pre2v5.5.9-pre1Dan Engelbrecht2024-10-111-1/+1
|
* oplog mirror and vfs utf8 paths (#189)Dan Engelbrecht2024-10-103-7/+8
| | | * assume "filename" fields in oplog entries are utf8 paths
* Dashboard: alignment of complex stats & logo goes home (#187)Martin Ridgers2024-10-103-57/+78
| | | | | | | * Unselectable logo text * Revisit alignment of complex request/bytes stats * ZenStore logo takes you home
* Revert "remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY ↵Dan Engelbrecht2024-10-102-2/+7
| | | | | (#191)" (#193) This reverts commit e809931618b443809e9740edb70a62d0cab01f87.
* don't read chunks into memory during cache batch fetch unless we may cache ↵Dan Engelbrecht2024-10-093-13/+15
| | | | | them in memory (#188) * Don't read chunks into memory during cache batch fetch unless we may cache them in memory
* remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY (#191)Stefan Boberg2024-10-082-7/+2
| | | | | | * remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY * temp disable signing on Mac this change should be revisited once we have resumed regular service wrt MacOS runners
* Mrp/referencedset (#174)Matt Peters2024-10-048-16/+16
| | | | * zen.exe commands: Add initializers for all POD types; this fixes incorrect behavior for flags in debug * README.md: Fix typo in --no-dry-run line
* add automatic decompression to cache-get (default on) and oplog-mirror ↵Dan Engelbrecht2024-10-044-3/+35
| | | | (default off) (#186)
* improve naming and feedback in zen commands (#185)Dan Engelbrecht2024-10-033-13/+18
| | | | * rename cache-get opton attachmentid -> attachmenthash for improved clarity * add help info for --dry-run in DropProjectCommand
* remove gc v1 (#121)Dan Engelbrecht2024-10-0321-3120/+116
| | | | | * kill gc v1 * block use of gc v1 from zen command line * warn and flip to gcv2 if --gc-v2=false is specified for zenserver
* 5.5.9-pre0v5.5.9-pre0Dan Engelbrecht2024-10-031-1/+1
|
* Reinstated a line that was moved instead of duplicated (#184)Martin Ridgers2024-10-031-0/+1
|