aboutsummaryrefslogtreecommitdiff
path: root/src/zenserver
Commit message (Collapse)AuthorAgeFilesLines
* tighten elliptical ring radiifeature/oplog-dependency-graphMtBntChvn2026-02-212-8/+8
| | | | | | base_radius: 70 → 50, ring_gap: 40 → 32 Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* use elliptical rings for node expansion placementMtBntChvn2026-02-212-13/+26
| | | | | | | | | Ripple rings are now elliptical (2:1 horizontal-to-vertical ratio) to match the rectangular shape of nodes. This spreads children wider horizontally where nodes need more room, and keeps them tighter vertically where nodes are slim. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* replace fireworks expansion with ripple (concentric rings) placementMtBntChvn2026-02-212-82/+127
| | | | | | | | | | | | | | | | Children are now placed in concentric rings around the expanded node like ripples in water, instead of a single arc at a large radius. Ring placement: - base_radius=70, ring_gap=40, min_node_gap=45 - Each ring fits floor(arc_length / min_gap) nodes - Inner rings fill first, outer rings hold more nodes - Semi-circle for non-root, full circle for root Push-away reduced from 200+4n to a fixed 80px since the tight rings no longer need a large clearance. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* focus view on expanded node and fit children after expansionMtBntChvn2026-02-201-0/+1
| | | | | | | Call fit_subtree(node) after layout completes in expand_node so the view zooms to show the expanded node and all its new children. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* reduce expansion spread for tighter graph layoutMtBntChvn2026-02-201-3/+3
| | | | | | | | Push distance: 400+6n → 200+4n Arc radius: 200+4n → 120+2.5n Jitter: 40 → 20 Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* prevent re-push on collapse and re-expandMtBntChvn2026-02-201-1/+3
| | | | | | | | Mark nodes with _was_pushed after the first push-away from parent. On subsequent expand after collapse, the node stays in place instead of being pushed further away each time. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* fix collapsed nodes not re-expandableMtBntChvn2026-02-201-1/+1
| | | | | | | | | mark_has_deps was setting has_deps=false on ALL nodes not in the check set, including previously collapsed nodes that have deps. The click guard (has_deps !== false) then blocked re-expansion. Fix: only set has_deps=false on nodes not yet checked (undefined). Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* remove breadcrumb path dimming from graph nodesMtBntChvn2026-02-201-8/+0
| | | | | | | The breadcrumb is for navigation only — selecting a path segment navigates the tree browser panel, it should not dim graph nodes. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* extract shared GraphEngine from graph views, add filtering and searchMtBntChvn2026-02-206-4068/+3133
| | | | | | | | | | | | | | | | | | | | | | Extract ~2000-line GraphEngine class from duplicated code across graph-debug-playground.js, graph.js, and minigraph.js. All three consumers now share: QuadTree layout, viewport culling, text LOD, context menu (collapse/re-expand/fit subtree/trace to root/pin), compression fill, descendant dragging, overlap removal, loading pulse. New features added to the shared engine: - Compression slider: arrow beneath the gradient scale filters nodes by compression ratio with smooth fade - Edge-type node hiding: toggling off an edge type fades out nodes that become unreachable from roots - Graph search overlay (Ctrl+F / find button): highlights matches, dims non-matching nodes, navigate with Enter/Shift+Enter - Quick-filter pills: leaves, unresolved, large (top 20% by size) - Breadcrumb path filter: clickable path segments dim non-matching nodes, synced with the right-panel tree browser - Improved node appearance: slimmer, rounder, border-based styling Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* WIP: add real data mode to graph debug playgroundMtBntChvn2026-02-202-62/+2791
| | | | | | | | | | | | | | | | | | Connect the graph debug playground to live zenstore API data via project/oplog URL parameters. Builds a path prefix tree from the indexer as the entry point for navigating large oplogs (1M+ entries). - dual-mode: no params = existing synthetic mode, with params = real data - prefix tree built from indexer.enum_all(), shown as group nodes - group nodes expand into sub-groups or individual entries - entry nodes fetch deps via CBO API with legacy fallback - dep IDs resolved via indexer.lookup_id() with hex fallback - async expansion with loading pulse animation - has_deps pre-check for children (same pattern as graph.js) Still TODO: testing with live data, edge cases, polish. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* add uniform view navigation links to dashboard pagesMtBntChvn2026-02-188-111/+1762
| | | | | | | | | Adds list/tree/graph links to the section header of the oplog, tree, and graph pages. Links are displayed in a row at the top right, on the same line as the section heading, with the border extending under them. Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* add interactive dependency graph view to dashboardMtBntChvn2026-02-185-0/+1192
| | | | | | | | Canvas-based force-directed graph for exploring package dependencies. Nodes show short names with full path on hover tooltip (with size/dep info). Supports pan, zoom, node drag, click-to-expand, double-click to promote nodes to root, right-click to demote. Includes side panel with browsable entry tree and filter. Linked from project page and entry detail page.
* add http server root password protection (#757)Dan Engelbrecht2026-02-174-16/+75
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Feature: Added `--security-config-path` option to zenserver to configure security settings - Expects a path to a .json file - Default is an empty path resulting in no extra security settings and legacy behavior - Current support is a top level filter of incoming http requests restricted to the `password` type - `password` type will check the `Authorization` header and match it to the selected authorization strategy - Currently the security settings is very basic and configured to a fixed username+password at startup { "http" { "root": { "filter": { "type": "password", "config": { "password": { "username": "<username>", "password": "<password>" }, "protect-machine-local-requests": false, "unprotected-uris": [ "/health/", "/health/info", "/health/version" ] } } } } }
* logging config move to zenutil (#754)Stefan Boberg2026-02-137-87/+47
| | | made logging config options from zenserver available in zen CLI
* Fix formatting of stat pages (#748)Liam Mitchell2026-02-094-3/+10
| | | * Fix formatting of stat pages
* use matcher over regex (#744)Dan Engelbrecht2026-02-045-16/+56
| | | | * replace http router AddPattern with AddMatcher * fix scrub logging
* Merge pull request #724 from ue-foundation/lm/restrict-reads-to-projectLiam Mitchell2026-02-031-4/+32
|\ | | | | Restrict filesystem reads in snapshot to paths under project root
| * Disallow external file reads from project with unset project rootsLiam Mitchell2026-01-291-5/+8
| |
| * Revert to previous behaviour for path checking in the presence of an empty ↵Liam Mitchell2026-01-281-9/+13
| | | | | | | | project root
| * Use std::mismatch to compare paths and hoist project root canonicalization ↵Liam Mitchell2026-01-211-13/+18
| | | | | | | | out of loop
| * Restrict filesystem reads in snapshot to paths under project rootLiam Mitchell2026-01-191-2/+18
| |
* | add command line option for scrub timeslice (#742)Dan Engelbrecht2026-02-031-1/+9
| |
* | restore missing healthinfo call (#737)Dan Engelbrecht2026-01-281-0/+5
| |
* | Zs/oplog navigation fix (#731)Zousar Shaker2026-01-232-6/+6
| | | | | | * Fix incorrect oplog navigation symbols
* | hotfix 5.7.18 (#730)Dan Engelbrecht2026-01-221-2/+5
| | | | | | | | * make sure we properly convert command line args for zenserver as well * make sure we *add* wildcards/excludes in addition to defaults
* | zen hub (#574)Stefan Boberg2026-01-219-10/+1546
|/ | | | | Initial implementation of zenserver "hub" mode. This is an experimental feature. zenserver can be started in hub mode by specifying `hub` as the first argument to zenserver
* zenserver API changes, some other minor changes (#720)Stefan Boberg2026-01-195-25/+129
| | | | | | | * add system metrics output to top command * removed unnecessary xmake directives * file system API/comment tweaks * fixed out-of-range access in httpserver test * updated ZenServer base API to allow customization by mode
* OTLP/trace improvements (#717)Stefan Boberg2026-01-193-15/+19
| | | | | | | This PR brings over some changes made to avoid performing setup for otel instrumentation if we are not sending otel information anywhere anyway. It also adds the ability to configure an OTLP endpoint on the command line using `--otlp-endpoint=<URI>`. Bear in mind that OTLP support is still not officially supported so this should not be used in production at this stage.
* use current locale when converting wide char command line arguments to ↵Dan Engelbrecht2026-01-151-0/+8
| | | | | | string (#712) * set utf8 locale, only set LC_CTYPE as we don't want to affect how decimal point or sorting orders are handled * set language/region explicitly so we can use LC_ALL
* asio/http optimizations (#449)Stefan Boberg2026-01-141-27/+2
| | | | | | | This change primarily introduces improved logic for dealing with sending data from file references. This is intended to reduce the amount of memory-mapping we end up doing when sending data from files. Windows now uses `TransmitFile` to send file data more efficiently using kernel-side I/O, but Linux/Mac basically behaves as before since they don't offer any true async file I/O support via asio. This should be implemented separately using a background I/O thread pool. This PR also includes improved memory management for http/asio with reduced allocation counts, and a fix for a potential use-after-free in very high load scenarios.
* if we fail to create the server mutex, gracefully report error without ↵Dan Engelbrecht2026-01-121-1/+3
| | | | sending error to Sentry (#705)
* Avoid rendering user text input as HTML (#700)Liam Mitchell2026-01-092-1/+1
| | | * Avoid rendering user text input as HTML
* Ensure upstream put propagation includes overwritezousar2025-12-194-5/+39
| | | | When changing the default limit-overwrite behavior, a unit test surfaced a bug where an put of data with overwrite cache policy would not get propagated via zen's built-in upstream mechanism with a matching overwrite cache policy to the upstream. This change ensures that it does and leaves the unit test configured to exercise this scenario.
* Change default limit-overwrite behavior to truezousar2025-12-172-2/+2
|
* remove error warning in output (#695)Dan Engelbrecht2025-12-172-2/+2
| | | * changed some logging string so they don't get caught in CI logging
* add boost-worker oplog import export options (#693)Dan Engelbrecht2025-12-162-22/+73
| | | | | | | | | | - Feature: `zen oplog-export`, `zen oplog-import` and `zen oplog-download` now has options to boost workers - `--boost-worker-count` - Increase the number of worker threads - may cause computer to be less responsive - `--boost-worker-memory` - Increase the limit where we write downloaded data to temporary storage to conserve space - may cause computer to be less responsive due to high memory usage - `--boost-workers` - Enables both 'boost-worker-count' and 'boost-worker-memory' - may cause computer to be less responsive - Improvement: Refactored boost options for `zen builds` operations `upload`, `download`, `diff`, `prime-cache`, `fetch-blob` and `validate-part` - `--boost-worker-count` - Increase the number of worker threads - may cause computer to be less responsive - `--boost-worker-memory` - Increase the limit where we write downloaded data to temporary storage to conserve space - may cause computer to be less responsive due to high memory usage - `--boost-workers` - Enables both 'boost-worker-count' and 'boost-worker-memory' - may cause computer to be less responsive
* add otel instrumentation (#581)Stefan Boberg2025-12-113-0/+19
| | | | | | | | this change adds OTEL tracing to a few places * Top-level application lifecycle (config/init/cleanup, main loop) * http.sys requests it also brings some otlptrace optimizations and dynamic configuration of tracing. OTLP tracing is currently always disabled
* upload to zen cache from oplog import now disabled by default (#680)Dan Engelbrecht2025-12-091-1/+1
|
* add missing patterns to objectstore service http routing (#674)Dan Engelbrecht2025-12-031-3/+7
|
* automatic scrub on startup (#667)Dan Engelbrecht2025-11-273-32/+46
| | | | | - Improvement: Deeper validation of data when scrub is activated (cas/cache/project) - Improvement: Enabled more multi threading when running scrub operations - Improvement: Added means to force a scrub operation at startup with a new release using ZEN_DATA_FORCE_SCRUB_VERSION variable in xmake.lua
* logging improvements (#664)Stefan Boberg2025-11-243-21/+24
| | | | | * Eliminate spurious `FlushFileBuffers` calls on Windows by tracking writes * Make cache log file creation optional
* Added actions to drop all projects or all z$ namespaces. (#655)Martin Ridgers2025-11-183-2/+54
| | | | | | | | | | | * Save references to the project and zcache tables * Add an attribute to table rows with the actionable project/namespace id * Drop-all option for projects and cache namespaces * Updated frontend .zip archive * Edited changelog
* Include version string on the dashboard's start page. (#651)Martin Ridgers2025-11-174-2/+26
| | | | | | | | | | | * Method to get plain text from an async request * Include server's version on the dashboard start page * Same paragraph style as the rest of the method * Updated changelog * Update frontend archive
* control cache upload (#646)Dan Engelbrecht2025-11-121-0/+2
| | | * add option to enable/disable upload to builds cache
* switch to xmake for package management (#611)Stefan Boberg2025-11-074-10/+55
| | | | | | | | | | | | | | | | | | | | | | This change removes our dependency on vcpkg for package management, in favour of bringing some code in-tree in the `thirdparty` folder as well as using the xmake build-in package management feature. For the latter, all the package definitions are maintained in the zen repo itself, in the `repo` folder. It should now also be easier to build the project as it will no longer depend on having the right version of vcpkg installed, which has been a common problem for new people coming in to the codebase. Now you should only need xmake to build. * Bumps xmake requirement on github runners to 2.9.9 to resolve an issue where xmake on Windows invokes cmake with `v144` toolchain which does not exist * BLAKE3 is now in-tree at `thirdparty/blake3` * cpr is now in-tree at `thirdparty/cpr` * cxxopts is now in-tree at `thirdparty/cxxopts` * fmt is now in-tree at `thirdparty/fmt` * robin-map is now in-tree at `thirdparty/robin-map` * ryml is now in-tree at `thirdparty/ryml` * sol2 is now in-tree at `thirdparty/sol2` * spdlog is now in-tree at `thirdparty/spdlog` * utfcpp is now in-tree at `thirdparty/utfcpp` * xmake package repo definitions is in `repo` * implemented support for sanitizers. ASAN is supported on windows, TSAN, UBSAN, MSAN etc are supported on Linux/MacOS though I have not yet tested it extensively on MacOS * the zencore encryption implementation also now supports using mbedTLS which is used on MacOS, though for now we still use openssl on Linux * crashpad * bumps libcurl to 8.11.0 (from 8.8.0) which should address a rare build upload bug
* Various fixes to address issues flagged by gcc / non-UE toolchain build (#621)Stefan Boberg2025-11-018-34/+35
| | | | | | | | | | | | | | | | | | | | * gcc: avoid using memset on nontrivial struct * redundant `return std::move` * fixed various compilation issues flagged by gcc * fix issue in xmake.lua detecting whether we are building with the UE toolchain or not * add GCC ignore -Wundef (comment is inaccurate) * remove redundant std::move * don't catch exceptions by value * unreferenced variables * initialize "by the book" instead of memset * remove unused exception reference * add #include <cstring> to fix gcc build * explicitly poulate KeyValueMap by traversing input spans fixes gcc compilation * remove unreferenced variable * eliminate redundant `std::move` which gcc complains about * fix gcc compilation by including <cstring> * tag unreferenced variable to fix gcc compilation * fixes for various cases of naming members the same as their type
* make sure OpenProcessCache is initialized before use (#618)Stefan Boberg2025-10-291-4/+4
| | | previously, a null reference would be passed into ProjectStore constructor
* fix --zentrace=no compile errors (#616)Stefan Boberg2025-10-282-2/+4
| | | | | | * make sure the correct `UE_WITH_TRACE` conditional is used to enable/disable support code as appropriate * fixed some accidental `int32`, `int64` et al usage, due to typedefs leaking through from trace header with this fix, it is now possible to build with `--zentrace=no` again
* move cpr in-tree (#605)Stefan Boberg2025-10-241-2/+1
| | | | | | * added cpr 1.10.5 in-tree to allow updates to vcpkg without breaking the build * added asio 1.29.0 in-tree to remove one more vcpkg dependency * bumped vcpkg to 2024.06.15 to address failure to build due to use of deprecated binaries in vcpkg (404 error: `https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.1.0-1-any.pkg.tar.zst` during build)
* add host discovery and zen cache support for oplog import (#601)Dan Engelbrecht2025-10-231-13/+29
| | | * add host discovery and zen cache support for oplog import
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-19 22:12:27 +0000