aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Fix formatting of stat pages (#748)Liam Mitchell2026-02-094-3/+10
| | | * Fix formatting of stat pages
* ported optimizations of MeasureVarUInt (#747)Dan Engelbrecht2026-02-061-2/+12
|
* fix target folder cleanup in builds download (#746)Dan Engelbrecht2026-02-061-12/+9
|
* only check file size for requested range in asio TransmitFileAsync in debug ↵Dan Engelbrecht2026-02-061-41/+63
| | | | | | mode (#745) * only check file size for requested range in asio TransmitFileAsync in debug mode * only do Transmit file for whole files
* Merge pull request #723 from ue-foundation/lm/service-interactive-sessionLiam Mitchell2026-02-044-40/+16
|\ | | | | Run Windows service as an interactive session, so we correctly respond to RequestApplicationExit when requested to stop by the service manager
| * Revert "Run Windows service as an interactive session, so we correctly ↵Liam Mitchell2026-02-031-2/+2
| | | | | | | | | | | | respond to RequestApplicationExit when requested to stop by the service manager" This reverts commit b380c1bac4b738f49cd412697e0a051402e6d171.
| * Respond to RequestApplicationExit() in http server implementations even in ↵Liam Mitchell2026-01-294-40/+16
| | | | | | | | non-interactive sessions
| * Run Windows service as an interactive session, so we correctly respond to ↵Liam Mitchell2026-01-191-2/+2
| | | | | | | | RequestApplicationExit when requested to stop by the service manager
* | use matcher over regex (#744)Dan Engelbrecht2026-02-046-18/+58
| | | | | | | | * replace http router AddPattern with AddMatcher * fix scrub logging
* | implemented chunking for TransmitFile path (#736)Stefan Boberg2026-02-041-58/+119
| | | | | | | | | | * implemented chunking for TransmitFile path, to ensure payloads exceeding the TransmitFile API limit of 4GB can be handled * also fixes similar issue with memory path
* | Merge pull request #724 from ue-foundation/lm/restrict-reads-to-projectLiam Mitchell2026-02-031-4/+32
|\ \ | | | | | | Restrict filesystem reads in snapshot to paths under project root
| * | Disallow external file reads from project with unset project rootsLiam Mitchell2026-01-291-5/+8
| | |
| * | Revert to previous behaviour for path checking in the presence of an empty ↵Liam Mitchell2026-01-281-9/+13
| | | | | | | | | | | | project root
| * | Use std::mismatch to compare paths and hoist project root canonicalization ↵Liam Mitchell2026-01-211-13/+18
| | | | | | | | | | | | out of loop
| * | Restrict filesystem reads in snapshot to paths under project rootLiam Mitchell2026-01-191-2/+18
| |/
* | reduce blocking in scrub (#743)Dan Engelbrecht2026-02-033-67/+100
| | | | | | * reduce held locks while performing scrub operation
* | add command line option for scrub timeslice (#742)Dan Engelbrecht2026-02-033-5/+23
| |
* | only disable backlog scheduling when downloaded payload is not on disk (#741)Dan Engelbrecht2026-02-022-7/+14
| |
* | reduce batch size for reads (#740)Dan Engelbrecht2026-01-294-5/+5
| | | | | | | | | | * reduce maximum size per chunk to read to reduce disk contention * increase timeout before warning on slow shut down of zenserver * reduce default window size for blockstore chunk iteration
* | don't do full cb-object validation on cache records when read from disk (#739)Dan Engelbrecht2026-01-291-10/+9
| | | | | | * don't do full cb-object validation on cache records when read from disk
* | restore missing healthinfo call (#737)Dan Engelbrecht2026-01-281-0/+5
| |
* | Avoid conversion from JSon to compact binary when querying for builds to ↵Dan Engelbrecht2026-01-286-18/+24
| | | | | | | | avoid integer vs float conversion issues (#735)
* | allow download specification for zen builds download (#734)Dan Engelbrecht2026-01-277-126/+323
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Feature: `zen builds download` now supports `--download-spec-path` to determine what content to download from a build - The unstructured format expects one line per file relative to the root with '/' as a path delimiter - The structured format uses JSon format and the `--download-spec-path` must have extension `.json` to enable structured input { "parts": { "default" : { "files": [ "foo/bar", "baz.exe" ] }, "symbols": { "files": [ "baz.pdb" ] } } }
* | avoid big ioworker backlog (#733)Dan Engelbrecht2026-01-263-39/+56
| | | | | | | | | | | | * add ability to override scheduling mode in ParallelWork * Don't increase buffering size when copying from local cache with --boost-worker-memory enabled * Rework scheduling writes of downloaded data to reduce memory usage
* | builds scanning cache (#727)v5.7.19-pre0Dan Engelbrecht2026-01-2310-199/+1110
| | | | | | | | - Feature: Added `--chunking-cache-path` option to `zen builds upload` and `zen builds diff` - Path to cache for chunking information of scanned files. Default is empty resulting in no caching
* | make sure new blocks generated by a part is accessible to following parts (#732)Dan Engelbrecht2026-01-232-81/+92
| |
* | Zs/oplog navigation fix (#731)Zousar Shaker2026-01-232-6/+6
| | | | | | * Fix incorrect oplog navigation symbols
* | hotfix 5.7.18 (#730)Dan Engelbrecht2026-01-227-39/+62
| | | | | | | | * make sure we properly convert command line args for zenserver as well * make sure we *add* wildcards/excludes in addition to defaults
* | zen hub (#574)Stefan Boberg2026-01-2110-10/+1798
| | | | | | | | | | Initial implementation of zenserver "hub" mode. This is an experimental feature. zenserver can be started in hub mode by specifying `hub` as the first argument to zenserver
* | builds multipart upload (#722)Dan Engelbrecht2026-01-207-1437/+2219
|/ | | | | | | | | | | | | | | | | | | | | - Feature: `zen builds upload` now support structure manifest input for `--manifest-path` when the path has a `.json` extension - The structured manifest supports splitting a build into multiple parts { "parts": { "default" : { "partId": "f939f3939939fff3f3202", # optional - used to control the id of each part "files": [ "foo/bar", "baz.exe" ] }, "symbols": { "files": [ "baz.pdb" ] } } }
* zenserver API changes, some other minor changes (#720)Stefan Boberg2026-01-199-29/+186
| | | | | | | * add system metrics output to top command * removed unnecessary xmake directives * file system API/comment tweaks * fixed out-of-range access in httpserver test * updated ZenServer base API to allow customization by mode
* ZenServerProcess API changes (#719)Stefan Boberg2026-01-198-48/+162
| | | | | | | This refactor aims to improve the `ZenServerProcess` classes by making them useful for managing child zenserver instances in more scenarios than just automated tests. This involves changing some functions to not talk about "test directory" and instead use "data directory" etc As a consequence of the API changes, some tests have changed accordingly. The code includes som reference to the "hub" mode but there is not yet any other code using this mode, it's just included in this PR to simplify future merges.
* remove ZENCORE_API completely (#718)Stefan Boberg2026-01-1922-423/+404
| | | initially we had ZENCORE_API macros to potentially allow for DLL linkage. It turns out that this is not useful and the macros just contribute noise, so this change removes them completely.
* OTLP/trace improvements (#717)Stefan Boberg2026-01-196-35/+152
| | | | | | | This PR brings over some changes made to avoid performing setup for otel instrumentation if we are not sending otel information anywhere anyway. It also adds the ability to configure an OTLP endpoint on the command line using `--otlp-endpoint=<URI>`. Bear in mind that OTLP support is still not officially supported so this should not be used in production at this stage.
* consul package and basic client added (#716)Stefan Boberg2026-01-198-20/+426
| | | | | | | | * this adds a consul package which can be used to fetch a consul binary * it also adds a `ConsulProcess` helper which can be used to spawn and manage a consul service instance * zencore dependencies brought across: - `except_fmt.h` for easer generation of formatted exception messages - `process.h/cpp` changes (adds `Kill` operation and process group support on Windows) - `string.h` changes to allow generic use of `WideToUtf8()`
* Merge pull request #701 from ue-foundation/lm/mac-daemon-modeLiam Mitchell2026-01-152-41/+35
|\ | | | | Implement final changes required for daemon mode on Mac
| * Run clang-format on service.cppLiam Mitchell2026-01-151-3/+2
| |
| * Rename IsElevated to RequiresElevationLiam Mitchell2026-01-151-9/+9
| |
| * Implement final changes required for daemon mode on MacLiam Mitchell2026-01-072-33/+28
| |
* | throw error on bad oidctoken-exe-path (#713)Dan Engelbrecht2026-01-152-10/+24
| | | | | | | | * throw error on bad oidctoken-exe-path
* | use current locale when converting wide char command line arguments to ↵Dan Engelbrecht2026-01-1511-1/+49
| | | | | | | | | | | | string (#712) * set utf8 locale, only set LC_CTYPE as we don't want to affect how decimal point or sorting orders are handled * set language/region explicitly so we can use LC_ALL
* | fix init of buildpart id in zen oplog-download (#711)Dan Engelbrecht2026-01-151-1/+1
| |
* | structured output for builds ls (#709)Dan Engelbrecht2026-01-143-70/+188
| | | | | | | | * make ResolveBuildStore respect Verbose flag * add structured output to zen builds ls command
* | asio/http optimizations (#449)Stefan Boberg2026-01-142-131/+640
| | | | | | | | | | | | | | This change primarily introduces improved logic for dealing with sending data from file references. This is intended to reduce the amount of memory-mapping we end up doing when sending data from files. Windows now uses `TransmitFile` to send file data more efficiently using kernel-side I/O, but Linux/Mac basically behaves as before since they don't offer any true async file I/O support via asio. This should be implemented separately using a background I/O thread pool. This PR also includes improved memory management for http/asio with reduced allocation counts, and a fix for a potential use-after-free in very high load scenarios.
* | minor fixes (#708)Stefan Boberg2026-01-132-3/+2
| | | | | | | | | | * remove unreferenced local in projectstore_cmd * fix minor atomic memory issue in RotatingFileSink
* | added options to configure exclude folders and extensions to zen build ↵Dan Engelbrecht2026-01-1310-223/+468
| | | | | | | | | | | | | | | | commands (#706) * added `--exclude-folders` to `zen upload`, `zen download` and `zen diff` added `--exclude-extensions` to `zen upload` and `zen diff` excluded folder names are now matched by folder name in subfolders in addition to root level folders * allow multiple token separators
* | fixed block generation after bug introduced in PR #704 (#707)Dan Engelbrecht2026-01-131-12/+15
| |
* | if we fail to create the server mutex, gracefully report error without ↵Dan Engelbrecht2026-01-121-1/+3
| | | | | | | | sending error to Sentry (#705)
* | various optimizations (#704)Dan Engelbrecht2026-01-095-33/+151
| | | | | | | | | | | | | | | | | | - Improvement: Validate chunk hashes when dechunking files in oplog import - Improvement: Use stream decompression when dechunking files - Improvement: When assembling blocks for oplog export, make sure we keep under/at block size limit - Improvement: Make cancelling of oplog import more responsive - Improvement: Use decompress to composite to avoid allocating a new memory buffer for uncompressed chunks during oplog import - Improvement: Reduce memory buffer size and allocate it on demand when writing multiple chunks to block store - Improvement: Reduce lock contention when fetching/checking existence of chunks in block store
* | CprHttpClient cleanup (#703)Dan Engelbrecht2026-01-092-7/+3
| |
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-22 07:57:34 +0000