aboutsummaryrefslogtreecommitdiff
path: root/.github/workflows
Commit message (Collapse)AuthorAgeFilesLines
* kill stale test processes (zenserver, minio, nomad, consul) before and after ↵Stefan Boberg3 days1-0/+84
| | | | | CI test runs (#909) Adds steps to the validate workflow on all platforms that kill any zenserver, minio, nomad, or consul processes launched from the build output directory. Runs before tests to clear stale processes from previous runs, and after tests (always, even on failure) to clean up.
* Skip release workflow when version tag already exists (#898)Stefan Boberg8 days2-276/+308
| | | Split create_release.yml into a lightweight gate that checks for an existing git tag and a reusable workflow (create_release_impl.yml) containing all build/release jobs. When VERSION.txt is merged to a non-release branch the tag check short-circuits the entire workflow, preventing duplicate builds and failed artifact uploads.
* Linux Crashpad fix (#890)Stefan Boberg11 days1-0/+6
| | | | | | - **Replace crashpad static-libc++ patch file with `io.replace()` in `on_install`** — The old `.patch` file was fragile (trailing-whitespace stripping on Windows would silently break it). Using `io.replace()` in the xmake build script is more robust and easier to maintain. - **Skip sentry-native `on_test` link check on Linux** — The link test requires `-lc++abi` when building with the UE clang toolchain but adding it unconditionally breaks GCC/libstdc++ builds. The zenserver build itself validates that the library is usable. - **Add `crashpad-test.sh`** — A test script that launches a release zenserver, waits for the health endpoint, then verifies that `crashpad_handler` is running, no `sentry_init` failure was logged, and the handler has no dynamic `libc++.so.1` dependency. - **Add Crashpad Check step to Linux release CI** — Runs `crashpad-test.sh` in the `validate` workflow for release builds to catch crashpad regressions before merge.
* Merge branch 'de/v5.7.25-hotpatch' (#880)Dan Engelbrecht12 days1-0/+1
|
* Compute batching (#849)Stefan Boberg2026-03-181-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ### Compute Batch Submission - Consolidate duplicated action submission logic in `httpcomputeservice` into a single `HandleSubmitAction` supporting both single-action and batch (actions array) payloads - Group actions by queue in `RemoteHttpRunner` and submit as batches with configurable chunk size, falling back to individual submission on failure - Extract shared helpers: `MakeErrorResult`, `ValidateQueueForEnqueue`, `ActivateActionInQueue`, `RemoveActionFromActiveMaps` ### Retracted Action State - Add `Retracted` state to `RunnerAction` for retry-free rescheduling — an explicit request to pull an action back and reschedule it on a different runner without incrementing `RetryCount` - Implement idempotent `RetractAction()` on `RunnerAction` and `ComputeServiceSession` - Add `POST jobs/{lsn}/retract` and `queues/{queueref}/jobs/{lsn}/retract` HTTP endpoints - Add state machine documentation and per-state comments to `RunnerAction` ### Compute Race Fixes - Fix race in `HandleActionUpdates` where actions enqueued between session abandon and scheduler tick were never abandoned, causing `GetActionResult` to return 202 indefinitely - Fix queue `ActiveCount` race where `NotifyQueueActionComplete` was called after releasing `m_ResultsLock`, allowing callers to observe stale counters immediately after `GetActionResult` returned OK ### Logging Optimization and ANSI improvements - Improve `AnsiColorStdoutSink` write efficiency — single write call, dirty-flag flush, `RwLock` instead of `std::mutex` - Move ANSI color emission from sink into formatters via `Formatter::SetColorEnabled()`; remove `ColorRangeStart`/`End` from `LogMessage` - Extract color helpers (`AnsiColorForLevel`, `StripAnsiSgrSequences`) into `helpers.h` - Strip upstream ANSI SGR escapes in non-color output mode. This enables colour in log messages without polluting log files with ANSI control sequences - Move `RotatingFileSink`, `JsonFormatter`, and `FullFormatter` from header-only to pimpl with `.cpp` files ### CLI / Exec Refactoring - Extract `ExecSessionRunner` class from ~920-line `ExecUsingSession` into focused methods and a `ExecSessionConfig` struct - Replace monolithic `ExecCommand` with subcommand-based architecture (`http`, `inproc`, `beacon`, `dump`, `buildlog`) - Allow parent options to appear after subcommand name by parsing subcommand args permissively and forwarding unmatched tokens to the parent parser ### Testing Improvements - Fix `--test-suite` filter being ignored due to accumulation with default wildcard filter - Add test suite banners to test listener output - Made `function.session.abandon_pending` test more robust ### Startup / Reliability Fixes - Fix silent exit when a second zenserver instance detects a port conflict — use `ZEN_CONSOLE_*` for log calls that precede `InitializeLogging()` - Fix two potential SIGSEGV paths during early startup: guard `sentry_options_new()` returning nullptr, and throw on `ZenServerState::Register()` returning nullptr instead of dereferencing - Fail on unrecognized zenserver `--mode` instead of silently defaulting to store ### Other - Show host details (hostname, platform, CPU count, memory) when discovering new compute workers - Move frontend `html.zip` from source tree into build directory - Add format specifications for Compact Binary and Compressed Buffer wire formats - Add `WriteCompactBinaryObject` to zencore - Extended `ConsoleTui` with additional functionality - Add `--vscode` option to `xmake sln` for clangd / `compile_commands.json` support - Disable compute/horde/nomad in release builds (not yet production-ready) - Disable unintended `ASIO_HAS_IO_URING` enablement - Fix crashpad patch missing leading whitespace - Clean up code triggering gcc false positives
* fix for GHES failing on upload-artifacts@v3 (#856)Stefan Boberg2026-03-182-16/+16
| | | Pin version to last v3 version using node20, since our GHES does not support v4
* Push Docker images to ECR after building (#845)Stefan Boberg2026-03-162-17/+21
| | | | | | | - Add ECR login via aws CLI (using IMDS credentials) - Tag and push images to 728559092788.dkr.ecr.us-east-1.amazonaws.com/zenserver - Use tag suffixes (-wine, -linux) to discriminate image variants - Replace read-file-action with shell equivalent for VERSION.txt - Enable docker-build and artifact uploads on all branches for validation
* Add Docker image build for compute workers (#837)Stefan Boberg2026-03-162-0/+101
| | | Adds a Dockerfile (Ubuntu 24.04 + WineHQ) and an `xmake docker` task to build and optionally push a zenserver-compute Docker image, enabling Linux deployment of compute workers that run Windows executables via Wine.
* oidctoken tool package (#810)Stefan Boberg2026-03-051-5/+5
| | | | | * added OidcToken binary to the build process. The binary is mirrored from p4 and is placed next to the output of the build process. It is also placed in the release zip archives. * also fixed issue with Linux symbol stripping which was introduced in toolchain changes yesterday
* native xmake toolchain definition for UE-clang (#805)Stefan Boberg2026-03-042-5/+5
| | | | | | | | | | | | | | | This change is meant to provide a smoother experience when working on Linux. After this change, the toolchain setup process is now simply ```bash $ scripts/ue_build_linux/get_ue_toolchain.sh ``` and then at config time the toolchain is automatically detected if you downloaded it to the default location or have the `UE_TOOLCHAIN_DIR` environment variable set ```bash xmake config --mode=debug ``` Compared to the old script-based approach this configures the toolchain more precisely, avoiding leakage into unrelated build processes such as when a package manager decides to build something like Ninja locally etc.
* added `--verbose` option to zenserver-test and `xmake test` (#798)Stefan Boberg2026-03-012-6/+6
| | | | | | * when `--verbose` is specified to zenserver-test, all child process output (typically, zenserver instances) is piped through to stdout. you can also pass `--verbose` to `xmake test` to accomplish the same thing. * this PR also consolidates all test runner `main` function logic (such as from zencore-test, zenhttp-test etc) into central implementation in zencore for consistency and ease of maintenance * also added extended utf8-tests including a fix to `Utf8ToWide()`
* test running / reporting improvements (#797)Stefan Boberg2026-02-282-27/+66
| | | | | | | | | | | | | | | | | | | **CI/CD improvements (validate.yml):** - Add test reporter (`ue-foundation/test-reporter@v2`) for all three platforms, rendering JUnit test results directly in PR check runs - Add "Trust workspace" step on Windows to fix git safe.directory ownership issue with self-hosted runners - Clean stale report files before each test run to prevent false failures from leftover XML - Broaden `paths-ignore` to skip builds for non-code changes (`*.md`, `LICENSE`, `.gitignore`, `docs/**`) **Test improvements:** - Convert `CHECK` to `REQUIRE` in several test suites (projectstore, integration, http) for fail-fast behavior - Mark some tests with `doctest::skip()` for selective execution - Skip httpclient transport tests pending investigation - Add `--noskip` option to `xmake test` task - Add `--repeat=<N>` option to `xmake test` task, to run tests repeatedly N times or until there is a failure **xmake test output improvements:** - Add totals row to test summary table - Right-justify numeric columns in summary table
* retain xmake state between runs (#656)Stefan Boberg2025-11-182-2/+2
| | | | | | this change relocates the xmake global state to a directory beside the workspace directory so it doesn't get wiped on every run thus we can avoid rebuilding every package on every run. Unlike vcpkg, xmake separates revisions of packages into their own tree it's robust enough to handle different versions of different packages on different branches. It's however not clear to me that modifying the contents of an `xmake.lua` package definition file across branches is ok. It *may* be necessary to change the directory name for the shared state in this case but it should be a rare event.
* sentry/asan configuration tweaks (#649)v5.7.10-pre0Stefan Boberg2025-11-132-6/+6
| | | | | * Automated more of the decisions around which options to set when using ASAN * Also disabled Sentry by default as it's a bit annoying to have it upload crashes during development. Sentry is still automatically enabled and integrated as part of the `xmake bundle` step however so released builds will still have it.
* switch to xmake for package management (#611)Stefan Boberg2025-11-072-105/+5
| | | | | | | | | | | | | | | | | | | | | | This change removes our dependency on vcpkg for package management, in favour of bringing some code in-tree in the `thirdparty` folder as well as using the xmake build-in package management feature. For the latter, all the package definitions are maintained in the zen repo itself, in the `repo` folder. It should now also be easier to build the project as it will no longer depend on having the right version of vcpkg installed, which has been a common problem for new people coming in to the codebase. Now you should only need xmake to build. * Bumps xmake requirement on github runners to 2.9.9 to resolve an issue where xmake on Windows invokes cmake with `v144` toolchain which does not exist * BLAKE3 is now in-tree at `thirdparty/blake3` * cpr is now in-tree at `thirdparty/cpr` * cxxopts is now in-tree at `thirdparty/cxxopts` * fmt is now in-tree at `thirdparty/fmt` * robin-map is now in-tree at `thirdparty/robin-map` * ryml is now in-tree at `thirdparty/ryml` * sol2 is now in-tree at `thirdparty/sol2` * spdlog is now in-tree at `thirdparty/spdlog` * utfcpp is now in-tree at `thirdparty/utfcpp` * xmake package repo definitions is in `repo` * implemented support for sanitizers. ASAN is supported on windows, TSAN, UBSAN, MSAN etc are supported on Linux/MacOS though I have not yet tested it extensively on MacOS * the zencore encryption implementation also now supports using mbedTLS which is used on MacOS, though for now we still use openssl on Linux * crashpad * bumps libcurl to 8.11.0 (from 8.8.0) which should address a rare build upload bug
* move cpr in-tree (#605)Stefan Boberg2025-10-242-2/+2
| | | | | | * added cpr 1.10.5 in-tree to allow updates to vcpkg without breaking the build * added asio 1.29.0 in-tree to remove one more vcpkg dependency * bumped vcpkg to 2024.06.15 to address failure to build due to use of deprecated binaries in vcpkg (404 error: `https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.1.0-1-any.pkg.tar.zst` during build)
* use batching clang-format for quicker turnaround on validate actions (#529)Stefan Boberg2025-09-301-1/+1
| | | this changes the validate job to use a batching version of the clang-format-action which reduces turnaround from some six minutes to six seconds
* update readme with required vcpkg version (#496)Dan Engelbrecht2025-09-152-2/+2
| | | - Improvement: Updated README.md to state the required version vcpkg
* Remove workflow hacks for CI debuggingLiam Mitchell2025-08-221-1/+0
|
* Remove libc++ installation from validate workflowLiam Mitchell2025-08-201-6/+0
|
* Use apt instead of apt-get for installing system packagesLiam Mitchell2025-07-301-2/+3
|
* Install libc++-dev during CI in order to build libsystemd properlyLiam Mitchell2025-07-291-0/+5
|
* Always upload vcpkg logs on failureLiam Mitchell2025-07-261-0/+1
|
* Temporarily enable Validate jobs on push to de/zen-service-command for testingLiam Mitchell2025-07-261-0/+1
|
* Upload vcpkg logs as artifacts on failureLiam Mitchell2025-07-251-0/+6
|
* Fixed release mirror on new release (#243)Joakim Lindqvist2024-11-282-6/+6
| | | | | By removing the minimal version we set (as this is exclusive meaning it would not replicate the current release). As such we cant guarantee that the replication takes the current release so we replicate a few releases. Also fixed the display name of the step when manually running the release mirroring.
* upload linux mac exe to sentry (#196)Dan Engelbrecht2024-10-161-6/+10
| | | | * upload mac/linux executables to sentry using `debug-files bundle-sources` on all platforms * update sentry-cli to latest on windows
* Revert "remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY ↵Dan Engelbrecht2024-10-101-2/+1
| | | | | (#191)" (#193) This reverts commit e809931618b443809e9740edb70a62d0cab01f87.
* remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY (#191)Stefan Boberg2024-10-081-1/+2
| | | | | | * remove temporary workaround involving _LIBCPP_DISABLE_AVAILABILITY * temp disable signing on Mac this change should be revisited once we have resumed regular service wrt MacOS runners
* Running the public github release mirroring as part of creating the release ↵Joakim Lindqvist2024-09-162-3/+27
| | | | | | | (#158) * Running the public github release mirroring as part of creating the release This because workflows does not trigger events when created using the built in GITHUB_TOKEN so the release we create does not trigger the release replication workflow.
* Replicate releases on new release creation (#150)Joakim Lindqvist2024-09-102-6/+11
| | | | | | | | | * Ignore changes to the mirror_releases script * Only trigger release mirroring when new releases are made * Added a minimum release number to workaround issues with certain older releases * Lowered number of releases that are replicated
* Fixes to the release replication workflow (#148)Joakim Lindqvist2024-09-091-2/+6
| | | | | * Use our local copy of the clone-release action * Avoid pre-releases and draft releases
* Added github action to mirror releases to github.com (#144)Joakim Lindqvist2024-09-051-0/+29
|
* bump vcpkg and xmake to latest (#40)Dan Engelbrecht2024-04-242-4/+4
| | | - Improvement: Bumped xmake to 2.9.1 and vcpkg version to 2024.03.25
* add a limit to the number of times we attempt to finalize (#22)Dan Engelbrecht2024-03-252-10/+15
| | | | | | - Improvement: Add limit to the number of times we attempt to finalize and exported oplog - Improvement: Switch to large thread pool when executing oplog export/import - Improvement: Clean up reporting of missing attachments in oplog export/import - Improvement: Remove double-reporting of abort reason for oplog export/import
* Edit action name for brevityStefan Boberg2024-03-211-1/+1
|
* added action to mirror repo to github.com (#17)Stefan Boberg2024-03-212-1/+22
|
* locking action-cond to 1.1.1Dan Engelbrecht2024-03-211-1/+1
|
* use [email protected] to avoid node20 problemsStefan Boberg2024-03-211-2/+2
|
* re-enable macos signing (#15)Dan Engelbrecht2024-03-202-4/+2
|
* remove hv tags on actions since they are no longer usefulStefan Boberg2024-03-202-9/+9
| | | | we use `zen` tags to discriminate now instead
* Enabled signing on windows agents again (#12)Joakim Lindqvist2024-03-202-4/+3
| | | * Enabled signing on windows agents again
* make sure zenserver reacts and exist on SIGTERM signal (#8)Dan Engelbrecht2024-03-152-11/+13
| | | | | * make sure zenserver reacts and exist on SIGTERM signal * add zen tag to all runners * temp disable mac codesigning
* remove vcpkg integrate install from windows setupStefan Boberg2024-03-151-1/+0
|
* updated runs-on for release workflowDan Engelbrecht2024-03-141-4/+5
|
* updates to signingStefan Boberg2024-03-132-3/+4
| | | | | macOS signs executables again Windows releases do not (neither does validate)
* workflow tweaksStefan Boberg2024-03-122-9/+9
|
* workflow fixes (#1)Stefan Boberg2024-03-122-25/+22
| | | | | * update validate action for enterprise github * updated runner setup options * updated release workflow for enterprise github
* also update validate to avoid code sign problemsStefan Boberg2024-03-051-1/+2
|
* disable official signing of windows executables (#667)Dan Engelbrecht2024-03-051-1/+2
|
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-04 21:38:26 +0000