aboutsummaryrefslogtreecommitdiff
path: root/.github/workflows/create_release.yml
Commit message (Collapse)AuthorAgeFilesLines
* Skip release workflow when version tag already exists (#898)Stefan Boberg8 days1-276/+23
| | | Split create_release.yml into a lightweight gate that checks for an existing git tag and a reusable workflow (create_release_impl.yml) containing all build/release jobs. When VERSION.txt is merged to a non-release branch the tag check short-circuits the entire workflow, preventing duplicate builds and failed artifact uploads.
* Merge branch 'de/v5.7.25-hotpatch' (#880)Dan Engelbrecht12 days1-0/+1
|
* Compute batching (#849)Stefan Boberg2026-03-181-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ### Compute Batch Submission - Consolidate duplicated action submission logic in `httpcomputeservice` into a single `HandleSubmitAction` supporting both single-action and batch (actions array) payloads - Group actions by queue in `RemoteHttpRunner` and submit as batches with configurable chunk size, falling back to individual submission on failure - Extract shared helpers: `MakeErrorResult`, `ValidateQueueForEnqueue`, `ActivateActionInQueue`, `RemoveActionFromActiveMaps` ### Retracted Action State - Add `Retracted` state to `RunnerAction` for retry-free rescheduling — an explicit request to pull an action back and reschedule it on a different runner without incrementing `RetryCount` - Implement idempotent `RetractAction()` on `RunnerAction` and `ComputeServiceSession` - Add `POST jobs/{lsn}/retract` and `queues/{queueref}/jobs/{lsn}/retract` HTTP endpoints - Add state machine documentation and per-state comments to `RunnerAction` ### Compute Race Fixes - Fix race in `HandleActionUpdates` where actions enqueued between session abandon and scheduler tick were never abandoned, causing `GetActionResult` to return 202 indefinitely - Fix queue `ActiveCount` race where `NotifyQueueActionComplete` was called after releasing `m_ResultsLock`, allowing callers to observe stale counters immediately after `GetActionResult` returned OK ### Logging Optimization and ANSI improvements - Improve `AnsiColorStdoutSink` write efficiency — single write call, dirty-flag flush, `RwLock` instead of `std::mutex` - Move ANSI color emission from sink into formatters via `Formatter::SetColorEnabled()`; remove `ColorRangeStart`/`End` from `LogMessage` - Extract color helpers (`AnsiColorForLevel`, `StripAnsiSgrSequences`) into `helpers.h` - Strip upstream ANSI SGR escapes in non-color output mode. This enables colour in log messages without polluting log files with ANSI control sequences - Move `RotatingFileSink`, `JsonFormatter`, and `FullFormatter` from header-only to pimpl with `.cpp` files ### CLI / Exec Refactoring - Extract `ExecSessionRunner` class from ~920-line `ExecUsingSession` into focused methods and a `ExecSessionConfig` struct - Replace monolithic `ExecCommand` with subcommand-based architecture (`http`, `inproc`, `beacon`, `dump`, `buildlog`) - Allow parent options to appear after subcommand name by parsing subcommand args permissively and forwarding unmatched tokens to the parent parser ### Testing Improvements - Fix `--test-suite` filter being ignored due to accumulation with default wildcard filter - Add test suite banners to test listener output - Made `function.session.abandon_pending` test more robust ### Startup / Reliability Fixes - Fix silent exit when a second zenserver instance detects a port conflict — use `ZEN_CONSOLE_*` for log calls that precede `InitializeLogging()` - Fix two potential SIGSEGV paths during early startup: guard `sentry_options_new()` returning nullptr, and throw on `ZenServerState::Register()` returning nullptr instead of dereferencing - Fail on unrecognized zenserver `--mode` instead of silently defaulting to store ### Other - Show host details (hostname, platform, CPU count, memory) when discovering new compute workers - Move frontend `html.zip` from source tree into build directory - Add format specifications for Compact Binary and Compressed Buffer wire formats - Add `WriteCompactBinaryObject` to zencore - Extended `ConsoleTui` with additional functionality - Add `--vscode` option to `xmake sln` for clangd / `compile_commands.json` support - Disable compute/horde/nomad in release builds (not yet production-ready) - Disable unintended `ASIO_HAS_IO_URING` enablement - Fix crashpad patch missing leading whitespace - Clean up code triggering gcc false positives
* fix for GHES failing on upload-artifacts@v3 (#856)Stefan Boberg2026-03-181-8/+8
| | | Pin version to last v3 version using node20, since our GHES does not support v4
* Push Docker images to ECR after building (#845)Stefan Boberg2026-03-161-13/+11
| | | | | | | - Add ECR login via aws CLI (using IMDS credentials) - Tag and push images to 728559092788.dkr.ecr.us-east-1.amazonaws.com/zenserver - Use tag suffixes (-wine, -linux) to discriminate image variants - Replace read-file-action with shell equivalent for VERSION.txt - Enable docker-build and artifact uploads on all branches for validation
* Add Docker image build for compute workers (#837)Stefan Boberg2026-03-161-0/+56
| | | Adds a Dockerfile (Ubuntu 24.04 + WineHQ) and an `xmake docker` task to build and optionally push a zenserver-compute Docker image, enabling Linux deployment of compute workers that run Windows executables via Wine.
* oidctoken tool package (#810)Stefan Boberg2026-03-051-5/+5
| | | | | * added OidcToken binary to the build process. The binary is mirrored from p4 and is placed next to the output of the build process. It is also placed in the release zip archives. * also fixed issue with Linux symbol stripping which was introduced in toolchain changes yesterday
* native xmake toolchain definition for UE-clang (#805)Stefan Boberg2026-03-041-2/+2
| | | | | | | | | | | | | | | This change is meant to provide a smoother experience when working on Linux. After this change, the toolchain setup process is now simply ```bash $ scripts/ue_build_linux/get_ue_toolchain.sh ``` and then at config time the toolchain is automatically detected if you downloaded it to the default location or have the `UE_TOOLCHAIN_DIR` environment variable set ```bash xmake config --mode=debug ``` Compared to the old script-based approach this configures the toolchain more precisely, avoiding leakage into unrelated build processes such as when a package manager decides to build something like Ninja locally etc.
* added `--verbose` option to zenserver-test and `xmake test` (#798)Stefan Boberg2026-03-011-3/+3
| | | | | | * when `--verbose` is specified to zenserver-test, all child process output (typically, zenserver instances) is piped through to stdout. you can also pass `--verbose` to `xmake test` to accomplish the same thing. * this PR also consolidates all test runner `main` function logic (such as from zencore-test, zenhttp-test etc) into central implementation in zencore for consistency and ease of maintenance * also added extended utf8-tests including a fix to `Utf8ToWide()`
* test running / reporting improvements (#797)Stefan Boberg2026-02-281-4/+4
| | | | | | | | | | | | | | | | | | | **CI/CD improvements (validate.yml):** - Add test reporter (`ue-foundation/test-reporter@v2`) for all three platforms, rendering JUnit test results directly in PR check runs - Add "Trust workspace" step on Windows to fix git safe.directory ownership issue with self-hosted runners - Clean stale report files before each test run to prevent false failures from leftover XML - Broaden `paths-ignore` to skip builds for non-code changes (`*.md`, `LICENSE`, `.gitignore`, `docs/**`) **Test improvements:** - Convert `CHECK` to `REQUIRE` in several test suites (projectstore, integration, http) for fail-fast behavior - Mark some tests with `doctest::skip()` for selective execution - Skip httpclient transport tests pending investigation - Add `--noskip` option to `xmake test` task - Add `--repeat=<N>` option to `xmake test` task, to run tests repeatedly N times or until there is a failure **xmake test output improvements:** - Add totals row to test summary table - Right-justify numeric columns in summary table
* retain xmake state between runs (#656)Stefan Boberg2025-11-181-1/+1
| | | | | | this change relocates the xmake global state to a directory beside the workspace directory so it doesn't get wiped on every run thus we can avoid rebuilding every package on every run. Unlike vcpkg, xmake separates revisions of packages into their own tree it's robust enough to handle different versions of different packages on different branches. It's however not clear to me that modifying the contents of an `xmake.lua` package definition file across branches is ok. It *may* be necessary to change the directory name for the shared state in this case but it should be a rare event.
* sentry/asan configuration tweaks (#649)v5.7.10-pre0Stefan Boberg2025-11-131-3/+3
| | | | | * Automated more of the decisions around which options to set when using ASAN * Also disabled Sentry by default as it's a bit annoying to have it upload crashes during development. Sentry is still automatically enabled and integrated as part of the `xmake bundle` step however so released builds will still have it.
* switch to xmake for package management (#611)Stefan Boberg2025-11-071-56/+2
| | | | | | | | | | | | | | | | | | | | | | This change removes our dependency on vcpkg for package management, in favour of bringing some code in-tree in the `thirdparty` folder as well as using the xmake build-in package management feature. For the latter, all the package definitions are maintained in the zen repo itself, in the `repo` folder. It should now also be easier to build the project as it will no longer depend on having the right version of vcpkg installed, which has been a common problem for new people coming in to the codebase. Now you should only need xmake to build. * Bumps xmake requirement on github runners to 2.9.9 to resolve an issue where xmake on Windows invokes cmake with `v144` toolchain which does not exist * BLAKE3 is now in-tree at `thirdparty/blake3` * cpr is now in-tree at `thirdparty/cpr` * cxxopts is now in-tree at `thirdparty/cxxopts` * fmt is now in-tree at `thirdparty/fmt` * robin-map is now in-tree at `thirdparty/robin-map` * ryml is now in-tree at `thirdparty/ryml` * sol2 is now in-tree at `thirdparty/sol2` * spdlog is now in-tree at `thirdparty/spdlog` * utfcpp is now in-tree at `thirdparty/utfcpp` * xmake package repo definitions is in `repo` * implemented support for sanitizers. ASAN is supported on windows, TSAN, UBSAN, MSAN etc are supported on Linux/MacOS though I have not yet tested it extensively on MacOS * the zencore encryption implementation also now supports using mbedTLS which is used on MacOS, though for now we still use openssl on Linux * crashpad * bumps libcurl to 8.11.0 (from 8.8.0) which should address a rare build upload bug
* move cpr in-tree (#605)Stefan Boberg2025-10-241-1/+1
| | | | | | * added cpr 1.10.5 in-tree to allow updates to vcpkg without breaking the build * added asio 1.29.0 in-tree to remove one more vcpkg dependency * bumped vcpkg to 2024.06.15 to address failure to build due to use of deprecated binaries in vcpkg (404 error: `https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.1.0-1-any.pkg.tar.zst` during build)
* update readme with required vcpkg version (#496)Dan Engelbrecht2025-09-151-1/+1
| | | - Improvement: Updated README.md to state the required version vcpkg
* reinstate symbol upload for linuxDan Engelbrecht2025-06-191-5/+2
|
* symbol gen hack-fix for linux (#442)v5.6.13-pre2Dan Engelbrecht2025-06-181-2/+5
|
* Fixed release mirror on new release (#243)Joakim Lindqvist2024-11-281-5/+5
| | | | | By removing the minimal version we set (as this is exclusive meaning it would not replicate the current release). As such we cant guarantee that the replication takes the current release so we replicate a few releases. Also fixed the display name of the step when manually running the release mirroring.
* upload linux mac exe to sentry (#196)Dan Engelbrecht2024-10-161-6/+10
| | | | * upload mac/linux executables to sentry using `debug-files bundle-sources` on all platforms * update sentry-cli to latest on windows
* Running the public github release mirroring as part of creating the release ↵Joakim Lindqvist2024-09-161-0/+23
| | | | | | | (#158) * Running the public github release mirroring as part of creating the release This because workflows does not trigger events when created using the built in GITHUB_TOKEN so the release we create does not trigger the release replication workflow.
* bump vcpkg and xmake to latest (#40)Dan Engelbrecht2024-04-241-2/+2
| | | - Improvement: Bumped xmake to 2.9.1 and vcpkg version to 2024.03.25
* add a limit to the number of times we attempt to finalize (#22)Dan Engelbrecht2024-03-251-1/+1
| | | | | | - Improvement: Add limit to the number of times we attempt to finalize and exported oplog - Improvement: Switch to large thread pool when executing oplog export/import - Improvement: Clean up reporting of missing attachments in oplog export/import - Improvement: Remove double-reporting of abort reason for oplog export/import
* locking action-cond to 1.1.1Dan Engelbrecht2024-03-211-1/+1
|
* use [email protected] to avoid node20 problemsStefan Boberg2024-03-211-2/+2
|
* re-enable macos signing (#15)Dan Engelbrecht2024-03-201-2/+1
|
* remove hv tags on actions since they are no longer usefulStefan Boberg2024-03-201-4/+4
| | | | we use `zen` tags to discriminate now instead
* Enabled signing on windows agents again (#12)Joakim Lindqvist2024-03-201-2/+1
| | | * Enabled signing on windows agents again
* make sure zenserver reacts and exist on SIGTERM signal (#8)Dan Engelbrecht2024-03-151-5/+6
| | | | | * make sure zenserver reacts and exist on SIGTERM signal * add zen tag to all runners * temp disable mac codesigning
* remove vcpkg integrate install from windows setupStefan Boberg2024-03-151-1/+0
|
* updated runs-on for release workflowDan Engelbrecht2024-03-141-4/+5
|
* updates to signingStefan Boberg2024-03-131-1/+2
| | | | | macOS signs executables again Windows releases do not (neither does validate)
* workflow tweaksStefan Boberg2024-03-121-4/+4
|
* workflow fixes (#1)Stefan Boberg2024-03-121-9/+8
| | | | | * update validate action for enterprise github * updated runner setup options * updated release workflow for enterprise github
* disable official signing of windows executables (#667)Dan Engelbrecht2024-03-051-1/+2
|
* add signing identity when creating release (windows)Dan Engelbrecht2023-12-151-1/+1
|
* embed html frontend content as binary compiled data (#559)Dan Engelbrecht2023-11-231-1/+1
| | | | | | - Feature: Added xmake task `updatefrontend` which updates the zip file containing the frontend html (`/src/zenserver/frontend/html.zip`) - Improvement: The frontend html content is no longer appended at the end of the executable which prevented signing, instead it is compiled in from the `/src/zenserver/frontend/html.zip` archive - Improvement: MacOS now does ad-hoc code signing by default when issuing `xmake bundle`, signing with proper cert is done on CI builds
* bump xmake CI version to 2.8.2 (#514)Dan Engelbrecht2023-11-071-9/+6
| | | | * bump xmake CI version to 2.8.2 * show test times in log
* revive UE toolchain build (#343)Dan Engelbrecht2023-08-221-16/+9
| | | | | | | | | * add comment about 7z usage in xmake bundle * add ue-libcxx lib/headers and licence + tps * update get_ue_toolchain.sh to use embedded libc++ and decouple from p4 * clearer output when falling back to zip from 7z * update ci scripts to use ue toolchain on linux * updated linux build README.md * changelog
* update vcpkg dependencies (#356)Dan Engelbrecht2023-08-111-6/+6
| | | | | | * bump vcpkg version * fmt lib 10 fixes * xmake dependencies (with linux workarounds) * changelog
* add exe to release sentry-cli upload-dif stepStefan Boberg2023-05-311-3/+3
|
* bumped xmake and vcpkg versionsStefan Boberg2023-05-261-6/+6
| | | | | xmake is now 2.7.9 (was 2.6.4) vcpkg is now 2023.04.15 (was 2022.08.15)
* bump timeout for create-release to 25 min (linux/mac)Dan Engelbrecht2023-05-261-2/+2
|
* bump timeout for create-release to 25 minDan Engelbrecht2023-05-261-1/+1
|
* steps.read_version.outputs.contents -> steps.read_version.outputs.contentDan Engelbrecht2023-04-211-5/+5
|
* try fixing version/changelog readingDan Engelbrecht2023-04-211-2/+2
|
* switch to juliangruber/read-file-action to avoid deprecated api usage (#252)Dan Engelbrecht2023-04-211-2/+2
| | | * switch andstor/file-reader-action for juliangruber/read-file-action in create_release.yml
* actions/[email protected] -> actions/checkout@v3Dan Engelbrecht2022-11-141-4/+4
|
* update github actions versions to avoid node js warningsDan Engelbrecht2022-11-141-4/+4
|
* create release in Sentry and set version string in executable (#162)Dan Engelbrecht2022-09-121-6/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | * create release in Sentry and set version string in executable * changelog * 0.1.6-pre0 * sentr-cli install dir * 0.1.6-pre1 * include org and project when creating Sentry release * 0.1.6-pre2 * move org and project options * 0.1.6-pre3 * need to first to "new", then finalize * 0.1.6-pre4 * read version before creating release * 0.1.6-pre5
* Use "\\?\" prefixed paths and fix hardcoded path delimiters (#149)Dan Engelbrecht2022-08-261-18/+18
| | | | | | * use "\\?\" prefix for windows paths * fix path delimiters * disable vcpkg caching * Workaround for spdlog not being able to create directories prefixed with `\\?\`
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-04 15:06:41 +0000