aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* 0.2.25v0.2.25Dan Engelbrecht2023-09-291-1/+1
|
* 0.2.25-pre0v0.2.25-pre0Dan Engelbrecht2023-09-291-1/+1
|
* added handle to http.sys error response logging (#432)Stefan Boberg2023-09-291-2/+3
| | | * added handle to http.sys error response logging
* move badrequest count back to old scope for compatability with Zen DashboardDan Engelbrecht2023-09-281-2/+1
|
* adding more stats (#429)Dan Engelbrecht2023-09-2817-72/+554
| | | | | - Feature: Add detailed stats on requests and data sizes on a per-bucket level, use parameter `cachestorestats=true` on the `/stats/z$` endpoint to enable - Feature: Add detailed stats on requests and data sizes on cidstore, use parameter `cidstorestats=true` on the `/stats/z$` endpoint to enable - Feature: Dashboard now accepts parameters in the URL which is passed on to the `/stats/z$` endpoint
* added more context to http response error message (#430)Stefan Boberg2023-09-282-10/+78
| | | when a http.sys request response API call fails, we now include more information including metadata about the contents of the reponse (i.e memory/file references including file names/size and chunk offsets/size) to help track down some odd error conditions seen in production
* prefer to handle cache RPC requests synchronously (#428)Stefan Boberg2023-09-274-8/+46
| | | | | * only handle RPC requests in a worker thread if we have an upstream. we may as well handle the request inline on the http_io thread if we're only dealing with local data since the response times should be pretty consistent in that case * http.sys: don't create async worker thread pool until it's needed (typically only if we have an upstream)
* chache upstream stats improved (#426)Dan Engelbrecht2023-09-272-10/+18
| | | | * cache upstream stats improved * fix exit for monitor thread
* flush block store blocks when finished (#425)Dan Engelbrecht2023-09-272-0/+4
| | | * flush block store block
* Merge branch 'main' of https://github.com/EpicGames/zenStefan Boberg2023-09-2646-209/+741
|\
| * 0.2.24v0.2.24Dan Engelbrecht2023-09-251-1/+1
| |
| * 0.2.24-pre1v0.2.24-pre1Dan Engelbrecht2023-09-251-1/+1
| |
| * handle error in error log (#422)Dan Engelbrecht2023-09-252-15/+47
| | | | | | * do not allow exceptions to leak from Sentry error reporting or SentryAssertImpl::OnAssert
| * corrected changelogDan Engelbrecht2023-09-251-2/+2
| |
| * 0.2.24-pre0v0.2.24-pre0Dan Engelbrecht2023-09-221-1/+1
| |
| * Add runtime status/control of logging (#419)Dan Engelbrecht2023-09-2212-29/+286
| | | | | | | | | | | | | | | | | | | | | | - Feature: New endpoint `/admin/logs` to query status of logging and log file locations and cache logging - `enablewritelog`=`true`/`false` parameter to control cache write logging - `enableaccesslog`=`true`/`false` parameter to control cache access logging - `loglevel` = `trace`/`debug`/`info`/`warning`/`error` - Feature: New zen command `logs` to query/control zen logging - No arguments gives status of logging and paths to log files - `--cache-write-log` `enable`/`disable` to control cache write logging - `--cache-access-log` `enable`/`disable` to control cache access logging - `--loglevel` `trace`/`debug`/`info`/`warning`/`error` to set debug level
| * added support for sln on Mac (#421)Stefan Boberg2023-09-222-4/+13
| | | | | | this makes it so users can use xmake sln on Mac as well as Windows to generate IDE files
| * added linker/compile options for determinism (#420)Stefan Boberg2023-09-221-2/+6
| |
| * added name to http.sys request queue (#417)Stefan Boberg2023-09-221-1/+33
| | | | | | | | | | | | * added name to http.sys request queue * changed so that rejected requests are answered with a 403 response instead of just dropping the connection
| * Collect all zen admin-related commands into admin.h/.cpp (#418)Dan Engelbrecht2023-09-2233-140/+117
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * move commands in scrub.h/cpp to admin_cmd.h/cpp * move job command into admin_cmd.h/.cpp * admin -> admin_cmd * bench -> bench_cmd * cache -> cache_cmd * copy -> copy_cmd * dedup -> dedup_cmd * hash -> hash_cmd * print -> print_cmd * projectstore -> projectstore_cmd * rpcreplay -> rpcreplay_cmd * serve -> serve_cmd * status -> status_cmd * top -> top_cmd * trace -> trace_cmd * up -> up_cmd * version -> version_cmd
| * add trace command to enable/disable tracing at runtime (#416)Dan Engelbrecht2023-09-228-38/+259
| | | | | | | | | | * add trace command to enable/disable tracing at runtime * rework tracing init/start/stop * changelog
* | sort commands for cleaner mergesStefan Boberg2023-09-261-2/+2
|/
* Improvement: Add names to background jobs for easier debugging (#412)Dan Engelbrecht2023-09-207-113/+179
| | | | Improvement: Background jobs now temporarily sets thread name to background job name while executing Improvement: Background jobs tracks worker thread id used while executing
* controlled zenserver shutdown (#413)Dan Engelbrecht2023-09-202-21/+37
| | | * Do controlled shutdown of zenserver catching any exception thrown during shutdown
* added info verb to vfs command help textStefan Boberg2023-09-201-1/+1
|
* VFS implementation for local storage service (#396)Stefan Boberg2023-09-2033-27/+2559
| | | currently, only Windows (using Projected File System) is supported
* changelog version bumpDan Engelbrecht2023-09-201-0/+2
|
* 0.2.23v0.2.23Dan Engelbrecht2023-09-191-1/+1
|
* 0.2.23-pre0v0.2.23-pre0Dan Engelbrecht2023-09-191-1/+1
|
* increase jupiter oplog import/export connection timeout to 30 min (#411)Dan Engelbrecht2023-09-192-1/+2
| | | | * increase jupiter oplog import/export connection timeout to 30 min * changelog
* Add retry if FinalizeRef responds with non-empty "Needs" attachments (#409)Dan Engelbrecht2023-09-196-261/+379
| | | | | * Add retry if FinalizeRef responds with non-empty "Needs" attachments * better logging/progress report * changelog
* handle errors in spdlog gracefully (#410)Dan Engelbrecht2023-09-192-0/+31
| | | | * handle errors in spdlog gracefully - try to report and avoid termination * changelog
* add DiskWriteBlocker to structured cache store log writer (#408)Dan Engelbrecht2023-09-154-32/+48
| | | | | * add DiskWriteBlocker to structured cache store log writer * changelog
* v0.2.22v0.2.22Dan Engelbrecht2023-09-151-1/+1
|
* 0.2.22-pre0v0.2.22-pre0Dan Engelbrecht2023-09-151-1/+1
|
* add more trace scopes (#362)Dan Engelbrecht2023-09-1515-282/+439
| | | | | * more trace scopes * Make sure ReplayLogEntries uses the correct size for oplog buffer * changelog
* updated CHANGELOG.md release versionsStefan Boberg2023-09-151-2/+4
|
* bugfix: http.sys async response handling race (#406)Stefan Boberg2023-09-152-1/+15
| | | | under heavy load, an async response could end up deleting the HTTP transaction object before the issuing call had completed
* 0.2.21v0.2.21Dan Engelbrecht2023-09-141-1/+1
|
* 0.2.21-pre1v0.2.21-pre1Dan Engelbrecht2023-09-141-1/+1
|
* More statistics for Cache, Project Store and Cid Store (#405)Dan Engelbrecht2023-09-147-15/+109
| | | | | Cache: requestcount, badrequestcount, writes Project Store: requestcount Cid Store: cidhits, cidmisses, cidwrites
* enable sentry personal information (ip/username) on shared instances (#404)Dan Engelbrecht2023-09-141-0/+3
|
* v0.2.21-pre0v0.2.21-pre0Dan Engelbrecht2023-09-141-1/+1
|
* changelogDan Engelbrecht2023-09-141-2/+2
|
* http and httpsys config options (#401)Dan Engelbrecht2023-09-1410-31/+91
| | | | * Added `--http-threads`, `--httpsys-async-work-threads`, `--httpsys-enable-request-logging` and `--httpsys-enable-async-response` command line options to zenserver * remove unused CreateHttpSysServer
* disable access logging on shared instances (#403)Dan Engelbrecht2023-09-141-0/+1
|
* job queue and async oplog-import/export (#395)Dan Engelbrecht2023-09-1323-153/+1382
| | | | | | | | | | | | | | | | - Feature: New http endpoint for background jobs `/admin/jobs/status` which will return a response listing the currently active background jobs and their status - Feature: New http endpoint for background jobs information `/admin/jobs/status/{jobid}` which will return a response detailing status, pending messages and progress status - GET will return a response detailing status, pending messages and progress status - DELETE will mark the job for cancelling and return without waiting for completion - If status returned is "Complete" or "Aborted" the jobid will be removed from the server and can not be queried again - Feature: New zen command `jobs` to list, get info about and cancel background jobs - If no options are given it will display a list of active background jobs - `--jobid` accepts an id (returned from for example `oplog-export` with `--async`) and will return a response detailing status, pending messages and progress status for that job - `--cancel` can be added when `--jobid` is given which will request zenserver to cancel the background job - Feature: oplog import and export http rpc requests are now async operations that will run in the background - Feature: `oplog-export` and `oplog-import` now reports progress to the console as work progress by default - Feature: `oplog-export` and `oplog-import` can now be cancelled using Ctrl+C - Feature: `oplog-export` and `oplog-import` has a new option `--async` which will only trigger the work and report a background job id back
* scan oplog object for fields (#397)Dan Engelbrecht2023-09-132-89/+131
| | | | * scan oplog object for fields * Read all oplog entries but only read op data and get mapping for latest op of each key
* issue warning instead of assert on bad data in cid store (#400)Dan Engelbrecht2023-09-132-10/+15
| | | * issue warning instead of assert on bad data in cid store
* fix url parsing crash (#399)Dan Engelbrecht2023-09-132-1/+2
| | | * Don't index out of string_view range when parsing URI in httpsys