aboutsummaryrefslogtreecommitdiff
path: root/src/zenutil/workerpools.cpp
Commit message (Collapse)AuthorAgeFilesLines
* add ability to limit concurrency (#565)Stefan Boberg2025-10-101-47/+68
| | | | | | | | | | | | effective concurrency in zenserver can be limited via the `--corelimit=<N>` option on the command line. Any value passed in here will be used instead of the return value from `std::thread::hardware_concurrency()` if it is lower. * added --corelimit option to zenserver * made sure thread pools are configured lazily and not during global init * added log output indicating effective and HW concurrency * added change log entry * removed debug logging from ZenEntryPoint::Run() also removed main thread naming on Linux since it makes the output from `top` and similar tools confusing (it shows `main` instead of `zenserver`)
* shorten thread pool names for Linux which has a limit of 15 characters (#563)Stefan Boberg2025-10-081-9/+9
| | | without this change we just get a whole bunch of threads named "main" or "zenserver" depending on timing
* build cache prime (#327)Dan Engelbrecht2025-03-271-1/+13
| | | | - Feature: zen `--boost-workers` option to builds `upload`, `download` and `validate-part` that will increase the number of worker threads, may cause computer to be less responsive - Feature: zen `--cache-prime-only` that uploads referenced data from a part to `--zen-cache-host` if it is not already present. Target folder will be untouched.
* separate worker pools into burst/background to avoid background jobs ↵Dan Engelbrecht2024-08-221-70/+48
| | | | blocking client requests (#134)
* Use a smaller thread pool for network operations when doing oplog import to ↵Dan Engelbrecht2024-05-301-1/+1
| | | | | reduce risk NIC/router failure (#89) Medium worker pool now uses a minimum of 2 threads (up from 1)
* Use multithreading to fetch size/rawsize of entries in ↵Dan Engelbrecht2024-03-281-2/+25
| | | | | | `/prj/{project}/oplog/{log}/chunkinfos` and `/prj/{project}/oplog/{log}/files` (#30) - Improvement: Use multithreading to fetch size/rawsize of entries in `/prj/{project}/oplog/{log}/chunkinfos` and `/prj/{project}/oplog/{log}/files` - Improvement: Add `GetMediumWorkerPool()` in addition to `LargeWorkerPool()` and `SmallWorkerPool()`
* safe threadpool shutdown (#584)Dan Engelbrecht2023-12-041-0/+6
| | | * shut down thread pools earlier to worker threads has a chance to terminate before main thread atexit
* global thread worker pools (#577)Dan Engelbrecht2023-11-291-0/+89
- Improvement: Use two global worker thread pools instead of ad-hoc creation of worker pools