| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| ... | |
| | |
| |
| |
| |
| | |
* added LLM tag to properly tag RPC allocations
* annotated some more httpsys functions with memory tags
* only emit memory scope events if the active tag is different from the new tag
|
| | |
| |
| | |
* reduce length of oplog import/export job name
|
| | |
| |
| |
| |
| | |
* improved payload validation in HttpClient
* separate error messages for FromCompressed and Decompress
* refactor so we can do retry if decompression of block fails
|
| | |
| |
| |
| | |
* fix so we can replace an openid provider that was read from disk file
* fix OidcClient lifetime issues in authmg
|
| | | |
|
| | |
| |
| |
| | |
* move openprocess cache to central location
* enable openprocesscache in projectstore so "getchunks" can send filehandles when requested
|
| | |
| |
| | |
Feature: Project store "getchunks" rpc call /prj/{project}/oplog/{log}/rpc extended to accept both CAS (RawHash) and Id (Oid) identifiers as well as partial ranges
|
| | |
| |
| | |
some fixes to make everything build using unity build mode. Mostly moved code from anonymous namespaces into local impl namespace to avoid ambiguity in name resolution.
|
| | |
| |
| |
| |
| | |
* changed so release build uses lto and optimizes for speed on Mac and Windows
* Linux does not currently support LTO due to toolchain limitations
|
| | | |
|
| | |
| |
| | |
should fix build issues caused by curl pulling in a different version
|
| | | |
|
| | | |
|
| | | |
|
| | |
| |
| |
| |
| | |
* eliminated allocation in SetCurrentThreadName
* reduced memory allocator activity in cache RPC response building
* reduced allocations in compact binary building
|
| | | |
|
| | | |
|
| | |
| |
| |
| | |
* don't allow compact in time critical oplog calls
* bump small chunk size limit when doing iteratechunks
|
| | |
| |
| |
| |
| | |
* added FLLMTag which can be used to register memory tags outside of core
* changed `UE_MEMSCOPE` -> `ZEN_MEMSCOPE` for consistency
* instrumented some subsystems with dynamic tags
|
| | | |
|
| | |
| |
| |
| |
| |
| | |
* Make sure we don't throw exception from worker thread
* secure async project flush
* secure workspaces
* spelling
|
| | |
| |
| | |
* when reading paths for oplog index, make sure we don't point our string view to potentially stale memory
|
| | |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
* Input boxes' text was unreadable when using the dark theme
* Change from margins to padding top/bottom - easier to reason about vertical styling.
* A treemap. Not used anywhere and not finished. Submitting so it isn't lost
* Prevent tables' first content columns from collapsing
* Dashboardk .zip archive update
|
| | | |
|
| | |
| |
| |
| |
| | |
By removing the minimal version we set (as this is exclusive meaning it would not replicate the current release). As such we cant guarantee that the replication takes the current release so we replicate a few releases.
Also fixed the display name of the step when manually running the release mirroring.
|
| | | |
|
| | | |
|
| | |
| |
| | |
if response payload does not validate properly do a retry if applicable
|
| | | |
|
| | |
| |
| |
| |
| | |
* use plain sorted array instead of map of vectors
* reserve vectors up front = 5% perf increase
* don't do batch read of chunks if we have a single chunk -> 1% perf gain
|
| | | |
|
| | |
| |
| |
| | |
* add missing shardlock during compact in filecas
* add warning log when filecas fails to open a file it expects to be present
|
| | | |
|
| | | |
|
| | | |
|
| | | |
|
| | |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
* Wrong divisor for friendly giga-values
* We want Explorer style for kilo/kibi units; round up
* var -> const - zero idea if this matters
* Include sum of an entry's package data sizes in index
* Method to enurate all properties of a loaded oplog index
* Include bulkdata size in an oplog index
* Found a space that was missing
* Show package data sizes when viewing an oplog entry
* Navigating a component tree would error out at the end of the chain
* Parameterise friendly rounding
* Added size and rawsize columns to oplog tree view
* Sort of parameterised indexer's worker count and page size
* Right-align size columns on entry view page
* Updated frontend .zip archive
* A changelog update
|
| | | |
|
| | |
| |
| |
| | |
* snapshot test
* use proper IoBuffer constructor to take handle ownership
|
| | | |
|
| | |
| |
| |
| | |
* store inlined chunk as temp files and store to Cid after oplog iteration is complete and ops updated
* make sure we can get to the payload when doing `prep` for new ops
|
| | |
| |
| | |
* don't provide size if compressed buffer validation fails
|
| | |
| |
| |
| |
| |
| | |
* Allow caller to control threshold for bulk-loading chunks in IterateChunks
* use smaller batch chunk reading for /fileinfos and /chunkinfos as we do not intend to read the payload
* use smaller batch read buffer when just querying for size of attachments
|
| | |
| |
| |
| |
| |
| | |
- Don't add RawSize and Size in ProjectStore::GetProjectFiles response if we can't get the payload
- Use validation of payload size/existance in all chunk fetch operations in file cas
- In project store oplog validate, make sure we can reach all the payloads
- Add threading to oplog validate request
|
| | | |
|
| | |
| |
| |
| |
| |
| |
| | |
minor clean-up
`zencore/memory.h` used to contain a variety of things including `Malloc` support along with `MemoryView` etc
since the memory allocator stuff moved into `zencore/memory/memory.h` there was basically only `MemoryView` and `MemCmp` in there which seemed better to split out into separate headers to avoid overloading `memory.h`
|
| | |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
This change introduces support for tracing of memory allocation activity. The code is ported from UE5, and Unreal Insights can be used to analyze the output. This is currently only fully supported on Windows, but will be extended to Mac/Linux in the near future.
To activate full memory tracking, pass `--trace=memory` on the commandline alongside `--tracehost=<ip>` or `-tracefile=<path>`. For more control over how much detail is traced you can instead pass some combination of `callstack`, `memtag`, `memalloc` instead. In practice, `--trace=memory` is an alias for `--trace=callstack,memtag,memalloc`). For convenience we also support `--trace=memory_light` which omits call stacks.
This change also introduces multiple memory allocators, which may be selected via command-line option `--malloc=<allocator>`:
* `mimalloc` - mimalloc (default, same as before)
* `rpmalloc` - rpmalloc is another high performance allocator for multithreaded applications which may be a better option than mimalloc (to be evaluated). Due to toolchain limitations this is currently only supported on Windows.
* `stomp` - an allocator intended to be used during development/debugging to help track down memory issues such as use-after-free or out-of-bounds access. Currently only supported on Windows.
* `ansi` - fallback to default system allocator
|
| | | |
|
| | | |
|
| | |
| |
| |
| |
| |
| |
| |
| | |
GC (#224)
make sure we rewrite filecas entries if chunk size changes (due to compression changes)
hardening of move/write files in filecas
if we encounter a filecas entry with mismatching size (due to pre-existing bug) we validate the file and update the index
if we find a bad filecas file on disk we now attempt to remove it
|