optimizations (#200)

* Use direct file read and direct buffer allocation for small IoBuffer materalization
* Reduce range of materialized data in CompositeBuffer reading
CompressedBuffer header reading often only need a small part and not the whole file
* reduce lock contention in IoBuffer::Materialize
* Reduce parsing of compressed headers
Validate header type at decompression
* faster CreateDirectories - start from leaf going up and recurse back
* optimized BufferHeader::IsValid
* Add ValidateCompressedHeader to use when we don't need the actual compressed data
Validate that we always get compressed data in CidStore::AddChunk
* changelog

1 files changed, 5 insertions, 1 deletions

diff --git a/zenserver/testing/launch.cpp b/zenserver/testing/launch.cpp
index 0e46fff94..b26f9e437 100644
--- a/zenserver/testing/launch.cpp
+++ b/zenserver/testing/launch.cpp
@@ -477,7 +477,11 @@ HttpLaunchService::HttpLaunchService(CidStore& Store, const std::filesystem::pat
 							{
 								std::filesystem::path FullPath = SandboxDir / FileName;
 
-								CompressedBuffer			  Compressed	  = CompressedBuffer::FromCompressed(SharedBuffer(Chunk));
+								IoHash			 RawHash;
+								uint64_t		 RawSize;
+								CompressedBuffer Compressed = CompressedBuffer::FromCompressed(SharedBuffer(Chunk), RawHash, RawSize);
+								ZEN_ASSERT(Compressed);
+								ZEN_ASSERT(FileHash == RawHash);
 								CompositeBuffer				  CompositeBuffer = Compressed.DecompressToComposite();
 								std::span<const SharedBuffer> Segments		  = CompositeBuffer.GetSegments();
 								std::vector<IoBuffer>		  Chunks(Segments.size());