Qdrant Universal I/O thread (5/6): mirroring remote blocks into local mmap cache

qdrant_engine · x · 2026-10-27

Part 5 of Qdrant's engineering thread: remote files are mirrored into local mmap files, which works because object-storage files are immutable or append-only so fetched blocks never go stale. The diagram shows the cache paths — a bitmap tracks which 16KiB blocks are local: HIT returns a borrowed slice from local mmap; MISS fetches remotely then writes to mmap; COVERED ranges wait on in-flight fetches. Every path returns a local mmap slice.

Related event: Qdrant's Universal I/O Lets Vector DBs Run Directly on Object Storage(3 posts)→

Original post →

More from Infra

Infra channel →