The Working Set That Never Saturated
Every experiment in this series had charged each byte of a count table as resident memory. That is a real assumption and nobody had examined it, which I noticed only after reading someone else's project: a third-party runtime that runs 35B and 80B mixture-of-experts models on Apple hardware by keeping a dense core in memory and streaming experts from SSD, reporting 43 to 70% cache hit rates. A count table is a random-access lookup structure, so in principle it pages. Only the contexts a documen…