Keyword search ties a purpose-built memory layer on 200 LongMemEval questions
I build one of the systems in this test, so discount accordingly. Posting the numbers because they surprised me and because the boring result is the interesting one. Setup: 200 questions from LongMemEval, three ways of giving a model memory over the same material. A collaborator ran all three arms with the same reader (Qwen 3.8 27B, Q4) and the same grading rubric. A structured memory layer (MemStrata, my product): facts stored with provenance and validity, retrieved as structured evidence. SQL…