SparseEngine Puts Fifteen Sparse Attention Methods Behind One Lifecycle Contract
TL;DR SparseEngine is an inference engine for large language models that keeps only part of the attention state in GPU memory, published on arXiv as 2609.39068v1 by a team including Harbin Institute of Technology authors and released as Apache-2.0 code in the repository CURRENTF/SparseEngine. A sparse attention method is the technique that decides which part of the KV cache survives, which lowers the memory and attention cost of long-context decoding at the price of an approximation. Existing i…