Saltar al contenido
← volver

DNeo: Your Parallel Draft Model Needs Better Target Feature Encoding

arXiv cs.AI · arxiv.org Publicado:

arXiv:2611.21925v1 Announce Type: new Abstract: Speculative-diffusion decoding uses a small parallel drafter model to generate b draft tokens in one forward pass, which then undergo parallel verification via a larger target model. Faster inference can be achieved when multiple draft tokens pass verification simultaneously. Recent parallel draft architectures (DFlash, DSpark) improve draft quality by conditioning on rich features computed by the target, through a mechanism known as feature encod…

Leer original →

Más de arXiv cs.AI