Decoding by Contrasting Retrieval Heads
Ana-Paula Gema,
Chen Jin,
Abdullah Abdulaal,
Tom Diethe,
Philip Teare,
Benjamin Alex,
Pasquale Minervini,
Amrutha Saseendran
October 2024
Abstract
Training-free decoding that mitigates LLM hallucinations by contrasting a base model with a masked-retrieval variant, boosting summarisation by up to 18.6%.