Decoding by Contrasting Retrieval Heads

Abstract

Training-free decoding that mitigates LLM hallucinations by contrasting a base model with a masked-retrieval variant, boosting summarisation by up to 18.6%.

Publication
EMNLP, 2025

Related