Why Fine-Tuning Encourages Hallucinations and How to Fix It.

arXiv:2604.15574v3 Announce Type: replace-cross Abstract: Large language models are prone to hallucinating factually incorrect statements. A key source of these errors is exposure to new factual information through supervised fine-tuning (SFT), which can incre