arXiv AI recent: Can Editing 1 Neuron Fix Repetition Loops in LLMs?
Researchers explored whether editing a small set of neurons in large language models (LLMs) can fix repetition loops that occur when generating long factual enumerations. They found that...
The researchers used per-layer ablation and per-neuron attribution to localize the cause of the loops and confirmed the strongest candidates with full-generation sweeps. They also studied longer thinking budgets, where the two larger models most visibly enter doom looping, and found that the same...