Researchers have discovered that fine-tuning large language models can inadvertently reactivate the verbatim recall of copyrighted books, undermining previous alignment efforts. Dubbed alignment whack-a-mole, this vulnerability demonstrates that attempting to restrict a model from generating protected content can be easily bypassed through subsequent training adjustments. The researchers have released their official code to help the broader tech community better understand and mitigate this complex issue.