Mode collapse
Search documents
X @Avi Chawla
Avi Chawlaยท 2025-11-27 06:59
Stanford researchers built a new prompting technique!By adding ~20 words to a prompt, it:- boosts LLM's creativity by 1.6-2x- raises human-rated diversity by 25.7%- beats fine-tuned model without any retraining- restores 66.8% of LLM's lost creativity after alignmentPost-training alignment methods, such as RLHF, are designed to make LLMs helpful and safe.However, these methods unintentionally cause a significant drop in output diversity (called mode collapse).When an LLM collapses to a mode, it starts favor ...