Why does SFT struggle…

MCQ·Medium·Asked atAnthropic OpenAI Shopify·Relevant atGoogle

In long pretraining, what pattern most strongly suggests excessive weight decay?