The Surprising Effectiveness of Deleting Weights in LLM Post-Training
How little of a pretrained large language model (LLM) has to change for it to acquire new capabilities? We find that zeroing fewer than 0.05% of its weights, with no other modification, matches full f
- Upvotes7