The 'Astra can read and write weights to improve Qwen' post is misleading

I work in this field (mech interp research) and I agree, the original post is definitely misleading. Some overselling in research is normal but it's a bit much. First, the key result has nothing to do with making Qwen better at math, it just reduces reasoning loops. Reasoning loops are a simple problem: the model…

Speaking for myself. I’ve been aware of a lot of concepts around training, but stayed away from it until very recently. A few weeks ago, I formed a hypothesis that I could get a smaller model good at the specific standards I have for my git commit messages, which are hard to get out of most LLMs today. I spent the…

Wasn’t all that obvious to anyone who read the original post when they got to the section that explicitly explained what the author of this post is now summarizing? Sure if you only read the title and brief at the top you’d walk away without the full picture though. This is a better response imo:…