There is no posttraining data commons

its a good post, but a bit naive. There is no universe in which any frontier ai lab does not have a unfathomly gigantic posttraining data commons set consisting of synthetic trajectory rollouts, internal human-annotated preference pairs, specialized coding corpora environments, and domain-specific RL reward sets.

Distributed post training over the internet is much easier than distributed pretraining. What we need is just agent traces, from everyone's daily use. Hugging Face already supports uploading agent traces, see https://huggingface.co/docs/hub/en/agent-traces We've been developing DataClaw to help everyone collect agent…

A very academic way of saying We have all the data in the world, except the data we actually need. You ask a company how something works and they say: "Oh, theres a process." Great. Where is it documented? "in a spreadsheet." Which spreadsheet? "Well, theres the old spreadsheet, new spreadsheet, and the spreadsheet…