Dayjob: Tax – evaluating AI agents on 50 professional tax assignments

This is about wild west accounting, though, when the user has no idea what they're doing. When launching my financial business, I spent half a year learning accounting to be sure to understand everything, then I implemented my accounting software, specialized for my activity. And as luck had it, I made it be a CLI.…

As a proof-of-concept, I've been using extra tokens to formalize the IRS tax forms and worksheets, mostly just to prove this can be done. The idea is that something like this could be adapted into a publicly maintained version of the IRS Direct File program (RIP). I'm up to an estimated 60% coverage of US federal tax…

Same story here as many others: I now do my personal and business taxes myself using an application I had claude cook up for me, doing it 100% correct, for South Africa's tax system. Previously I paid thousands to a small accounting firm to do it for me as it can be slightly nerve wrecking, but I had claude explain…