I'm making LLMs work on small and old devices
2 comments
- Points435
- Comments167
2 comments
Story details from Hacker News ↗ · linked article on github.com.
I'm making LLMs work on small and old devices was first seen on Hacker News · Front page on Nov 12, 2026. Since then it has appeared in 105 checks on 2 different days. Its best position was #3 of 30, reached on Nov 12, 18:13 UTC. It dropped off the list after Nov 13, 18:13 UTC.
Position on Hacker News · Front page at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by Hacker News.
A few top-level comments from Hacker News, shortened. Read the full thread on Hacker News.
For the last five months or so, opus and fable have both been able to do this task as a soneshot prompt. An inference engine is almost pure compute and to a first approximation the only operation your hardware needs to support to do llm inference is multiplication [the rest of an inference engine is "some trig"]. So…
Recently I started this open source project at my AI company, where I'm trying to make LLMs working Now Reached 16B models running on iPad Air 1st gen and xiaomi tv box, both have less than 1GB of usable memory, and reached some decent speeds given the hardware. I'm open sourcing the effort done, kernels developed…
This is very cool. Love the trend of optimizing small models I’ve been working on small local models and it’s amazing how fast the tech has progressed A year ago, I was creating conversational characters by finetuning a qwen 2.5 0.5b param model, and it worked pretty well. But no reasoning or math capabilities, and…
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 13, 18:13 UTC, after 2 days of trending.
#3 on Hacker News · Front page, on Nov 12, 18:13 UTC. Trendoday checks this list every 15 minutes.
It was first seen on Nov 12, 2026 and has been on the list on 2 days (105 checks) since.
435 points and 167 comments; submitted by mrashad74 on Nov 12, 2026.