Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium
discuss
- Points54
- Comments7
discuss
Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions :) What it does today: - Serves 2 instances of GLM-5.3 flash on a single box, 8 trn2 with a cache aware router. - Can process 3.57M TPM (tokens per minute) on SemiAnalysis's AgentX…
Story details from Hacker News ↗ · linked article on github.com.
Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium was first seen on Hacker News · Front page on Nov 17, 2026. Since then it has appeared in 126 checks on 4 different days, across 3 lists (Hacker News · Front page, Hacker News · Show HN, Hacker News · Show HN · this week). Its best position was #8 of 30, reached on Nov 17, 17:43 UTC. It dropped off the list after Nov 20, 02:51 UTC. The same link also trended on GitHub, which raises its cross-platform score.
Position on Hacker News · Front page at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by Hacker News.
| List | Best | Days | Checks | Last seen |
|---|---|---|---|---|
| Hacker News · Front page | #8 | 2 | 29 | |
| Hacker News · Show HN | #2 | 2 | 45 | |
| Hacker News · Show HN · this week | #22 | 4 | 52 | |
| GHGitHub · Rising today runanywhereai/trnrt | same link | |||
A few top-level comments from Hacker News, shortened. Read the full thread on Hacker News.
Good on these folks for doing something useful with Trainium. I'm always surprised that the Tranium ecosystem is as poor as it is. Amazon's market cap is nearly $3T and they can't throw a couple L6s and a modest token budget at this? Making Trainium work as seamlessly as possible as an Nvidia substitute is a clear…
Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.
curious how the token/$ on trainuim compare to nvidia chips and amd. is the future "chipless" inference?
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 20, 02:51 UTC, after 4 days of trending.
#8 on Hacker News · Front page, on Nov 17, 17:43 UTC. Trendoday checks this list every 15 minutes.
It was first seen on Nov 17, 2026 and has been on the list on 4 days (126 checks) since.
54 points and 7 comments; submitted by sanchitmonga22 on Nov 17, 2026.