Trendoday

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

discuss

  • Points54
  • Comments7
–Rank now
#8Peak rank
4Days on list
63Score · 7d
Nov 17, 2026First seen
Rank · 7 days

On Hacker News

Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions :) What it does today: - Serves 2 instances of GLM-5.3 flash on a single box, 8 trn2 with a cache aware router. - Can process 3.57M TPM (tokens per minute) on SemiAnalysis's AgentX…

Points
54
Comments
7
Submitted by
sanchitmonga22
Posted
Nov 17, 2026
Site
github.com

Story details from Hacker News ↗ · linked article on github.com.

Trending history

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium was first seen on Hacker News · Front page on Nov 17, 2026. Since then it has appeared in 126 checks on 4 different days, across 3 lists (Hacker News · Front page, Hacker News · Show HN, Hacker News · Show HN · this week). Its best position was #8 of 30, reached on Nov 17, 17:43 UTC. It dropped off the list after Nov 20, 02:51 UTC. The same link also trended on GitHub, which raises its cross-platform score.

Rank history

Position on Hacker News · Front page at every check (lower is better).

#1#11#20#30 17:2819:1320:5822:4300:28 Nov 17, 17:28 UTC · #9Nov 17, 17:43 UTC · #8Nov 17, 17:58 UTC · #9Nov 17, 18:13 UTC · #10Nov 17, 18:28 UTC · #14Nov 17, 18:43 UTC · #13Nov 17, 18:58 UTC · #17Nov 17, 19:13 UTC · #17Nov 17, 19:28 UTC · #24Nov 17, 19:43 UTC · #25Nov 17, 19:58 UTC · #27Nov 17, 20:13 UTC · #27Nov 17, 20:28 UTC · #27Nov 17, 20:43 UTC · #29Nov 17, 20:58 UTC · #27Nov 17, 21:13 UTC · #21Nov 17, 21:28 UTC · #19Nov 17, 21:43 UTC · #20Nov 17, 21:58 UTC · #21Nov 17, 22:13 UTC · #22Nov 17, 22:28 UTC · #24Nov 17, 22:43 UTC · #26Nov 17, 22:58 UTC · #25Nov 17, 23:13 UTC · #28Nov 17, 23:28 UTC · #28Nov 17, 23:43 UTC · #29Nov 17, 23:58 UTC · #29Nov 18, 00:13 UTC · #29Nov 18, 00:28 UTC · #30

Last 14 days

Best rank per day (UTC).

Nov 7today

Metric history

Platform metric as reported by Hacker News.

0142842 17:2819:1320:5822:4300:28 Nov 17, 17:28 UTC · 4Nov 17, 17:43 UTC · 10Nov 17, 17:58 UTC · 13Nov 17, 18:13 UTC · 16Nov 17, 18:28 UTC · 17Nov 17, 18:43 UTC · 18Nov 17, 18:58 UTC · 19Nov 17, 19:13 UTC · 22Nov 17, 19:28 UTC · 23Nov 17, 19:43 UTC · 25Nov 17, 19:58 UTC · 26Nov 17, 20:13 UTC · 27Nov 17, 20:28 UTC · 29Nov 17, 20:43 UTC · 30Nov 17, 20:58 UTC · 32Nov 17, 21:13 UTC · 33Nov 17, 21:28 UTC · 34Nov 17, 21:43 UTC · 34Nov 17, 21:58 UTC · 34Nov 17, 22:13 UTC · 35Nov 17, 22:28 UTC · 35Nov 17, 22:43 UTC · 37Nov 17, 22:58 UTC · 38Nov 17, 23:13 UTC · 39Nov 17, 23:28 UTC · 39Nov 17, 23:43 UTC · 40Nov 17, 23:58 UTC · 41Nov 18, 00:13 UTC · 41Nov 18, 00:28 UTC · 42

Where it trended

ListBestDaysChecksLast seen
Hacker News · Front page#8229
Hacker News · Show HN#2245
Hacker News · Show HN · this week#22452
GitHub · Rising today runanywhereai/trnrtsame link

From the discussion

A few top-level comments from Hacker News, shortened. Read the full thread on Hacker News.

Good on these folks for doing something useful with Trainium. I'm always surprised that the Tranium ecosystem is as poor as it is. Amazon's market cap is nearly $3T and they can't throw a couple L6s and a modest token budget at this? Making Trainium work as seamlessly as possible as an Nvidia substitute is a clear…

Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.

curious how the token/$ on trainuim compare to nvidia chips and amd. is the future "chipless" inference?

Questions

Is Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium trending on Hacker News right now?

Not at the moment. It was last on the list on Nov 20, 02:51 UTC, after 4 days of trending.

What is the highest rank Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium reached?

#8 on Hacker News · Front page, on Nov 17, 17:43 UTC. Trendoday checks this list every 15 minutes.

How long has Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium been trending?

It was first seen on Nov 17, 2026 and has been on the list on 4 days (126 checks) since.

How much discussion did it get on Hacker News?

54 points and 7 comments; submitted by sanchitmonga22 on Nov 17, 2026.