Trendoday
GitHub · Rising todayOff the listPython

runanywhereai/trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

  • Stars1099
  • LanguagePython
  • LicenseApache-2.0
–Rank now
#10Peak rank
3Days on list
110Score · 7d
Nov 11, 2026First seen
Rank · 7 days

About RunanywhereAI/trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

TrnRT is an open inference engine for large language models on AWS Trainium. It serves an OpenAI-compatible API from one trn2.48xlarge, runs decode as NKI megakernels (about one kernel per layer half), and keeps a prefix cache across device and host memory. GLM-5.3-Flash is the first supported model; more open models are on the way.

How we built it, with the AgentX results: Serving GLM-5.3-Flash on one Trainium2 box with NKI layer megakernels.

awsglminferencellmllm-servingmegakernelsneuronnkiopenai-apitrainium
Stars
1099
Forks
9
Language
Python
License
Apache-2.0
Last push
Nov 9, 2026
Created
Oct 30, 2026

Description and README excerpt from RunanywhereAI/trnrt on GitHub ↗.

Trending history

runanywhereai/trnrt was first seen on GitHub · Rising today on Nov 11, 2026. Since then it has appeared in 93 checks on 3 different days. Its best position was #10 of 30, reached on Nov 11, 07:15 UTC. It dropped off the list after Nov 13, 06:30 UTC.

Rank history

Position on GitHub · Rising today at every check (lower is better).

#1#11#20#30 07:1519:0406:5318:4206:30 Nov 11, 07:15 UTC · #10Nov 11, 07:30 UTC · #13Nov 11, 07:45 UTC · #13Nov 11, 08:00 UTC · #13Nov 11, 08:15 UTC · #13Nov 11, 08:30 UTC · #12Nov 11, 08:45 UTC · #12Nov 11, 09:00 UTC · #11Nov 11, 09:15 UTC · #12Nov 11, 09:30 UTC · #12Nov 11, 09:45 UTC · #12Nov 11, 10:00 UTC · #12Nov 11, 10:15 UTC · #12Nov 11, 10:30 UTC · #12Nov 11, 10:45 UTC · #12Nov 11, 11:00 UTC · #10Nov 11, 11:15 UTC · #12Nov 11, 11:30 UTC · #12Nov 11, 11:45 UTC · #12Nov 11, 12:00 UTC · #10Nov 11, 12:30 UTC · #12Nov 11, 12:45 UTC · #12Nov 11, 13:00 UTC · #11Nov 11, 13:16 UTC · #12Nov 11, 13:30 UTC · #17Nov 11, 13:45 UTC · #22Nov 11, 14:15 UTC · #22Nov 12, 14:00 UTC · #30Nov 12, 14:16 UTC · #27Nov 12, 14:30 UTC · #26Nov 12, 15:00 UTC · #27Nov 12, 15:15 UTC · #25Nov 12, 15:30 UTC · #24Nov 12, 15:46 UTC · #24Nov 12, 16:00 UTC · #25Nov 12, 16:16 UTC · #23Nov 12, 16:30 UTC · #23Nov 12, 16:46 UTC · #27Nov 12, 17:00 UTC · #26Nov 12, 17:15 UTC · #24Nov 12, 17:30 UTC · #24Nov 12, 17:46 UTC · #23Nov 12, 18:00 UTC · #24Nov 12, 18:15 UTC · #25Nov 12, 18:30 UTC · #25Nov 12, 18:46 UTC · #23Nov 12, 19:01 UTC · #24Nov 12, 19:15 UTC · #24Nov 12, 19:31 UTC · #24Nov 12, 19:46 UTC · #23Nov 12, 20:01 UTC · #23Nov 12, 20:16 UTC · #24Nov 12, 20:30 UTC · #24Nov 12, 20:46 UTC · #23Nov 12, 21:00 UTC · #23Nov 12, 21:15 UTC · #26Nov 12, 21:30 UTC · #26Nov 12, 21:46 UTC · #24Nov 12, 22:00 UTC · #24Nov 12, 22:15 UTC · #25Nov 12, 22:30 UTC · #27Nov 12, 22:46 UTC · #25Nov 12, 23:00 UTC · #25Nov 12, 23:15 UTC · #27Nov 12, 23:30 UTC · #27Nov 12, 23:46 UTC · #26Nov 13, 00:00 UTC · #26Nov 13, 00:15 UTC · #27Nov 13, 00:30 UTC · #27Nov 13, 00:46 UTC · #26Nov 13, 01:01 UTC · #27Nov 13, 01:15 UTC · #29Nov 13, 01:31 UTC · #29Nov 13, 01:46 UTC · #28Nov 13, 02:01 UTC · #27Nov 13, 02:16 UTC · #28Nov 13, 02:30 UTC · #28Nov 13, 02:46 UTC · #29Nov 13, 03:00 UTC · #28Nov 13, 03:15 UTC · #30Nov 13, 03:30 UTC · #30Nov 13, 03:46 UTC · #29Nov 13, 04:00 UTC · #28Nov 13, 04:15 UTC · #29Nov 13, 04:30 UTC · #30Nov 13, 04:46 UTC · #29Nov 13, 05:00 UTC · #28Nov 13, 05:15 UTC · #30Nov 13, 05:30 UTC · #30Nov 13, 05:46 UTC · #29Nov 13, 06:00 UTC · #28Nov 13, 06:15 UTC · #29Nov 13, 06:30 UTC · #29

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

Platform metric as reported by GitHub.

0181361547 07:1519:0406:5318:4206:30 Nov 11, 07:15 UTC · 533Nov 11, 07:30 UTC · 533Nov 11, 07:45 UTC · 533Nov 11, 08:00 UTC · 533Nov 11, 08:15 UTC · 547Nov 11, 08:30 UTC · 547Nov 11, 08:45 UTC · 547Nov 11, 09:00 UTC · 547Nov 11, 09:15 UTC · 538Nov 11, 09:30 UTC · 538Nov 11, 09:45 UTC · 538Nov 11, 10:00 UTC · 538Nov 11, 10:15 UTC · 533Nov 11, 10:30 UTC · 533Nov 11, 10:45 UTC · 533Nov 11, 11:00 UTC · 533Nov 11, 11:15 UTC · 517Nov 11, 11:30 UTC · 517Nov 11, 11:45 UTC · 517Nov 11, 12:00 UTC · 517Nov 11, 12:30 UTC · 503Nov 11, 12:45 UTC · 503Nov 11, 13:00 UTC · 503Nov 11, 13:16 UTC · 490Nov 11, 13:30 UTC · 490Nov 11, 13:45 UTC · 439Nov 11, 14:15 UTC · 441Nov 12, 14:00 UTC · 267Nov 12, 14:16 UTC · 285Nov 12, 14:30 UTC · 285Nov 12, 15:00 UTC · 253Nov 12, 15:15 UTC · 267Nov 12, 15:30 UTC · 267Nov 12, 15:46 UTC · 256Nov 12, 16:00 UTC · 256Nov 12, 16:16 UTC · 263Nov 12, 16:30 UTC · 263Nov 12, 16:46 UTC · 251Nov 12, 17:00 UTC · 251Nov 12, 17:15 UTC · 257Nov 12, 17:30 UTC · 257Nov 12, 17:46 UTC · 258Nov 12, 18:00 UTC · 258Nov 12, 18:15 UTC · 256Nov 12, 18:30 UTC · 256Nov 12, 18:46 UTC · 256Nov 12, 19:01 UTC · 256Nov 12, 19:15 UTC · 252Nov 12, 19:31 UTC · 252Nov 12, 19:46 UTC · 258Nov 12, 20:01 UTC · 258Nov 12, 20:16 UTC · 248Nov 12, 20:30 UTC · 248Nov 12, 20:46 UTC · 257Nov 12, 21:00 UTC · 257Nov 12, 21:15 UTC · 246Nov 12, 21:30 UTC · 246Nov 12, 21:46 UTC · 257Nov 12, 22:00 UTC · 257Nov 12, 22:15 UTC · 246Nov 12, 22:30 UTC · 246Nov 12, 22:46 UTC · 257Nov 12, 23:00 UTC · 257Nov 12, 23:15 UTC · 246Nov 12, 23:30 UTC · 246Nov 12, 23:46 UTC · 257Nov 13, 00:00 UTC · 257Nov 13, 00:15 UTC · 246Nov 13, 00:30 UTC · 246Nov 13, 00:46 UTC · 255Nov 13, 01:01 UTC · 255Nov 13, 01:15 UTC · 244Nov 13, 01:31 UTC · 244Nov 13, 01:46 UTC · 252Nov 13, 02:01 UTC · 252Nov 13, 02:16 UTC · 242Nov 13, 02:30 UTC · 242Nov 13, 02:46 UTC · 245Nov 13, 03:00 UTC · 245Nov 13, 03:15 UTC · 235Nov 13, 03:30 UTC · 235Nov 13, 03:46 UTC · 242Nov 13, 04:00 UTC · 242Nov 13, 04:15 UTC · 233Nov 13, 04:30 UTC · 233Nov 13, 04:46 UTC · 237Nov 13, 05:00 UTC · 237Nov 13, 05:15 UTC · 228Nov 13, 05:30 UTC · 228Nov 13, 05:46 UTC · 235Nov 13, 06:00 UTC · 235Nov 13, 06:15 UTC · 229Nov 13, 06:30 UTC · 229

Questions

Is runanywhereai/trnrt trending on Trendoday Rising right now?

Not at the moment. It was last on the list on Nov 13, 06:30 UTC, after 3 days of trending.

What is the highest rank runanywhereai/trnrt reached?

#10 on GitHub · Rising today, on Nov 11, 07:15 UTC. Trendoday checks this list every 60 minutes.

How long has runanywhereai/trnrt been trending?

It was first seen on Nov 11, 2026 and has been on the list on 3 days (93 checks) since.

What language is RunanywhereAI/trnrt written in, and what is its license?

Mostly Python; it is licensed under Apache-2.0. It has 1099 stars and 9 forks.