awslabs/ai-eval-studio
- Stars562
- Forks4
- LanguagePython
- LicenseApache-2.0
GitHub counts sampled
GitHub counts sampled
An end-to-end LLM evaluation platform. Upload a dataset, describe your goal in chat, and the system runs evaluations across models, optimizes the prompt iteratively against real failures, and hands you back a standalone Python eval harness you can run in CI.
Every model call — the agent driving the conversation, the models under test, and the LLM judge — runs on Amazon Bedrock.
Description and README excerpt from awslabs/ai-eval-studio on GitHub ↗.
awslabs/ai-eval-studio was first seen on GitHub · Rising today on Nov 19, 2026. Since then it has appeared in 2 checks on 1 different day. Its best position was #30 of 30, reached on Nov 19, 00:46 UTC. It dropped off the list after Nov 19, 01:01 UTC.
Position on GitHub · Rising today at every check (lower is better).
Best rank per day (UTC).
Estimated stars gained over 24 hours at each check.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 19, 01:01 UTC, after 1 day of trending.
#30 on GitHub · Rising today, on Nov 19, 00:46 UTC.
It was first seen on Nov 19, 2026 and has been on the list on 1 day (2 checks) since.
Mostly Python; it is licensed under Apache-2.0. It has 562 stars and 4 forks.