Mechanistic Critics for Sample-Efficient NPU Design-Space Exploration
NPU design-space exploration for LLM inference mainly relies on an expensive simulator that often returns only scalar feedback such as latency and power. Such feedback can rank evaluated configuration
- Upvotes4