Many Indian banks serve customers through FAQ pages and scripted chatbots. Assistants based on language models could respond faster and carry out requests such as blocking a card, but only if they giv
TauIndianBankBench evaluates language model assistants on Indian retail banking by verifying both procedural compliance and final outcomes across 1,000 simulated tasks.
Many Indian banks serve customers through FAQ pages and scripted chatbots. Assistants based on language models could respond faster and carry out requests such as blocking a card, but only if they give correct information and follow the bank's rules. These rules prescribe a procedure, a set of required steps, such as obtaining a closure quote before closing a deposit. Adapting models to this domain requires measuring how well they follow the procedure, before and after training. Benchmarks usually judge only the records left at the end of a conversation. Many required steps, however, leave the records unchanged, so an assistant that skips them can still be judged successful. We present…
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
TauIndianBankBench: Procedure-Aware, Action-Oriented Evaluation of Tool-Using Conversational Agents was first seen on Hugging Face · Daily papers on Oct 29, 2026. Since then it has appeared in 43 checks on 5 different days. Its best position was #17 of 30, reached on Oct 30, 03:28 UTC. It dropped off the list after Nov 2, 01:28 UTC.
Position on Hugging Face · Daily papers at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by Hugging Face.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 2, 01:28 UTC, after 5 days of trending.
#17 on Hugging Face · Daily papers, on Oct 30, 03:28 UTC. Trendoday checks this list every 120 minutes.
It was first seen on Oct 29, 2026 and has been on the list on 5 days (43 checks) since.