DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat

Many AI benchmarks reduce complex decision-making to simplified game mechanics, missing how real tactical reasoning juggles geometry, timing, resources, and interacting rules simultaneously. DungeonBench tackles this using Dungeons & Dragons combat, covering rich official ruleset content and testing agents on both single encounters and multi-encounter \"days\" requiring resource management across time. Evaluating frontier language models reveals they win individual fights but struggle with long-term resource budgeting and rest timing. This benchmark is valuable for developing AI agents capable of complex, rule-bound sequential planning, applicable to game AI, logistics, and multi-step strategic decision systems. Authors: Ismayil Ismayilov, Atakan Kara, Kaan Oktay Paper: https://arxiv.org/abs/2607.29577v1