SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models.

arXiv:2610.03329v1 Announce Type: cross Abstract: Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated probes and aggregate accuracy. We introduce SyntaxBench,