SpecRead: A Benchmark for Measuring Whether Language Models Understand Hardware Specifications.

arXiv:2609.33699v1 Announce Type: new Abstract: Existing benchmarks for large language models (LLMs) in hardware design evaluate downstream artifacts such as generated RTL, assertions, or testbenches. When a model fails such a benchmark, the failure is ambiguo