HARISSA: Inference-Time Self-Checks for Efficient and Safe Local Language Model Deployment.

arXiv:2609.38006v1 Announce Type: new Abstract: Running a language model locally offers advantages in privacy, latency, and cost, but local hardware fits only small models, which are less capable than frontier models. The usual remedy for a hard query, escalat