Fewer Bits, More Tries: Recovering Capability Under Memory Constraints.

arXiv:2610.15372v1 Announce Type: new Abstract: Large language models are generally more capable than smaller ones, but their memory requirements can make local deployment difficult. We ask whether part of this capability gap can instead be recovered by runnin