Conceptizer: Next-Token Prediction Is Not All You Need.

arXiv:2610.33027v1 Announce Type: cross Abstract: Next-token prediction (NTP) rewards only the token that occurs next, penalizing every alternative. But natural language often offers many ways to express the same meaning. We introduce Conceptizer, a training f