Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs.
Olmo-core 3 introduces a redesigned, fully open training stack for efficiently scaling mixture-of-experts models into the trillion-parameter range.
Ai2 BlogResearch source·