allenai/StdMoE_1b14b_1T_Preanneal
Parameters13.6B
Context4K
Input → outputtext → text
Licenseapache-2.0
PrecisionF32
ArchitectureEmoForCausalLM
ReleasedMay 5, 2026
Downloads335
Other sizes and formats in the family
| Model | Params | Precision | Downloads |
|---|---|---|---|
| allenai/StdMoE_1b14b_130B | 13.6B | F32 | 382 |
| allenai/StdMoE_1b14b_1T | 13.6B | F32 | 429 |
| allenai/StdMoE_1b14b_1T_EmoAnnealed | 13.6B | F32 | 349 |
This release in the news
No coverage of this exact release yet.