HuggingFaceTB/SmolLM2-360M

Timeline

1. Oct 11, 2026 · Open-source release · 1 source
   Converting dense models into Mixture-of-Experts
   For the past few weeks I've been trying out converting existing dense models to sparse Mixture-of-Experts models, with no pretraining from scratch.

Often appears with