Libraries, tools and repos: releases you depend on and projects gaining stars.
For the past few weeks I've been trying out converting existing dense models to sparse Mixture-of-Experts models, with no pretraining from scratch.