Open source

Libraries, tools and repos: releases you depend on and projects gaining stars.

Parameter Golf with AutoResearch — Vayum Arora, Zhengyao Jiang, Dixing Xu & Dhruv Srikanth, Weco AI

Zhengyao Jiang introduces autoresearch as repeated proposals and evaluations, and Dixing Xu explains the team's Aiden system and its contributions to OpenAI's Parameter Golf challenge.

r/LocalLLaMA (top, daily)19h ago

Converting dense models into Mixture-of-Experts

For the past few weeks I've been trying out converting existing dense models to sparse Mixture-of-Experts models, with no pretraining from scratch.

GitHub: pytorch/pytorch11d ago

pytorch/pytorch v2.14.1: PyTorch 2.14.1 Release

This release is meant to fix the following regressions and silent correctness issues:

Code

GitHub: huggingface/peft12d ago

huggingface/peft v0.21.1

This is a small PEFT release to enable Tensor Parallel (TP) to work properly with PEFT.

Code