sgl-project/sglang v0.5.19
| Model | Type | PRs | Cookbook |
Key points
- Beam search. SGLang can now do beam search.
- Pass beamwidth in your request and you get back the n best sequences instead of a single sample.
Sources (1)
- [1]sgl-project/sglang v0.5.19GitHub: sgl-project/sglang · Sep 5, 02:27 AM
| Model | Type | PRs | Cookbook |
**Beam search.** SGLang can now do beam search.
Extractive summary: sentences quoted from the sources.