Updates
New models and papers, community benchmarks and tutorials from YouTube and Reddit, news coverage and Hacker News discussions — each summarised and linked to its source.
Last refreshed 2026-11-19 11:10 UTC
- 2026-11-04GitHubNews🚀 llama.cpp v0.9.0 released
Overview This release adds OCP FP8 E4M3 quantization support, a new flash_attn_ext_rows op that makes the unified KV cache efficient for multi-sequence inference, and a generic batched tensor copy API. Four new architect…
- 2026-11-03GitHubNews🚀 ollama v0.40.14 released
What's Changed ollama launch claude now applies the model's output token limit for Claude Code, so cloud models no longer run into the 128k default cap Cloud web search responses on /api/chat are now decoded correctly, i…
- 2026-11-02GitHubNews🚀 sglang v0.5.23 released
Highlights 1007 PRs from 257 contributors. New models | Model | Type | Cookbook | |---|---|---| | Muse Spark Open | LLM / VLM | link(https://docs.sglang.io/cookbook/autoregressive/Meta/MuseSparkOpen) | | Beam-1.0 | LLM /…
- 2026-11-02GitHubNews🚀 vllm v0.33.0rc3 released
v0.33.0 Highlights This release features 927 commits from 389 contributors (122 new)! New models: Reflection Beam-1.0 (501B MoE, 23B active) with its DFlash2 drafter (62074), Yandex AliceAI-Foundation-80B-A3B (57963), Re…
- 2026-10-30GitHubNews🚀 transformers v5.22.1 released
Patch release v5.22.1 We just had to fix the documentation! Fix Remove WIP doc for Ml4 (https://github.com/huggingface/transformers/pull/50124) from @remi-or
- 2026-10-29GitHubNews🚀 transformers v5.22.0 released
New Models Mistral Large 4 (Le Chonk) <img width="1329" height="780" alt="image" src="https://github.com/user-attachments/assets/1cff9ca7-19e3-4622-8db6-fb1cfa842579" / Mistral Large 4 is Mistral's largest and most capab…
- 2026-10-29GitHubNews🚀 transformers v5.21.1 released
Patch release v5.21.1 Fix rope_scaling setter for configs that assign it during init (50080 ) We broke remote code loading in vllm, this fixes it sorry everyone!
- 2026-10-28GitHubNews🚀 ollama v0.40.13 released
LFM3 on Linux and Windows Liquid AI's LFM3(https://ollama.com/library/lfm3) models, including text-to-speech in lfm3-audio(https://ollama.com/library/lfm3-audio) and lfm3-omni(https://ollama.com/library/lfm3-omni), now r…
- 2026-10-27GitHubNews🚀 ollama v0.40.12 released
Liquid AI LFM3 LFM3(https://ollama.com/library/lfm3) is Liquid AI's new family of small models built for local agents, tool calling, and structured output, on Liquid's new tri-hybrid architecture. The family includes: - …
- 2026-10-24GitHubNews🚀 ollama v0.40.11 released
Speech Ollama can now generate speech(https://docs.ollama.com/capabilities/speech) on macOS. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-com…
- 2026-10-22GitHubNews🚀 ollama v0.40.9 released
Speech Ollama can now generate speech(https://docs.ollama.com/capabilities/speech) with Phonon on Apple Silicon. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio th…
- 2026-10-21GitHubNews🚀 ollama v0.40.8 released
<p align="center"<img width="160" alt="flint-logo" src="https://github.com/user-attachments/assets/3c1741a5-710c-4bde-8ac7-096e40b495bb" /</p Recursive Flint Flint(https://ollama.com/library/flint) brings Recursive's cod…
- 2026-10-19GitHubNews🚀 transformers v5.20.2 released
Patch release: v5.20.2 This patch notably solves an issue where some inputs could loose their original type inside prepare_inputs_for_generation in generate, leading to problems with multimodal models. It also fixes some…
- 2026-10-19GitHubNews🚀 sglang v0.5.22 released
Highlights 950 PRs from 245 contributors. New models | Model | Type | Cookbook | |---|---|---| | Clef / Clef Flash | LLM / VLM | link(https://docs.sglang.io/cookbook/autoregressive/Cloudflare/clef) | | PPLX-Decider v1 / …
- 2026-10-18GitHubNews🚀 vllm v0.32.0 released
v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! Structured decisions and generic parsers: the new POST /v1/systemone endpoint answers choice, noul and score questions over a structur…
- 2026-10-18GitHubNews🚀 ollama v0.40.7 released
What's Changed pplx-decider(https://ollama.com/library/pplx-decider) is a 27B decision model from Perplexity, fine-tuned from Qwen3.8-27B Continuing an OpenAI-compatible Responses conversation no longer fails when switch…
- 2026-10-16GitHubNews🚀 ollama v0.40.6 released
What's Changed win: prevent orphaned runners by @dhiltgen in https://github.com/ollama/ollama/pull/18500 gguf: add the q2_0 tensor and file types by @jmorganca in https://github.com/ollama/ollama/pull/18967 Launch clef i…
- 2026-10-16GitHubNews🚀 transformers v5.20.1 released
Release v5.20.1 Special surprise including the new model Beam from Reflection AI :partying_face: <img width="2912" height="1440" alt="Gemini_Generated_Image_ox4hjlox4hjlox4h" src="https://github.com/user-attachments/asse…
- 2026-10-15GitHubNews🚀 transformers v5.20.0 released
Release v5.20.0 New Model additions Muse Spark Open <img width="2400" height="1296" alt="image" src="https://github.com/user-attachments/assets/bf34ea27-0edf-4ded-ba6f-905b04096126" / Muse Spark Open is a multimodal mixt…
- 2026-10-14GitHubNews🚀 ollama v0.40.5 released
NVIDIA Nemotron 3.5 Super NVIDIA Nemotron 3.5 Super(https://ollama.com/library/nemotron-3.5-super) is a vision-language model for coding, reasoning, tool use, and document understanding. It pairs a 120B-parameter hybrid …
- 2026-10-12GitHubNews🚀 ollama v0.40.4 released
Decision models in the CLI Decision models can now be used directly from the terminal with ollama run — ask yes/no questions, classify text into labels, or score against a rubric: ollama run nimble --ask "Is a refund bei…
- 2026-10-11GitHubNews🚀 ollama v0.40.3 released
What's Changed ollama launch claude no longer shows a warning about Claude connectors by @hoyyeva in https://github.com/ollama/ollama/pull/18878 ollama launch codex no longer warns about service tiers by @hoyyeva in http…
- 2026-10-08GitHubNews🚀 ollama v0.40.2 released
Model upgrades Models downloaded with earlier versions of Ollama are upgraded in the background the first time you run them, for better performance and compatibility when running on llama.cpp. To make downgrading safe, O…
- 2026-10-07GitHubNews🚀 ollama v0.40.1 released
What's Changed server: proxy cloud usage and balance APIs by @drifkin in https://github.com/ollama/ollama/pull/18829 llama: fix clef head reads past 2GiB on windows by @Gigrise in https://github.com/ollama/ollama/pull/18…
- 2026-10-06GitHubNews🚀 transformers v5.19.0 released
Release v5.19.0 New Model additions EmbeddingGemma2 <img width="2716" height="2308" alt="image" src="https://github.com/user-attachments/assets/84734e74-163d-4d12-b166-ffcf6749d563" / EmbeddingGemma 2 is a multimodal emb…
- 2026-10-05GitHubNews🚀 llama.cpp v0.6.0 released
Overview llama.cpp v0.6.0 introduces the new llama_batch_ext extended batch API (with llama_process) for mixed token/embedding inputs and MTP/deepstack state embeddings, adds support for the GLM-5.3-Flash (GLM5-Next) 320…
- 2026-10-05GitHubNews🚀 vllm v0.31.0 released
v0.31.0 Highlights This release features 717 commits from 307 contributors (96 new)! DeepSeek-V4.1-Flash performance: FlashMLA mega attention with the V4.1 NVFP4 compressed KV cache is now the SM100 default (56935); Deep…
- 2026-10-02GitHubNews🚀 sglang v0.5.21 released
Highlights 779 PRs from 227 contributors. New models | Model | Type | Cookbook | |---|---|---| | DeepSeek-V4.1 Flash | LLM / VLM | link(https://docs.sglang.io/cookbook/autoregressive/DeepSeek/DeepSeek-V4_1) | | GigaChat …
- 2026-09-30GitHubNews🚀 transformers v5.18.0 released
New Model additions Nemotron 3 Diarization <img width="1680" height="900" alt="image" src="https://github.com/user-attachments/assets/fe735cb3-9e5b-43ad-8f60-9dec8425aec7" / Nemotron 3 Diarization is an open-weight strea…
- 2026-09-29GitHubNews🚀 ollama v0.35.1 released
Clef decision models Ollama now supports Clef(https://ollama.com/library/clef) and Clef Flash(https://ollama.com/library/clef), Cloudflare's new open-source decision models, through /v1/systemone. Clef (27B) and Clef Fla…
- 2026-09-28GitHubNews🚀 ollama v0.35.0 released
Decision models Ollama now supports decision models through /v1/systemone, based on TypeSafe’s Jev API(https://typesafe.ai). Decision models return choices, probabilities, and scores instead of text. Use them for tasks s…
- 2026-09-25GitHubNews🚀 ollama v0.40.0 released
What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen3.8 ollama run qwen3…
- 2026-09-23GitHubNews🚀 ollama v0.34.4 released
What's Changed - Structured outputs on thinking models now apply in a single pass, making them faster and more reliable. - Fixed intermittent "model not found" errors with a large local library - Fixed the macOS app beco…
- 2026-09-22GitHubNews🚀 vllm v0.30.0 released
v0.30.0 Highlights This release features 762 commits from 315 contributors (104 new)! New models: DeepSeek-V4.1-Flash (56214, 56228, 56208) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 (568…
- 2026-09-19GitHubNews🚀 ollama v0.34.3 released
What's Changed GET /api/show now advertises each model's thinking controls and default: Available in the CLI with: ollama show gemma4 thinking levels false, true default true Available in the API with: sh curl http://loc…
- 2026-09-18GitHubNews🚀 sglang v0.5.20 released
Highlights 713 PRs from 237 contributors. New models in this release (see the cookbook(https://docs.sglang.io/cookbook) for all supported models): | Model | Type | PRs | Cookbook | |---|---|---|---| | GLM-5.3-Flash | Aut…
- 2026-09-15GitHubNews🚀 ollama v0.34.2 released
What's Changed - Added first-run setup when running ollama, with options to sign in or continue locally. Setup completion is shared with the desktop app on macOS and Windows. - Added ollama://apps to open the desktop app…
- 2026-09-14GitHubNews🚀 ollama v0.34.1 released
What's Changed MLX safetensors ollama create no longer experimental. GGUF model creation now requires using llama.cpp tooling for safetensor conversion and quantization. Improved MLX memory handling on Apple Silicon Runa…
- 2026-09-09GitHubNews🚀 transformers v5.17.0 released
Release v5.17.0 New Model additions HYV4 <img width="1503" height="827" alt="image" src="https://github.com/user-attachments/assets/e6ed85ee-eb1d-40eb-a0d4-c649f6337ca9" / Hy4-Preview is a 780B-parameter mixture-of-exper…
- 2026-09-09GitHubNews🚀 vllm v0.29.0 released
v0.29.0 Highlights This release features 594 commits from 277 contributors (91 new)! Model Runner V2 is now the default for all models (53183), completing the rollout that began with pooling models (48290). MRV2 also gai…
- 2026-09-05GitHubNews🚀 sglang v0.5.19 released
Highlights 786 PRs from 214 contributors. New models in this release (see the cookbook(https://docs.sglang.io/cookbook) for all supported models): | Model | Type | PRs | Cookbook | |---|---|---|---| | Qwen3.8 (2.4T-A95B)…
- 2026-08-26GitHubNews🚀 transformers v5.16.1 released
Release v5.16.1 This is a special release as we include GLM! (and a few small fixes) GLM-5.3-Flash <img width="4239" height="2643" alt="image" src="https://github.com/user-attachments/assets/17bc9c29-758b-44c8-8230-42f94…
- 2026-08-26GitHubNews🚀 transformers v5.16.0 released
Release v5.16.0 New Model additions Qwen4-Exp <img width="2241" height="693" alt="image" src="https://github.com/user-attachments/assets/c838b5ba-ffea-42da-baa9-3f66178e3671" / Qwen4-Exp builds on Qwen3.5's hybrid text a…
- 2026-08-26GitHubNews🚀 vllm v0.28.0 released
v0.28.0 Highlights This release features 584 commits from 270 contributors (76 new)! Kimi-K3 performance push: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (50484), fus…
- 2026-08-22GitHubNews🚀 sglang v0.5.18 released
Highlights 710 PRs from 212 contributors. New models in this release (see the cookbook(https://docs.sglang.io/cookbook) for all supported models): | Model | Type | PRs | Cookbook | |---|---|---|---| | Muse Glimmer | Auto…
- 2026-08-11GitHubNews🚀 vllm v0.27.1 released
This is a patch release on top of v0.27.0. - Support quantized DSpark Markov heads (50424)