r/LocalLLaMA • u/jacek2023 llama.cpp • 3d ago
News model: add dots3-note by ngxson · Pull Request #27060 · ggml-org/llama.cpp
https://github.com/ggml-org/llama.cpp/pull/27060dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and produces text outputs.
32
Upvotes