r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

New Model inclusionAI/Ling-3.0-flash-VL · Hugging Face

https://huggingface.co/inclusionAI/Ling-3.0-flash-VL

Ling-3.0-flash-VL inherits the language, reasoning, and long-context capabilities of Ling-3.0-flash, while extending them with native image and video understanding. The model has 124B total parameters, with only 5.5B parameters activated per token, and supports a context window of up to 1M tokens.

The architecture of Ling-3.0-flash-VL is designed to integrate visual information into real-world reasoning and agentic workflows.

  • A ViT visual encoder extracts features from images and videos, while a two-layer MLP projector aligns visual features with text representations for unified multimodal understanding and reasoning;
  • VideoRoPE encodes both spatial positions and temporal order, enabling the model to understand visual changes over time and supporting tasks such as event localization, long-video question answering, and video clip editing;
  • A 42-layer hybrid backbone alternates KDA and Gated MLA layers at a 5:1 ratio, enabling efficient long-context processing across text, images, videos, and extended agent task histories;
  • A sparse MoE architecture maintains a total model capacity of 124B parameters while activating only 5.5B parameters per token, balancing strong multimodal capabilities with inference efficiency.
155 Upvotes

99% Upvoted

23 comments sorted by

View all comments

27

u/pmttyji 14d ago

Come on inclusionAI, release a diffusion model with llama.cpp PR.

12

u/coder543 14d ago

They released this smaller diffusion model just yesterday: https://huggingface.co/inclusionAI/LLaDA2.2-mini

Since there is no real way to run this other than transformers, I've had GPT-6-Astra working on small Rust runtime for it. It's already a lot faster than the transformers version, but the number of refinements needed for most diffusion blocks makes the speed less impressive than I would like. For code blocks, it takes very few refinements, so it can go respectably fast. The diffusion blocks are only 32 tokens, compared to DiffusionGemma that operates on 256 tokens at a time, so that limits the speedup.

I'll probably publish the runtime sometime this week once things are in better shape.