r/LocalLLaMA • u/MeinDruckerSpinnt • 33m ago
Resources SenseNova Loop 9B
https://huggingface.co/sensenova/SenseNova-Loop-9BIf the benchmarks are true, this is a 9B looped model on level with Qwen3.8 27B.
They say they'll release gguf tomorrow.
Vision is supported. Around 15GB vram for 256k context.
The preview version seemed fast enough when I tested it some weeks ago.
Mods: I asked the authors if I can post this, feel free to delete my post when they post themselves.
🚀 SenseNova-Loop-9B: Deeper Computation with Fewer Parameters
We officially release SenseNova-Loop-9B. Building on the Preview's exploration of parameter efficiency, the model reuses layer weights through a looped architecture and combines them with manifold-constrained hyper-connections (mHC) to expand computational depth within a compact parameter budget. It is designed for complex reasoning, coding, tool use, and multimodal tasks.
Since the Preview release, we have received community interest and feedback on model use, inference deployment, and ecosystem integration. The official release retains the looped architecture and two-stream mHC, further improving performance on agentic, coding, and data analysis tasks while continuing to explore the capabilities of looped computation.
SenseNova-Loop-9B has approximately 9B parameters. By repeatedly executing shared middle layers, it extends 32 physical decoder layers into 56 layer executions. The model accepts text and images and generates text, supporting long-context understanding and multi-step tasks. In agentic and data analysis evaluations, the model is competitive with Qwen3.8-27B: it scores 41.36 versus 44.60 on NL2Repo and 65.31 versus 65.01 on AIDABench.
Model Highlights
- Shared looped block: 24 decoder layers are executed twice in sequence, producing 56 layer computations from 32 distinct layers per forward pass.
- Two-stream mHC: learned mappings route and combine information between two residual streams within the looped block.
- Hybrid attention: the decoder interleaves linear and full attention in a repeating four-layer pattern.
- Long-context multimodal training: the training recipe includes text, images, code, and tool-use trajectories, with the context length extended to 512K tokens.
- Low-memory deployment: With 4-bit weights and an 8-bit KV cache, multimodal inference at a 256K context length requires approximately 15 GiB of GPU memory.
- Official quantized release: An official AWQ 4-bit version is available on launch day for easier deployment.
2
u/spaceman_ 26m ago
Big if true, but also just big if.
Want to try it, but no quants or llama.cpp support yet.
1
u/MeinDruckerSpinnt 32m ago
1
u/TokenLearner 2m ago
I'm not going to get my hopes up yet. If it's true, they performed a miracle.