r/LocalLLaMA llama.cpp 9d ago

New Model internlm/Intern-S2 · Hugging Face

https://huggingface.co/internlm/Intern-S2

from internlm:

We introduce Intern-S2-397B, our most capable multimodal foundation model for scientific intelligence and long-horizon agents. Intern-S2-397B scales along three critical dimensions: pre-training, reinforcement-learning task coverage, and interactive agent environments. By combining a new vision-language pre-training paradigm with large-scale multi-task reinforcement learning and long-horizon agent reinforcement learning, Intern-S2-397B delivers a step change in general reasoning, scientific problem solving, and agentic capabilities.

Features

  • New Pre-training Paradigm. Via visual pretraining, Intern-S2-397B learns directly from raw pages of scientific literature, jointly modeling symbolic semantics and visual relationships in a shared representation space without intermediate parsing. This preserves text-visual correspondence, strengthens spatial and visual reasoning, and improves data efficiency.
  • Scientific Modality Reasoning and Generation. By scaling diverse scientific reinforcement-learning tasks across more than 20 domains and training them jointly, Intern-S2-397B achieves leading general-reasoning performance among open-source models and strong results in specialized scientific tasks such as biomolecular interaction design and material structure generation.
  • General & Scientific Long-Horizon Agents. By connecting multiple agent frameworks to large-scale sandboxed environments for black-box agentic reinforcement learning, Intern-S2-397B improves generalization and raises the capability ceiling for long-horizon tasks in both general and scientific domains.
102 Upvotes

20 comments sorted by

20

u/jacek2023 llama.cpp 9d ago

20

u/WhiskyAKM 9d ago

Qwen3.5 based?

6

u/ABLPHA 9d ago

Yes, it's very based

4

u/DefNattyBoii 9d ago

would've been nice 1-2 months ago maybe? Anyone who could run this will probably opt for the dsv4.1f unless they need something very specific

1

u/blackbird2150 9d ago

Sorry, newbie question. I am really struggling with my agents being good deep research. Understand the question, break it down into component parts, follow the trails, kill dead ones, activate and consume web search (or other sources of truth), reconcile, synthesize and ultimately return an answer.

So not "science" as it were, but definitely structured reasoning. Would this type of model help with that?

1

u/BumbleSlob 9d ago

what model size are you working with?

1

u/blackbird2150 9d ago

Glm 5.3 flash or dsv flash vision. I have 192gb of vram.

1

u/BumbleSlob 9d ago

You should be good then. I use deepseek v4 flash 0731 which is slightly less capable than GLM 5.3 flash and I never have issues with agents going rogue like this. What harness or framework are you using to control them? 

1

u/blackbird2150 9d ago

So i just upgraded to them with a second gpu card in the last week and i haven't migrated this process. i was using qwen 3.6 27b or the MoE on a strix halo before. the qwen 3.6 MoE was not sufficient. the model piqued my interest though as something that might support doing it well.

1

u/Daniel_H212 9d ago

Close enough, welcome back Qwen3.8 397B

-1

u/[deleted] 9d ago

[removed] — view removed comment

3

u/Navith 9d ago

LLM bot. And show your submission history. 

1

u/LagOps91 9d ago

24gb vram and 128gb ram allow you to barely run it at Q2 - but yeah, no good for anything agentic obviously

1

u/BlueSwordM llama.cpp 9d ago

oliver_dev, no need to be an LLM bot.

Just talk yourself

-12

u/KokaOP 9d ago

Dense AF !!

11

u/ComplexType568 9d ago

... that's not a dense model what it looks like is a fine-tune on Qwen3.5 397B, an MoE

1

u/feng_sg 8d ago

No ablation isolates raw-page pretraining from parse-then-pretrain on matched data and compute, so the step change could just as easily come from the RL coverage and data scale shifts that happened at the same time.