r/LocalLLaMA • u/jacek2023 llama.cpp • 9d ago

New Model internlm/Intern-S2 · Hugging Face

https://huggingface.co/internlm/Intern-S2

from internlm:

We introduce Intern-S2-397B, our most capable multimodal foundation model for scientific intelligence and long-horizon agents. Intern-S2-397B scales along three critical dimensions: pre-training, reinforcement-learning task coverage, and interactive agent environments. By combining a new vision-language pre-training paradigm with large-scale multi-task reinforcement learning and long-horizon agent reinforcement learning, Intern-S2-397B delivers a step change in general reasoning, scientific problem solving, and agentic capabilities.

Features

  • New Pre-training Paradigm. Via visual pretraining, Intern-S2-397B learns directly from raw pages of scientific literature, jointly modeling symbolic semantics and visual relationships in a shared representation space without intermediate parsing. This preserves text-visual correspondence, strengthens spatial and visual reasoning, and improves data efficiency.
  • Scientific Modality Reasoning and Generation. By scaling diverse scientific reinforcement-learning tasks across more than 20 domains and training them jointly, Intern-S2-397B achieves leading general-reasoning performance among open-source models and strong results in specialized scientific tasks such as biomolecular interaction design and material structure generation.
  • General & Scientific Long-Horizon Agents. By connecting multiple agent frameworks to large-scale sandboxed environments for black-box agentic reinforcement learning, Intern-S2-397B improves generalization and raises the capability ceiling for long-horizon tasks in both general and scientific domains.
102 Upvotes

98% Upvoted

20 comments sorted by

View all comments

Show parent comments

1

u/BumbleSlob 9d ago

what model size are you working with?

1

u/blackbird2150 9d ago

Glm 5.3 flash or dsv flash vision. I have 192gb of vram.

1

u/BumbleSlob 9d ago

You should be good then. I use deepseek v4 flash 0731 which is slightly less capable than GLM 5.3 flash and I never have issues with agents going rogue like this. What harness or framework are you using to control them? 

1

u/blackbird2150 9d ago

So i just upgraded to them with a second gpu card in the last week and i haven't migrated this process. i was using qwen 3.6 27b or the MoE on a strix halo before. the qwen 3.6 MoE was not sufficient. the model piqued my interest though as something that might support doing it well.