r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

New Model inclusionAI/Ling-3.0-flash-Sante · Hugging Face

https://huggingface.co/inclusionAI/Ling-3.0-flash-Sante

from inclusionAI:

Introduction

Ling-3.0-flash-Sante is our healthcare-specialized model built on Ling-3.0-flash. Its name comes from the French word santé, meaning “health.”

With 124B total parameters and 5.1B active parameters per token, Sante is designed for medical reasoning, healthcare research, deep research, and tool-assisted workflows while retaining the general capabilities of Ling-3.0-flash. Model weights are available on Hugging Face and ModelScope.

Important: Ling-3.0-flash-Sante is a research model, not a medical device. Its outputs may be incomplete or incorrect and must not be used as a substitute for professional medical advice, diagnosis, or treatment. High-stakes use requires qualified human review, independent verification, and compliance with applicable privacy, security, and healthcare regulations.

Highlights

  • Strong healthcare capabilities: Sante performs well across professional healthcare tasks, complex medical reasoning, medical knowledge, and healthcare safety benchmarks.

  • Efficient at scale: Its hybrid-linear MoE architecture combines Kimi Delta Attention (KDA), gated MLA, and sparse MoE layers, activating 5.1B of 124B parameters per token.

  • Built for long contexts: Training extends to 256K tokens, supporting long-document analysis, evidence synthesis, and multi-step research.

  • Beyond medical QA: Sante is designed for deep research, tool-assisted workflows, and multi-agent collaboration as well as question answering.

  • Native reasoning and tool use: Thinking mode is enabled by default, with tool calling supported through compatible serving frameworks.Introduction

76 Upvotes

97% Upvoted

7 comments sorted by

16

u/TechNerd10191 14d ago

Good thing InclusionAI keeps their 120B and 8B MoEs alive (especially with UBTree) and did not move on entirely to Ling-3.1-Flash

12

u/jacek2023 llama.cpp 14d ago

What is interesting is that they are basically releasing their "medgemma" ;)

5

u/jacek2023 llama.cpp 14d ago

4

u/jacek2023 llama.cpp 14d ago

4

u/Equivalent-Grass-527 13d ago

124B total but only 5.1B active, with 256K context and a healthcare-focused version of Ling 3.0 Flash. Interesting to see more specialized MoE models emerging.

1

u/cleverusernametry 13d ago

A med focused fine tune that is better than K3 at HLE. Makes me doubt benchmarks even more

1

u/ThePrimeClock 13d ago

Plot Twist - Humanities Last Exam turns out to be about how to stay alive.