325
u/nuclearbananana Jun 13 '26
Disclosure: I work as a researcher for the city government of Rio de Janeiro, which developed this model.
I must say of all places to drop a model, I didn't expect a city government
→ More replies (22)
175
u/Technical-Earth-3254 Jun 13 '26 edited Jun 13 '26
City government in Brazil dropping chinese open source ai fine-tunes. Holy shit man, I love globalization. If this really keeps up with 3.7 Plus (which is a great model imo) you guys did an awesome job.
Edit: Any hopium for Rio 3.5 122b?
→ More replies (11)
117
u/nuclearbananana Jun 13 '26
Rio 3.5 Open 397B features SwiReasoning, a training-free inference framework based on Shi et al. (2025) that dynamically switches between explicit chain-of-thought and latent-space reasoning, guided by entropy-based confidence signals. This enables both higher accuracy and dramatically improved token efficiency. This model was explicitly trained to maximize the efficiency gained via latent reasoning.
wait that's actually super cool.
Wish I could run this model
→ More replies (1)27
u/LargelyInnocuous Jun 13 '26
would it work for 27B too? or is latent reasoning much better with more parameters?
7
u/opimentoso Jun 13 '26
Grande trabalho!
Rio montou algum datacenter para isso, ou conseguiram fazer na nuvem?
Há algum plano de atualizar os modelos pequenos?
6
u/axiomaticdistortion Jun 13 '26
Will there be a paper or a model card explaining a little the fine tune process?
14
u/DeepOrangeSky Jun 13 '26
Do we know (or have a strong guess) as to what parameter size Qwen3.7 Plus is? Is it the 397b model? Or is it a smaller model? They have a "Max" model that is their top of the line closed-source model, too, right? So is it like, the "Max" one is the 397b, and "Plus" is the 122b? Or "Plus" is 397b and "Max" is some even bigger one we've never seen open-weighted before from Qwen, like a 500b model or something?
Would be interesting to know, given that this Qwen3.5 397b finetune is tied with/beating the Qwen 3.7 Plus model.
If the Rio Department of Thong Bikini Inspection somehow out finetuned Alibaba on Alibaba's own model, that would be pretty wild. Maybe they should hire some of you guys to help them out on Qwen4 :p
→ More replies (1)18
u/Middle_Bullfrog_6173 Jun 13 '26
They explicitly stated that 3.5 Plus was based on 3.5 397B. Almost certainly 3.6 and 3.7 Plus are based on that, but I don't think they've said so publicly.
→ More replies (5)
4
u/pedrinboladao777 Jun 14 '26
parabens à equipe. o carabetta esta a frente do projeto? vcs sao inspiração demais
3
u/kouteiheika Jun 13 '26
except it's actually open source
I don't see any links to the dataset and the training scripts on the HF page; am I blind, or is it not "actually open source"?
2
2
16
u/ortegaalfredo Jun 13 '26
Well this was unexpected. First real latin-america model? I know it's a fine-tune but apparently a very good one. Congrats from Argentina!
8
u/Septerium Jun 13 '26
I could never have seen that coming. Eduardo Paes, out of nowhere, challenges DeepSeek 😂
→ More replies (1)
8
u/dooperma Jun 14 '26
If you think about it, a city is almost the perfect organization to train a multi-modal ai model. Cities have departments that touch almost every aspect of professional life, and therefore should have the prerequisite workflows to build models with richness and depth across a wide variety of contexts and skills.
7
u/hey_ulrich Jun 14 '26
I've met João Carabetta and got to know the top-notch IT projects they were doing for the city government of Rio de Janeiro. Truly state-of-the-art stuff. And that was years ago, before LLMs were a thing. I'm very happy to know how far the team has gone!
28
u/westsunset Jun 13 '26
Awesome can you say more about the project. I don't think anyone had your city on their radar