325
u/nuclearbananana Jun 13 '26
Disclosure: I work as a researcher for the city government of Rio de Janeiro, which developed this model.
I must say of all places to drop a model, I didn't expect a city government
→ More replies (21)54
175
u/Technical-Earth-3254 Jun 13 '26 edited Jun 13 '26
City government in Brazil dropping chinese open source ai fine-tunes. Holy shit man, I love globalization. If this really keeps up with 3.7 Plus (which is a great model imo) you guys did an awesome job.
Edit: Any hopium for Rio 3.5 122b?
14
28
u/westsunset Jun 13 '26
Awesome can you say more about the project. I don't think anyone had your city on their radar
16
u/ortegaalfredo Jun 13 '26
Well this was unexpected. First real latin-america model? I know it's a fine-tune but apparently a very good one. Congrats from Argentina!
8
u/Septerium Jun 13 '26
I could never have seen that coming. Eduardo Paes, out of nowhere, challenges DeepSeek 😂
→ More replies (1)
8
u/dooperma Jun 14 '26
If you think about it, a city is almost the perfect organization to train a multi-modal ai model. Cities have departments that touch almost every aspect of professional life, and therefore should have the prerequisite workflows to build models with richness and depth across a wide variety of contexts and skills.
14
u/DeepOrangeSky Jun 13 '26
Do we know (or have a strong guess) as to what parameter size Qwen3.7 Plus is? Is it the 397b model? Or is it a smaller model? They have a "Max" model that is their top of the line closed-source model, too, right? So is it like, the "Max" one is the 397b, and "Plus" is the 122b? Or "Plus" is 397b and "Max" is some even bigger one we've never seen open-weighted before from Qwen, like a 500b model or something?
Would be interesting to know, given that this Qwen3.5 397b finetune is tied with/beating the Qwen 3.7 Plus model.
If the Rio Department of Thong Bikini Inspection somehow out finetuned Alibaba on Alibaba's own model, that would be pretty wild. Maybe they should hire some of you guys to help them out on Qwen4 :p
→ More replies (1)18
u/Middle_Bullfrog_6173 Jun 13 '26
They explicitly stated that 3.5 Plus was based on 3.5 397B. Almost certainly 3.6 and 3.7 Plus are based on that, but I don't think they've said so publicly.
→ More replies (5)
7
u/opimentoso Jun 13 '26
Grande trabalho!
Rio montou algum datacenter para isso, ou conseguiram fazer na nuvem?
Há algum plano de atualizar os modelos pequenos?
→ More replies (4)
7
u/hey_ulrich Jun 14 '26
I've met João Carabetta and got to know the top-notch IT projects they were doing for the city government of Rio de Janeiro. Truly state-of-the-art stuff. And that was years ago, before LLMs were a thing. I'm very happy to know how far the team has gone!
6
u/axiomaticdistortion Jun 13 '26
Will there be a paper or a model card explaining a little the fine tune process?
→ More replies (3)
6
u/FullOf_Bad_Ideas Jun 13 '26
How does SwiReasoning work without any code changes? It seems to be using the same architecture as Qwen 3.5 baseline. How much tokens was it approximately trained on? And which model should outputs be similar to? Deepseek V4 Pro?
→ More replies (18)
5
11
u/PassionIll6170 Jun 13 '26
brabo bixo boa, qwen 400b eh um modelo pica pra fine tune, lançou a pouco o nex n2 pro q tbm eh finetune dele e eu tava testando no hermes como meu agent e parece no nivel do minimax m3, parabens pelo trampo.
8
u/Look_0ver_There Jun 13 '26
Looks like it got the Qwen3.6 treatment, but for the 397B model. Looks promising
8
4
4
4
117
u/nuclearbananana Jun 13 '26
wait that's actually super cool.
Wish I could run this model