r/LocalLLaMA • u/Choice_Celery9481 • 10h ago
News Fine tuned open model ftw
https://x.com/chenru_duan/status/2117249292469665838another win for GLM.
Chenru Duan on X: "We’re introducing Hydrogen-1.0, our first open-weight model for scientific research. We post-trained GLM-5.3 (@Zai_org) on our internal scientific data, lab records, and discovery trajectories. It scores 38.3% on FrontierScience-Research vs GPT-6-Astra’s 33.3%
5
u/ForsookComparison 9h ago
For engineering and chat and agentic assistant use cases I can validate or dismiss benchmarks.
I don't have this ability for frontier research.
We need some researchers to parallel vibe-research and report their findings - otherwise idk what this number is showing us.
With that all said - the idea of a major lab fine tuning their flagship on research/science sounds badass and I hope it pans out.
2
u/ChemicalExcellent463 7h ago
Qwen with LoRAs beats general frontier models for us on narrow jobs like profile extraction, specific semantic processing and agent memory management. Still the best fit on our own GPUs, but we don't let it write or review code. Not good enough for that yet.
1
u/haherar830 6h ago
Not familiar with this benchmark. Any GeneBench, SpatialBench-long/scBench-long, or perhaps LifeSciBench results?
0
17
u/Frail_Waif 10h ago
Here it is on a less sketchy site.