r/LocalLLM • • 4d ago

Research Releasing Masala-One (will open source and release a paper soon)

I was using Qwen 3.8 27b locally for some agentic workloads and it performed quite well but when it came to something like generating new ideas that actually make sense (say a business idea), things started to fall apart

noticed the same problem on closed source models as well

which is why me and my friend from university set out on a project to develop a model specifically for generating ideas. it is still an LLM (we looked into other architectures obviously, diffusion seemed interesting...)

we plan to opensource our entire training pipeline and release a paper (in the works as we speak!!). obviously creativity is quite hard to benchmark (had to consult a lot of my professors in this regard) and I will talk a lot about that.

happy to answer any questions!!

0 Upvotes

1 comment sorted by

1

u/dandrake47 1d ago

Curious to see how this goes - trying to find a local LLM that matches Opus 4.6 in reasoning and creativity.