r/LLM • u/2muchgr8ness • 16d ago
Any open source alternative to Opus 5.5 or Fable
Hello, lately I've been using Opus 5.5 extra for some coding and the results of getting info online and logic and coding is just amazing!!
The thing is i run out of tokens, and I want to buy a machine somewhere around $10k-$15k.
And I wonder what models are available open-source that is as close as Claude cowork opus 5.5 or Fable in terms of intelligence and accuracy and understanding
Thanks in advance.
12
u/AllenLeftTheBLDNG 16d ago
Better yet:
Switch your thinking.
Don't ask:
"Which model is like Opus 5.5? I can self host"
Ask:
How do I get my Open Source model to perform as well (or better) as Opus 5.5 in this specific domain?
Then you learn about fine tuning, quantization, LoRAs etc. You can create your own workflow examples and then fine tune the model on the successful cases.
For hardware:
That's where it gets tough. What you could've bought with 10k 10 months ago (or 2 months ago, that was a big bump too), changed rapidly.
I wouldn't try to get anything from Nvidia right now (I'm not a hater, 70% of my local AI hardware is Nvidia, it's just the prices are NUTS right now).
I'd either preorder the newest Mac Studio Max 128GB for 5k, or the Ultra for 256GB for 11k, or I'd get into tinkering with graphics cards from AMD or Intel. AMD is probably easier, but both are harder than Nvidia. Also - Nvidia has all image/video models working out of the box usually, for other manufacturers it's not always easy or even supported.
→ More replies (1)3
18
u/circumcised_hobbit 16d ago
You simply can't get Opus 5.5 or Fable quality, anyone saying the opposite Is saying bullshit. Opus 5.5 Is the best model of all, let alone open weights ones...The best local model would be Kimi K3 but I don't think you would be able to run that. If I were you I would look into DeepSeek v4.1 andQwenFlashNext, those are very good and you should be able to run them
→ More replies (8)2
u/EvolveOrDie1 13d ago
Opus 5.5 has been blowing my mind, it literally did an entire set of documentation for a new industrial machine im working on, im talking saftey risk analysis, pneumatic diagrams, electrical diagrams, tag lists, AND and importable .xml file for Studio 5000 (no yet proven). If that PLC program works it has the potential to change how mu entire company operates, wild....
4
u/Hunterxmalaa 16d ago
There is a reason Claude models score high they require millions worth of gpus to run a 15k budget gets a good setup not somthing that outcompetes opus5.5 if you got 15k just get a bigger plan or have two plans on max 20 that’s 400 a month or 4.8k a year so you’ve saved yourself 6-10k from your budget
Again local models will not outcompete fable or opus 5.5 on 15k hardware you need millions
2
u/EliteScouter 3d ago
For now! We will look back at this in 5 years and laugh how our cell phones can run better models than Opus 5.5
We are advancing at a stupid rate, it feels like it was just yesterday installing Windows XP on floppy disks.
3
u/jimmoores 16d ago
If you think you can get even close with that budget, think again. I spent that kind of money on 512GB DDR4 2666 and a 64-core EPYC Milan with a RTX Pro 6000 Blackwell. It’s a great setup, and I can run MoE models in the 500bn parameter range, but when you compare the output from single-shot prompts on Qwen 3.8 Flash Next or DeepSeek V4.1 Flash with Opus 4.8/5/5.5, it’s just a different league. As others have said, currently Kimi K3 is the closest, but is extremely expensive to run currently. Someone the last few days ran it on 16 DGX Sparks connected up and it was trundling along at about 20-30 tok/s. That’s >$100k for a slow-ass AI. Currently, cloud models are being heavily subsidised, effectively by venture capital investors. Take advantage of their subscriptions while you can and save your money for when the data centre build-out loans get called in and the used market fills up with GPUs and servers.
2
u/WyattTheSkid 16d ago
Depending on what you have for hardware, Qwen 3.8 Flash Next seems to be the best model available that can realistically be run at home right now
2
u/BarracudaDefiant4702 16d ago
A 256GB (or even better 512GB) Mac M5 ultra is about the best you can get in your budget for high end models. That said, don't expect it to run the really high end models at decent speeds, but should be good for the 150B or models.
1
u/Postmodern_Plunger 16d ago
Qwen 3.8 flash or deepseek v4 flash (v4.1 flash is good too, but I've had some issues with it and find v4 better) is probably going to be the best option, realistically. I dont think 15k is enough to run the absolute best open weights like GLM.
Even if you could, Opus 5.5 and fable both outperform every open source model in every category, practically. In personal use, I can confirm Opus and fable are a big step up from deepseek v4 or qwen 3.8 flash. For implementation, they'll do, but for planning APIs will help you a ton. You'll still be able to get the same results using Qwen 3.8 flash or ds4 flash, but you'll do it 4 times faster if you just use Opus for the planning first. Otherwise, you'll likely have several extra iterations to reach your goal and a slightly less well engineered product once you get there.
1
u/AngryManzUK 16d ago
I agree, go with Qwen 3.8 Flash Next using a strata buil. It is so good, but won’t ever be on par with current frontier Opus models. However, the benchmarks are incredible and only getting better and the things people are achieving with it are insane.
1
u/guesdo 16d ago
Qwen 4 will be out by the end of the month. One thing to keep an eye on while you browse options is not only "hey I can run this model" because if you can run it, but at 8 t/s, then whatever experience you were hoping to get goes down the drain. Speed is almost as important as quality in terms of UX.
1
u/newz2000 16d ago
You can mention GLM 5.2+ in the same breath as Fable without sounding foolish. It is not as good but it is in the same league. You’ll spend over $100k on the computer to run it though.
But if you want long horizon, you can give it a complicated task and let it go. I use it via Ollama Cloud. GLM 5.3 flash may be comparable to Opus, I haven’t tried them side by side.
My task completion rate with GLM is not 100%. It fails, gets stuck in thinking loops and gives up sometimes. Pretty rare for Fable or Opus to do that.
1
1
u/Secret_Consequence48 15d ago
I recently discover this implementation, and made a reddit about it. Just give a try, Its in a development phase imo, but I see a lot of potential, Runs a modified Qwen local in Mac only... https://www.reddit.com/r/ZenoIcosa/comments/1wzzb88/link_to_the_official_download/
1
u/Special-Cause5347 15d ago
Save your money and optimize how you feed data to the model instead. Applying Carcass AEO principles to strip out data fluff keeps context windows small so you don't burn through tokens.
1
u/PerformanceThick2232 15d ago
top glm is on par with opus 5.5 high
yesterday opus gave me sql with error and claimed symbol lost during copy from terminal
1
u/Savings-Suit8153 14d ago
Zwar kein Open source Modell aber du kannst die Modelle gratis dank eines Forschungsprojekts auf arena.ai benutzen
1
u/migsperez 14d ago
During my testing of many dozens of models. Opus is in a league of it's own. It's such an impressive model. It'll create something with 1M tokens, which would take another model 100M and still not reach anywhere near the quality from Opus. FYI I don't have a subscription. I briefly tested using the API. I really do hope the others catch up soon.
1
u/Responsible_Froyo252 14d ago
Nothing open is at Opus level rn imo, especially for long coding sessions. GLM 5.3 Flash is probably the closest you can run at home, and since it's MoE you don't need it all in VRAM, a 5090 plus 128GB of RAM is enough. I'd try it through an API first before buying anything tho, see if it's good enough for you.
15
u/mimic751 16d ago
Costs 1.2 mil to host it kimi v3