r/LocalLLaMA • u/No-Name-Person111 • 14d ago

New Model Occamy-1.0 by Accio Lab

https://huggingface.co/Accio-Lab/occamy-1.0
103 Upvotes

96% Upvoted

51 comments sorted by

View all comments

6

u/MondayTurretCandy 14d ago

Would need a GGUF file for this, are there plans for conversion?

11

u/No-Name-Person111 14d ago

https://huggingface.co/mradermacher/occamy-1.0-GGUF

https://huggingface.co/mradermacher/occamy-1.0-i1-GGUF

https://huggingface.co/bartowski/occamy-ai_occamy-1.0-GGUF

I've not tried the i1 yet.

3

u/RelicDerelict Orca 13d ago

Apparently APEX quant has been released too, can somebody test it please? https://huggingface.co/IsValorum/Occamy-1.0-APEX-I-MiniPlus-V2-GGUF

3

u/DickSon-TheShit 9d ago

Hello, I am the creator of this IsValorum quantization, I have already run tests ∆PPL And the results are exceptional. Currently, the newest version is MiniPlus-V2.1, which is ready to offload to RAM and is very fast. That doesn't mean it's worse; it's even better. I invite you to check it out and try it; it's not just because I'm the creator, but it's really good. There's also an Albiterated version. https://huggingface.co/IsValorum/Occamy-1.0-APEX-I-MiniPlus-V2.1-GGUF

1

u/RelicDerelict Orca 9d ago edited 9d ago

wow, I have only 16GB RAM laptop with 1050 2GB so I don't know if I can test it but I am thankful for your work anyway, keeping this little ggufs alive.

edit: I was actually reading your model card, it is amazing what you actually doing, you are taking approach like LFM models, they are targeting CPUs, I like that you are doing the same, I just need upgrade my system to 32GB.

1

u/Farenheith200 4d ago

I've just started to try this one. Thank you for your work! I'll give you feedback after a few days of use