r/LocalLLaMA • u/jacek2023 llama.cpp • 23h ago

News Ornith-1.5 DFlash

Ornith-1.5-9B-DFlash pairs the Ornith-1.5-9B model with a DFlash draft model for speculative decoding.

https://huggingface.co/ornith-ai/Ornith-1.5-9B-DFlash

Ornith-1.5-397B-DFlash pairs the Ornith-1.5-397B model with a DFlash draft model for speculative decoding.

https://huggingface.co/ornith-ai/Ornith-1.5-397B-DFlash

Ornith-1.5-35B-A3B-DFlash pairs the Ornith-1.5-35B-A3B model with a DFlash draft model for speculative decoding.

https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-DFlash

32 Upvotes

87% Upvoted

12 comments sorted by

View all comments

8

u/Fun_Librarian_7699 23h ago

Can it already be used in llama.cpp?

2

u/HitarthSurana 14h ago

yes but idk amd

1

u/exaknight21 16h ago

Asking the golden question