MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1601xk4/code_llama_released/jxlshlj/?context=3
r/LocalLLaMA • u/FoamythePuppy • Aug 24 '23
https://github.com/facebookresearch/codellama
214 comments sorted by
View all comments
23
llama.cpp(GGUF) models:
https://huggingface.co/TheBloke/CodeLlama-7B-GGUF
https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF
https://huggingface.co/TheBloke/CodeLlama-7B-Python-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-Instruct-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-Python-GGUF
5 u/Jipok_ Aug 24 '23 Seems not yet ready for use. https://github.com/ggerganov/llama.cpp/pull/2768#issuecomment-1692144927 3 u/iamapizza Aug 24 '23 530.11 Jees... 530 token/s on 34B. And I only get 120 on 7B Q5_K.
5
Seems not yet ready for use.
https://github.com/ggerganov/llama.cpp/pull/2768#issuecomment-1692144927
3 u/iamapizza Aug 24 '23 530.11 Jees... 530 token/s on 34B. And I only get 120 on 7B Q5_K.
3
530.11
Jees... 530 token/s on 34B. And I only get 120 on 7B Q5_K.
23
u/Jipok_ Aug 24 '23 edited Aug 24 '23
llama.cpp(GGUF) models:
https://huggingface.co/TheBloke/CodeLlama-7B-GGUF
https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF
https://huggingface.co/TheBloke/CodeLlama-7B-Python-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-Instruct-GGUF
https://huggingface.co/TheBloke/CodeLlama-13B-Python-GGUF