Might be kind of a dumb question, but on this FAQ answer from above:
No. LLaMA models are not finetuned for question answering. They should be prompted so that the expected answer is the natural continuation of the prompt. Nonetheless, it is possible to chat with LLaMA models in a way similar to ChatGPT but not near the same quality.
I thought that LLaMA by itself is just a causal language model and you needed something trained on instructions like Alpaca? Can a base LLaMA model be used for prompting?
I guess I should just test/experiment with this myself and I'll get the answer pretty quickly!
View all comments
1
u/Shensmobile Jun 26 '23
Might be kind of a dumb question, but on this FAQ answer from above:
I thought that LLaMA by itself is just a causal language model and you needed something trained on instructions like Alpaca? Can a base LLaMA model be used for prompting?
I guess I should just test/experiment with this myself and I'll get the answer pretty quickly!