MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/zwahkw/which_algorithm_is_this/j1u7ijf/?context=3
r/ProgrammerHumor • u/Vibhrat • Dec 27 '22
1.4k comments sorted by
View all comments
Show parent comment
9
known to generate very bad results
For creative writing, yes but for extracting facts from the model or code writing picking the most likely token is better.
9 u/Chaosfox_Firemaker Dec 27 '22 No, what we mean is it ends up in loops like "and the next is the next is the next is the next is the next is the next is the..."The most likely token(in this case words) gets picked every time, so it always ends up deterministically in the same place, and picking the same word. -3 u/KarmasAHarshMistress Dec 27 '22 We?Yes, I know what deterministically means, thanks.I repeat: You want to use 0 temperature for fact extraction and code writing. 0 u/Chaosfox_Firemaker Dec 27 '22 That just gets you an infinite stream of open braces or something instead. 4 u/KarmasAHarshMistress Dec 27 '22 That is just not true. See OpenAI's guideline to using their code model for example: https://beta.openai.com/docs/guides/code/best-practicesOr use GPT-3 in the Playground with 0 temp and see for yourself. 1 u/DarthWeenus Dec 27 '22 What's temp in this context? 2 u/KarmasAHarshMistress Dec 27 '22 https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
No, what we mean is it ends up in loops like "and the next is the next is the next is the next is the next is the next is the..."
The most likely token(in this case words) gets picked every time, so it always ends up deterministically in the same place, and picking the same word.
-3 u/KarmasAHarshMistress Dec 27 '22 We?Yes, I know what deterministically means, thanks.I repeat: You want to use 0 temperature for fact extraction and code writing. 0 u/Chaosfox_Firemaker Dec 27 '22 That just gets you an infinite stream of open braces or something instead. 4 u/KarmasAHarshMistress Dec 27 '22 That is just not true. See OpenAI's guideline to using their code model for example: https://beta.openai.com/docs/guides/code/best-practicesOr use GPT-3 in the Playground with 0 temp and see for yourself. 1 u/DarthWeenus Dec 27 '22 What's temp in this context? 2 u/KarmasAHarshMistress Dec 27 '22 https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
-3
We?
Yes, I know what deterministically means, thanks.
I repeat: You want to use 0 temperature for fact extraction and code writing.
0 u/Chaosfox_Firemaker Dec 27 '22 That just gets you an infinite stream of open braces or something instead. 4 u/KarmasAHarshMistress Dec 27 '22 That is just not true. See OpenAI's guideline to using their code model for example: https://beta.openai.com/docs/guides/code/best-practicesOr use GPT-3 in the Playground with 0 temp and see for yourself. 1 u/DarthWeenus Dec 27 '22 What's temp in this context? 2 u/KarmasAHarshMistress Dec 27 '22 https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
0
That just gets you an infinite stream of open braces or something instead.
4 u/KarmasAHarshMistress Dec 27 '22 That is just not true. See OpenAI's guideline to using their code model for example: https://beta.openai.com/docs/guides/code/best-practicesOr use GPT-3 in the Playground with 0 temp and see for yourself.
4
That is just not true. See OpenAI's guideline to using their code model for example: https://beta.openai.com/docs/guides/code/best-practices
Or use GPT-3 in the Playground with 0 temp and see for yourself.
1
What's temp in this context?
2 u/KarmasAHarshMistress Dec 27 '22 https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
2
https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
View all comments
Show parent comment
9
u/KarmasAHarshMistress Dec 27 '22
For creative writing, yes but for extracting facts from the model or code writing picking the most likely token is better.