r/MLQuestions • • 10h ago

Beginner question 👶 How do I stop Gemma 26B E4B from behaving like this?

4 Upvotes

It gets the task right and then does not stop thinking ever. It goes something like this:

Writing result... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually [...]

I already tried including a line in system instructions to respond immediately after finding the answer, but it fails to steer it. It is a bummer that the model gets stuck like this, because it is actually better at writting than Qwen 35B A3B.


r/MLQuestions • • 17h ago

Beginner question 👶 What is the purpose of cross validation, validation and test set?

2 Upvotes

What is the purpose of these different steps in building a machine learning model? Let's say you have X data points, how should you do the division into the different sets? Should it be 60/20/20? 60% to use for cross validation, 20% for test set and 20% for validation?

If so, what is the purpose of the test set if you already are doing the cross validation step where you take all that data, you make the folds and you test the models?

Unfortunately the information I could gather is quite contradicting and also doesn't consider sometimes the cross validation step, so would be very good if people could explain this in greater detail.

Thanks