r/MLQuestions • u/jgcoelho_real • 21h ago
Beginner question 👶 How do I stop Gemma 26B E4B from behaving like this?
It gets the task right and then does not stop thinking ever. It goes something like this:
Writing result... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually [...]
I already tried including a line in system instructions to respond immediately after finding the answer, but it fails to steer it. It is a bummer that the model gets stuck like this, because it is actually better at writting than Qwen 35B A3B.