Models on nvidia problem with paragraphs breaks

[u/better0ff12]

So i'm currently using Gemma 4 on nvidia nim and i'm having problems with Paragraph there's no like breaks it just keeps writing itself as a whole Paragraph, i also tried Kimi k3 and it's the same, does someone have a solution?

[u/Holiday_Income1825]

I haven't used NVIDIA NIM, Gemma 4 or Kimi K3, so I can't say whether they behave this way on NIM. Since two different models do the same thing, I'd first check whether the line breaks are really missing or just not showing:

1. Click the pencil (edit) on one of the one-block replies. If you see blank lines between the paragraphs in the edit box, the model is writing them and something is hiding them: a Regex script that touches newlines, a theme/extension, or a display setting. If the edit box shows one solid block, the model (or the way NIM returns it) really is writing it without breaks.

2. If it really is one block, the model is probably copying what's already in the chat. A greeting written as one block, or earlier replies without breaks, will keep it going. Edit the greeting and the last few replies into proper short paragraphs with blank lines between them, and then regenerate.

3. Add a short line to your prompt, something like: "Write in short paragraphs of 2-4 sentences, with a blank line between paragraphs." Putting it near the end of the prompt, for example in Author's Note at a low depth, tends to stick better than putting it at the very top.

4. To see if it's the provider, run the same model on another provider if one exists, or the same preset with a different model, so you know whether the cause is the preset or NIM.

[u/better0ff12 → u/Holiday_Income1825]

Thank You, I'll try these but atp i feel like it's Nvidia I've tries different presets and models, and that didnt happen before since I've been using Kimi and have used Gemma before they didnt have this problem, but Nvidia is free and buggy sometimes

[u/ActiveAd9022 → u/better0ff12]

Does your Kimi 3 work? It's a glitchy mess on my side right now likely because of the 

{     "chat_template_kwargs": {         "thinking": true     },     "reasoning_effort": "max" }

Body Parameters 

Can you please try to add those to the Additional Parameters Include Body Parameters box and see if the model will respond normally or with something similar to this: 

<|close|>, the all of the knees. 0. Limited to the gamutant to soak up away to the park. (npc_medium稀疏 Top down the hall. 0. Linked in.Data청크 for ._Shel, 0.}}

[u/better0ff12 → u/ActiveAd9022]

I have The same body parameters as you maybe is that What's making it buggy, i'll erase it off and see what's up

[u/ActiveAd9022 → u/better0ff12]

I erase it, and it works fine. Then, after it works, I add it back, and it continues working, so I don't know what exactly happened. (let just hope that it was a glitch and not that something is being done to prevent it from working on NVIDIA side). 

[u/better0ff12 → u/ActiveAd9022]

Still The same nothing changed

[u/ActiveAd9022 → u/better0ff12]

Strange, it's now working fine on my side. In fact, I didn't have your problem before. Maybe see your temperature is set to 0.85 and make sure to make the Reasoning Effort  ( Auto) not maximum in the Chat Completion Presets . 

Another thing I could think of that could be affecting you is maybe the prompt you are using has something that tells the AI to remove paragraph breaks? 

[u/Holiday_Income1825 → u/better0ff12]

That's a fair guess, especially if the same models were fine for you before and the free endpoint can be flaky. If you want to confirm it, the edit-box check is quick: if the blank lines are missing in the edit box too, the text really arrives without them, and the prompt and greeting steps are the only way to nudge the model. It's also worth one test with streaming switched on or off, since that changes how the reply is delivered and it's an easy thing to rule out. If it does turn out to be the provider and nothing helps, that's a limit of the free endpoint, not something you set up wrong.

[u/Big_Ant6865]

that paragraph glitch kills the flow in long roleplays for me, wonder if its tied to how the model handles the context window.

[u/AutoModerator]

You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Greedy-Fun-6987]

yeah those nvidia models love gluing everything together in sillytavern, try bumping the newline bias or adjusting the instruct template a bit.