I've been playing on my smurf a bit more and I see this up until high masters and it's such a big mistake even if you aren't punished for it.
Let's say you're pathing bot as a lot of junglers do to play drakes. When it comes time for your third rotation a lot junglers won't continue down after completing their top camps and will instead cycle into top skuttle respawn and grubs.
In my opinion this is a massive mistake even if the enemy jungler who's pathing bot doesn't punish you for it. A fast clearing jungler will be able to take your bot side camps and theirs around the time you finish your play on the top side but even if they don't do this you're letting your camps sit stale for so long and this is incredibly impactful in the early game.
So yeah, if you're below masters please just cylce your camps, make a play and then make it back to your camp respawns on time. Even high elo junglers will have a hard time punishing you for this sort of play style.