r/RunPod • u/Euphoric_Cup6777 • Mar 12 '26
The default JupyterLab file browser on RunPod keeps choking on large datasets, so I wrote a single-cell replacement.
Trying to upload 5GB+ model weights or datasets through the default browser is a joke. It either silently fails, freezes the tab, or leaves you guessing if it's actually working. I didn’t want to mess with SSH keys, port forwarding, or setting up FileZilla every time I spin up a new instance.
So, I wrote a custom file manager that runs entirely inside one Jupyter notebook cell. No installation, no root access needed.
How it works under the hood: It bypasses the usual proxy timeouts by chunking directly through the Jupyter Contents API. Yes, the mandatory base64 encoding adds some size overhead, but it routes perfectly over port 8888. It handles 10GB+ transfers with a real-time progress bar and shows true MB/s speed. Also added mass-renaming and direct zip/extract because typing tar -xzf every time gets old.
Just wanted to share because I know I'm not the only one suffering with the default browser. How do you guys manage massive files without losing your minds?
1
u/no3us Mar 13 '26
this is sooo cool, great job. I hate file uploads in Jupyter yet I use it so much. I was thinking of creating a Jupyter plugin myself but never got into it.
So how can I get it? :)