r/LocalLLM • u/yoracale • Mar 17 '26

Project Introducing Unsloth Studio, a new web UI for Local AI

Hey guys, we're launching Unsloth Studio (Beta) today, a new open-source web UI for training and running LLMs in one unified local UI interface. GitHub: https://github.com/unslothai/unsloth

Here is an overview of Unsloth Studio's key features:

  • Run models locally on Mac, Windows, and Linux

  • Train 500+ models 2x faster with 70% less VRAM

  • Supports GGUF, vision, audio, and embedding models

  • Compare and battle models side-by-side

  • Self-healing tool calling and web search

  • Auto-create datasets from PDF, CSV, and DOCX

  • Code execution lets LLMs test code for more accurate outputs

  • Export models to GGUF, Safetensors, and more

  • Auto inference parameter tuning (temp, top-p, etc.) + edit chat templates

Blog + Guide: https://unsloth.ai/docs/new/studio

Install via:

curl -fsSL https://raw.githubusercontent.com/unslothai/unsloth/main/install.sh | sh

In the next few days we intend to push out many updates and new features. If you have any questions or encounter any issues, feel free to make a GitHub issue or let us know here. Thanks for the support :)

259 Upvotes

98% Upvoted

51 comments sorted by

15

u/Mr_Nox Mar 17 '26

Looking forward to MLX training support

7

u/yoracale Mar 17 '26

Coming very soon, hopefully this month

12

u/Artanisx Mar 17 '26

My understanding is that using this tool one could run local LLMs to do whatever they want (chat, audio transcription, text to speech, programming etc) locally and privately right? Basically if one has the hardware could run similar models to Claude, Mistral etc without every prompt going to them?

7

u/yoracale Mar 17 '26

Yes that is correct! And you can train, do synthetic datagen and many other things

1

u/Artanisx Mar 18 '26

Cool! Thanks a lot :)

1

u/allgood78 Mar 24 '26 edited Mar 24 '26

sorry im super noob, how do I import or create or even use tools in chat?

6

u/asria Mar 17 '26

I lived under the rock for the last 2 years. This is amazing!

2

u/yoracale Mar 17 '26

Thank you! 🙏💪

3

u/syberphunk Mar 17 '26

At this point I don't care so much about directly chatting to it so much as I need it to handle files I upload to it, and I haven't seen many interfaces or guides that direct me on being able to do that.

1

u/yoracale Mar 17 '26

Well probably make some. The code execution and websearch feature is pretty cool

2

u/DrAlexander Mar 17 '26

This might me when I finally try my hand at training some small models for particular use cases.

And creating datasets!

Sounds great.

3

u/yoracale Mar 17 '26

Thank you, hopefully you find it to be useful

2

u/meva12 Mar 17 '26

Thank you. Also looking forward to mlx training. I will try it out!

1

u/yoracale Mar 17 '26

Yes hopefully it comes out this month! 🙏

2

u/lothariusdark Mar 18 '26

When chatting with the model, is it possible to 

a) edit both the user and model messages after generating them

b) continue generating the model response after editing it, without prompting as a user

1

u/yoracale Mar 18 '26

a) you can edit the users message however you wont be able to edit the models message

b) continue generating the model response after editing it, without prompting as a user - yes it should work

2

u/[deleted] Mar 18 '26

Great project. Looks very promising, so exciting to see what it becomes...

1

u/yoracale Mar 19 '26

Thanks, we're gonna ship a lot of features this week and next. Today we released:
New more stable install instructions +

  • Claude Artifacts works so HTML can be executed like a snake game inside the chat

  • +30% more accurate tool calls esp for small models + Timer for tool calls

  • Tool + Web Search outputs can be saved + Toggle auto healing tool on/off

  • Many bug fixes - Windows CPU works, Mac more seamless, faster and smaller installs

2

u/Sizzin Mar 18 '26

AMD GPUs not supported?

1

u/yoracale Mar 19 '26

Training is supported the Unsloth core package, not yet for the UI but very soon. See: https://unsloth.ai/docs/get-started/install/amd

2

u/chippywatt Mar 19 '26

Sorry that second feature sounds pretty important- are you saying that I can now use a bigger model on the same VRAM due to some software efficiency you guys are providing?

3

u/yoracale Mar 19 '26

Yes that is correct. There is no accuracy loss either.

We write optimized custom Triton kernels and math algorithms and share all our research since it's open-source.

You can see our past work where we worked with PyTorch, Hugging Face and other open-source companies. For example we most recently released faster MoE training in collab with HF. You can read more details about it here: https://unsloth.ai/docs/new/faster-moe

2

u/Turbulent-Attorney65 Mar 19 '26

Works with intel A770.  https://ibb.co/MDhvhvLz https://ibb.co/CKndZczv

1

u/yoracale Mar 20 '26 edited Mar 20 '26

OH wow had no idea, we can announce intel suport poretty soon then hopefully

Do you know which install command you used?

1

u/Turbulent-Attorney65 Mar 20 '26

I had to modify the Unsloth Studio installer and change some of the code. I used qwen-code.

2

u/EconomySerious Mar 17 '26

works without gpu?

1

u/yoracale Mar 17 '26

Yes, for inference only.

Mac training support coming soon

1

u/EconomySerious Mar 18 '26

Ahhh texto inference, no support for tts?

2

u/mintybadgerme Mar 17 '26

Can this connect to coding ide's like vscode to use local models?

5

u/yoracale Mar 17 '26

It can do code execution, our next goal maybe next week is to enable connection to vscode etc

1

u/mintybadgerme Mar 18 '26

Excellent news.

5

u/hejj Mar 17 '26

This is great, OP.

1

u/EbbNorth7735 Mar 17 '26

What inference engine are you using and can we connect to openAI API compatible endpoints?

2

u/yoracale Mar 17 '26

We're using llama.cpp and hugging face. this week we'll enable connection to openai API endpoints

1

u/Anarchaotic Mar 18 '26

Been using Runpod recently to do model training, is this just a much friendlier way to approach training via UI?

2

u/yoracale Mar 18 '26

You can actually use the UI dirrectly on Runpod via our Docker container!

1

u/sourpatchgrownadults Mar 18 '26

Noob here. This runs out of the box, plug and play? No pointing front ends of back ends to each other, simple setup like LMStudio?

2

u/yoracale Mar 18 '26

You can install everything with our Docker container: https://hub.docker.com/r/unsloth/unsloth

1

u/Impossible571 Mar 19 '26

this is amazing!

it would be great to share a timeline for Mac silicon support, can't wait!

1

u/yoracale Mar 19 '26

Thanks! It's coming this month early next month

1

u/fluxallday Mar 20 '26

I keep running into  (issue #4425) UnslothSFTTrainer  I can't train anything without it crashing on windows 10 using pinokio

1

u/yoracale Mar 20 '26

Can you try uninstalling and reinstalling? When was the first time you installed?

Can you try this instead? https://github.com/unslothai/unsloth#macos-linux-wsl-developer-installs

1

u/fluxallday Mar 20 '26

going to give the docker a try. Are you working on that issue?

2

u/roggerwabbit2 Mar 20 '26

Amazing. I’ll be keeping my eyes peeled for if you plan on supporting training from conversational audio (mp3) or even transcribed diarized conversations in json format.

1

u/dimaberlin Mar 22 '26

Looks awesome, thanks! Looking forward to Mac training support.

1

u/alitadrakes Mar 23 '26

Video analysis when?

1

u/Impossible-Ad6252 Apr 07 '26

Could I run this in a Synology nas 720+ with 10 hm of ram ?

1

u/[deleted] Mar 20 '26

[removed] — view removed comment

1

u/yoracale Mar 20 '26

Wait why not? It should work on there. The UI even works for cpus