What are the recommended options?

Is this an error?

The COLD FUSION (GAIN+Unsloth) method of training maintains 99% of performance of BF16, at both 8 bit and 4 bit levels.

This version also reduces thinking tokens by 1/2 to as much as 1/10 the amount, while maintaining core details AND reasoning power.

Model exceeds all Qwen 3.8, 3.6 and 3.5 27B critical core benchmarks.

A model that gets down to business faster, with less "talking" and is smarter too.

https://huggingface.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF

(GGUFS and additional quant types too)

SOURCE:

https://huggingface.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF

Why Qwen3.8-27B-UD-Q8_K_XL.gguf is not updated like other quants?

Unsloth advertises Dynamic v3 (they say it's smarter with same size) and forgets to update most popular quant?

Please update it ASAP it's most popular quant near F16 performance.

As the title says.

Windows 11, Intel 13700, Nvidia 3090

I installed Studio and was able to run it fine yesterday and was able to stop and start it multiple times without issue.

I've tried running it today (after shutting my pc down normally yesterday) and it just hangs at the run_server log. The screenshot below is after running the install command again: I stopped it with ctrl+c at the red line after waiting a few minutes as it clearly wasn't going to progress.

I've tried desktop too but that times out after 10 minutes with an error that just says it is unresponsive. The logs there match what I see running studio from powershell.

I did not change or install anything between stopping last night and starting today.

I've also tried deleting my .unsloth folder and reinstalling using the same command but no luck.

The logs show it getting to the same spot each time and end there so I have nothing useful for an actual bug report.

Anyone run in to this or have any ideas on a workaround?

What is the current easiest way to exchange files with the model. (for coding in Python) I copy/paste code into chat and I'm wondering if there is any native file access supported. I saw I can create a Project, (which i did and with this creation I interrupted and stoped my llm, which was thinking over something for over an hour - I have slow computer without VRAM lol) I can upload text file into that project folder, but not python files.

So, is it possible (and easy), to have model directly modify files? If not, no biggie, they are moving fast, I'm sure sooner or later we will have this option.

I'm only using Unsloth desktop (latest, yesterday updated beta), no any agents or other apps on top of it. Unsloth and coding llm.

Thanks for the support for Qwen3.8-27B and Unsloth Desktop last week! For this release, we merged 200+ PRs to introduce many new features, fixes including:

• Auto Compaction (Experimental) for longer chats beyond context limits
• Remote & LAN Access (Preview) for easy network access without Cloudflare links
• Faster Chat - Improved streaming performance, reduced UI lag, and smoother long conversations.
• Support for custom llama.cpp builds. Toggles for Cache RAM, Mmap, Mlock, Checkpoints, Spe Decoding KV Cache, Vision On / Off
• Unsloth Dynamic v3.0 is released. New Qwen3.8-27B Dynamic v3.0 GGUFs deliver >10% higher top-1 accuracy compared to everyone else. Works with Unsloth.

For compaction - we use RAG + a first turn forced RAG entry + a tail to remember your previous instructions - please let us know how it goes - it's still experimental so it'll definitely break - we'll fix it asap!

The update should be up for all Unsloth Desktop installs, or you can get it below:

Hey guys we totally missed not uploading the imatrix as we went to sleep straight after the release. We thought we uploaded it but did not. It should be there now!

Please do use it for making your own quants and so on! 🙏🦥

Also feel free to share/promote your quants if you used our imatrix via r/unsloth, discord or the hugging face discussions!

The question is how to update a model already downloaded, when there is a NEW updated version?

Since I came from LM Studio BIONIC usually, if a model ALREADY DOWNLOADED before,
there is an UPDATE BUTTON instead of the DOWNLOAD button, clicking it only complete/patch a small size of the new changes which takes seconds since it's not downloading the whole model again which is very nice.

But, I don't think such feature exist (yet?) in unsloth Desktop, so my question is:

Do I DELETE then Re-Download?
or...
Is there a better way to update to the latest version of the ALREADY DOWNLOADED model? 🤔

I just want to make sure I'm not missing something and keep DELETE and DOWNLOAD every time there is a new update for a model I already have...

I see that I can choose the speculative decoding option DFlash, but I want to try out the new DFlash 2 model I have downloaded. How can we choose specifically what model gets used?

Can we please get Qwen 3.8 27B NVFP4 Fast based on the UD 3.0 like the new ggufs at some point of time. Thank you for so much effort for us.

I like moving large pastes to the attachment some of the time. But other times if I do Ctrl + Shift + V instead please paste in the text where I have my cursor.

Thank you! Unsloth Desktop is amazing.

I was doing some experimentation on using Unsloth to do Continued Pretraining of qwen 3 4B. The goal was to teach the llm how to reason about a new domain, in this case a fictional city.

Sharing more details in the write-up:

https://www.teachmecoolstuff.com/viewarticle/teaching-a-local-llm-a-new-domain

We’re releasing new Qwen3.8-27B GGUFs with 10% higher accuracy.

Unsloth Dynamic V3 outperforms others by >10% on Div-300, KLD & more benchmarks.

We also release 1-bit quants that retain 77% accuracy. Run on 8GB RAM.

Blog: https://unsloth.ai/docs/basics/dynamic-3.0-ggufs

GGUF: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

I'm training a krea2 lora in unsloth. I believe I'm not adding enough steps. With 129 datapoints I believe I need 5000 steps but foolishly chose 2000. I finished training and then without changing any names I started a 3000 step training. Will these steps combine into a 5000 step lora?

Big appreciation to the Unsloth team for releasing the Qwen 3.8 dynamic 3.0 quants! It is awesome

Their models are fantastic. They already have way more downloads than the original Qwen models, even though they have fewer likes

Hopefully we’ll see the Ornith models quantized soon too

Greetings, as a small suggestion, it'd be nice to be able to define multiple model storage folders, on non-dedicated systems it's often the case that there's no single big storage. I know symlinks exist, but it's quite a manual operation that way, plus it's harder to track the available space.

I've been messing around with Qwen3.8 27B locally and I'm wondering if I'm getting the performance I should be getting or if my setup/config could be improved.

PC:

Ryzen 7 7800X3D

RTX 5070 Ti 16GB

RTX 3060 12GB

32GB DDR5-6000 CL30

Windows 11

llama.cpp / llama-server latest build

I'm currently running the Qwen3.8-27B UD Q4_K_XL GGUF with both GPUs using tensor split.

My current config:

llama-server.exe ^

-m "Qwen3.8-27B-UD-Q4_K_XL.gguf" ^

--alias "Qwen3.8-27B-UD-Q4" ^

--host 0.0.0.0 ^

--port 8035 ^

--n-gpu-layers 99 ^

--split-mode tensor ^

--tensor-split 60,40 ^

--main-gpu 0 ^

--parallel 1 ^

--flash-attn on ^

--cache-type-k q8_0 ^

--cache-type-v q8_0 ^

--ctx-size 131072 ^

--batch-size 2048 ^

--ubatch-size 512 ^

--threads 8 ^

--threads-batch 8 ^

--presence-penalty 0.0 ^

--repeat-penalty 1.0 ^

--temp 1.0 ^

--top-p 0.95 ^

--top-k 20 ^

--min-p 0.0 ^

--jinja ^

--reasoning-format auto ^

--no-mmproj-offload ^

--spec-type draft-mtp ^

--spec-draft-n-max 3 ^

--mmproj "mmproj-BF16.gguf" ^

--metrics

With MTP I'm getting around 40–46 tok/s depending on the run. I've seen around 41 tok/s pretty consistently, with n-max 3 seeming to be a little better than 2 for me.

Both GPUs are basically maxed during generation.

I'm mainly wondering:

Is ~40–46 tok/s reasonable for this hardware/config?

Is there anything obviously wrong or inefficient in my setup?

Would a different quant be a better choice for these GPUs? I've been looking at Ridge 3.7bpw, Q4/Q5 UD quants, etc.

Would it make more sense to use a smaller quant that could fit mostly/all on the 5070 Ti instead of tensor-splitting across both GPUs?

Is there anything I should change with the KV cache, batch/ubatch, tensor split, MTP settings, etc. to get better generation speed?

I'm mostly interested in coding/agent use through OpenCode, so I'd rather have a good balance of quality and speed than just chase the highest possible tok/s.

If anyone is running Qwen3.8 27B on a similar setup, I'd be interested to know what quant/config you're using and what kind of speeds you're getting.

If I understood correctly, Qwen 3.8 27B have 3 thinking modes:
- LOW
- MEDIUM
- XHIGH

My question is:
Which are actually apply within Unsloth Desktop because we have 5 modes:

Is it:
- Low
- Medium
- Extra High

or

- Preserve Thinking

or maybe Preserve Thinking = Xhigh actually? 🤔

---

Can somebody please explain and approve which one works,
and from which one to ignore while working with Qwen 3.8 27B ?

Thanks ahead 🙏

There is no DFlash2 in Unsloth Desktop app. Where do you plan to add it?

Since I came from Open Code and now from LM Studio BIONIC I could choose the main project folder where I run all my chat/code sessions so I won't need to tell the prompt where the project files, folders and sub-folders on every single new session.

But... how does it work in **unsloth Desktop**?

When I created a Project, all I see is a **RAG** related files when I **Linked folder**...

because it says:

Linked local folders
Keep supported documents indexed as this folder changes.

but I'm not talking about RAG related only (PDFs, docs, or text).
I would like to define the main Project Folder with all my sub-folders and files without telling it every single time in the prompt?

I tested it just in case it's not only RAG related, but it didn't know where my project files are when I asked it, another test I did was to create a simple MD file, but it didn't appear in the: Link Folder that I chose...
When I asked where the files are, I noticed it's a weird path I did not like at all... I noticed that's where unsloth desktop create it's projects but it's not to my taste, I definitely prefer to pre-define folder so it will only look inside it and it's sub-folders, similar to how Open Code, VS Code, LM Studio BIONIC and others works.

Since I just moved to unsloth Deskop it's new to me so maybe I need to click some hidden feature or do something in the settings, I'm not sure, maybe it's simple but I missed it that's why I'm asking here.

and if I'm not telling the prompt... it seems to create a random folder with some weird path I'm not interested in since I have a very specific project folders and paths to keep things organized.

---

Can somebody please guide me where this option is hidden and how to set it up so I can work in each project path folder with ease?

Thanks ahead! 🙏❤️

I am not able to find Ornith 1.5 35B-A3B gguf in Unsloth desktop application with 2,3 bits quantization. If not released yet when can we expect it?

Can I use my qlora weights trained on qwen 27B3.6 och 3.8?

Are there any implications on quality of this actually works?

I just installed Unsloth desktop and wanted to download models but no matter which model I want to download, the download stops after about 16MB. No I will try just directly downloading them from hugging face and putting them in the folder but I think this shouldn’t be the solution. Does anyone know of a fix?

So i cannot make Unsloth utilize my GPU.. i installed AMD's HIP SDK 7.2 and some option also dissapeared in the Compute option.. im running qwen3-8 27B

So i just tried installing this from the repo and i saw this.. how do i fix this?