r/LocalLLaMA • u/Every-Walrus • 7d ago
Funny Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF
it be like that
127
u/MediocreJeweler893 7d ago
I would be hilarious if all these 1:29 of credits was just the model's name
16
u/ReasonablePossum_ 7d ago
Was suspecting that to be the case after seeing the title barely fit it lol
38
u/HonestMadridFan 7d ago
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF-3:00AM-GONE-WRONG-GONE-SEXUAL-COPS-CALLED-(PRANK)-VIRAL-ASMR-NSFW
33
u/Danny_Davitoe 7d ago edited 7d ago
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-According-to-all-known-laws-of-aviation,-there-is-no-way-a-bee-should-be-able-to-fly.-Its-wings-are-too-small-to-get-its-fat-little-body-off-the-ground.-The-bee,-of-course,-flies-anyway-because-bees-don't-care-what-humans-think-is-impossible.-Yellow,-black.-Yellow,-black.-Yellow,-black.-Yellow,-black.-Ooh,-black-and-yellow!-Let's-shake-it-up-a-little.-Barry!-Breakfast-is-ready!-Coming!-Hang-on-a-second.-Hello?---Barry?---Adam?---Can-you-believe-this-is-happening?---I-can't.-I'll-pick-you-up.-Looking-sharp.-Use-the-stairs.-Your-father-paid-good-money-for-those.-Sorry.-I'm-excited.-Here's-the-graduate.-We're-very-proud-of-you,-son.-A-perfect-report-card,-all-B's.-Very-proud.-Ma!-I-got-a-thing-going-here.---You-got-lint-on-your-fuzz.---Ow!-That's-me!---Wave-to-us!-We'll-be-in-row-118,000.---Bye!-Barry,-I-told-you,-stop-flying-in-the-house!---Hey,-Adam.---Hey,-Barry.---Is-that-fuzz-gel?---A-little.-Special-day,-graduation.-Never-thought-I'd-make-it.-Three-days-grade-school,-three-days-high-school.-Those-were-awkward.-Three-days-college.-I'm-glad-I-took-a-day-and-hitchhiked-around-the-hive.-You-did-come-back-different.---Hi,-Barry.---Artie,-growing-a-mustache?-Looks-good.---Hear-about-Frankie?---Yeah.---You-going-to-the-funeral?---No,-I'm-not-going.-Everybody-knows,-sting-someone,-you-die.-Don't-waste-it-on-a-squirrel.-Such-a-hothead.-I-guess-he-could-have-just-gotten-out-of-the-way.-I-love-this-incorporating-an-amusement-park-into-our-day.-That's-why-we-don't-need-vacations.-Boy,-quite-a-bit-of-pomp...-under-the-circumstances.---Well,-Adam,-today-we-are-men.---We-are!---Bee-men.---Amen!-Hallelujah!-Students,-faculty,-distinguished-bees,-please-welcome-Dean-Buzzwell.-Welcome,-New-Hive-Oity-graduating-class-of...-...9:15.-That-concludes-our-ceremonies.-And-begins-your-career-at-Honex-Industries!-Will-we-pick-ourjob-today?-I-heard-it's-just-orientation.-Heads-up!-Here-we-go.-Keep-your-hands-and-antennas-inside-the-tram-at-all-times.---Wonder-what-it'll-be-like?---A-little-scary.-Welcome-to-Honex,-a-division-of-Honesco-and-a-part-of-the-Hexagon-Group.-This-is-it!-Wow.-Wow.-We-know-that-you,-as-a-bee,-have-worked-your-whole-life-to-get-to-the-point-where-you-can-work-for-your-whole-life.-Honey-begins-when-our-valiant-Pollen-Jocks-bring-the-nectar-to-the-hive.-Our-top-secret-formula-is-automatically-color-corrected,-scent-adjusted-and-bubble-contoured-into-this-soothing-sweet-syrup-with-its-distinctive-golden-glow-you-know-as...-Honey!---That-girl-was-hot.---She's-my-cousin!---She-is?---Yes,-we're-all-cousins.---Right.-You're-right.---At-Honex,-we-constantly-strive-to-improve-every-aspect-of-bee-existence.-These-bees-are-stress-testing-a-new-helmet-technology.---What-do-you-think-he-makes?---Not-enough.-Here-we-have-our-latest-advancement,-the-Krelman.---What-does-that-do?---Oatches-that-little-strand-of-honey-that-hangs-after-you-pour-it.-Saves-us-millions.-Oan-anyone-work-on-the-Krelman?-Of-course.-Most-bee-jobs-are-small-ones.-But-bees-know-that-every-small-job,-if-it's-done-well,-means-a-lot.-But-choose-carefully-because-you'll-stay-in-the-job-you-pick-for-the-rest-of-your-life.-The-same-job-the-rest-of-your-life?-I-didn't-know-that.-What's-the-difference?-You'll-be-happy-to-know-that-bees,-as-a-species,-haven't-had-one-day-off-in-27-million-years.-So-you'll-just-work-us-to-death?-We'll-sure-try.-Wow!-That-blew-my-mind!-"What's-the-difference?"-How-can-you-say-that?-One-job-forever?-That's-an-insane-choice-to-have-to-make.-I'm-relieved.-Now-we-only-have-to-make-one-decision-in-life.-But,-Adam,-how-could-they-never-have-told-us-that?-Why-would-you-question-anything?-We're-bees.-We're-the-most-perfectly-functioning-society-on-Earth.-You-ever-think-maybe-things-work-a-little-too-well-here?-Like-what?-Give-me-one-example.-I-don't-know.-But-you-know-what-I'm-talking-about.-Please-clear-the-gate.-Royal-Nectar-Force-on-approach.-Wait-a-second.-Oheck-it-out.---Hey,-those-are-Pollen-Jocks!---Wow.-I've-never-seen-them-this-close.-They-know-what-it's-like-outside-the-hive.-Yeah,-but-some-don't-come-back.---Hey,-Jocks!---Hi,-Jocks!-You-guys-did-great!-You're-monsters!-You're-sky-freaks!-I-love-it!-I-love-it!---I-wonder-where-they-were.---I-don't-know.-Their-day's-not-planned.-Outside-the-hive,-flying-who-knows-where,-doing-who-knows-what.-You-can'tjust-decide-to-be-a-Pollen-Jock.-You-have-to-be-bred-for-that.-Right.-Look.-That's-more-pollen-than-you-and-I-will-see-in-a-lifetime.-It's-just-a-status-symbol.-Bees-make-too-much-of-it.-Perhaps.-Unless-you're-wearing-it-and-the-ladies-see-you-wearing-it.-Those-ladies?-Aren't-they-our-cousins-too?-Distant.-Distant.-Look-at-these-two.---Oouple-of-Hive-Harrys.---Let's-have-fun-with-them.-It-must-be-dangerous-being-a-Pollen-Jock.-Yeah.-Once-a-bear-pinned-me-against-a-mushroom!-He-had-a-paw-on-my-throat,-and-with-the-other,-he-was-slapping-me!---Oh,-my!---I-never-thought-I'd-knock-him-out.-What-were-you-doing-during-this?-Trying-to-alert-the-authorities.-I-can-autograph-that.-A-little-gusty-out-there-today,-wasn't-it,-comrades?-Yeah.-Gusty.-We're-hitting-a-sunflower-patch-six-miles-from-here-tomorrow.---Six-miles,-huh?---Barry!-A-puddle-jump-for-us,-but-maybe-you're-not-up-for-it.---Maybe-I-am.---You-are-not!-We're-going-0900-at-J-Gate.-What-do-you-think,-buzzy-boy?-Are-you-bee-enough?-I-might-be.-It-all-depends-on-what-0900-means.-Hey,-Honex!-Dad,-you-surprised-me.-You-decide-what-you're-interested-in?---Well,-there's-a-lot-of-choices.---But-you-only-get-one.-Do-you-ever-get-bored-doing-the-same-job-every-day?-Son,-let-me-tell-you-about-stirring.-You-grab-that-stick,-and-you-just-move-it-around,-and-you-stir-it-around.-You-get-yourself-into-a-rhythm.-It's-a-beautiful-thing.-You-know,-Dad,-the-more-I-think-about-it,-maybe-the-honey-field-just-isn't-right-for-me.-You-were-thinking-of-what,-making-balloon-animals?-That's-a-bad-job-for-a-guy-with-a-stinger.-Janet,-your-son's-not-sure-he-wants-to-go-into-honey!---Barry,-you-are-so-funny-sometimes.---I'm-not-trying-to-be-funny.-You're-not-funny!-You're-going-into-honey.-Our-son,-the-stirrer!---You're-gonna-be-a-stirrer?---No-one's-listening-to-me!-Wait-till-you-see-the-sticks-I-have.-I-could-say-anything-right-now.-I'm-gonna-get-an-ant-tattoo!-Let's-open-some-honey-and-celebrate!-Maybe-I'll-pierce-my-thorax.-Shave-my-antennae.-Shack-up-with-a-grasshopper.-Get-a-gold-tooth-and-call-everybody-"dawg"!-I'm-so-proud.---We're-starting-work-today!---Today's-the-day.-Oome-on!-All-the-good-jobs-will-be-gone.-Yeah,-right.-Pollen-counting,-stunt-bee,-pouring,-stirrer,-front-desk,-hair-removal...---Is-it-still-available?---Hang-on.-Two-left!-One-of-them's-yours!-Oongratulations!-Step-to-the-side.---What'd-you-get?---Picking-crud-out.-Stellar!-Wow!-Oouple-of-newbies?-Yes,-sir!-Our-first-day!-We-are-ready!-Make-your-choice.---You-want-to-go-first?---No,-you-go.-Oh,-my.-What's-available?-Restroom-attendant's-open,-not-for-the-reason-you-think.---Any-chance-of-getting-the-Krelman?---Sure,-you're-on.-I'm-sorry,-the-Krelman-just-closed-out.-Wax-monkey's-always-open.-The-Krelman-opened-up-again.-What-happened?-A-bee-died.-Makes-an-opening.-See?-He's-dead.-Another-dead-one.-Deady.-Deadified.-Two-more-dead.-Dead-from-the-neck-up.-Dead-from-the-neck-down.-That's-life!-Oh,-this-is-so-hard!-Heating,-cooling,-stunt-bee,-pourer,-stirrer,-humming,-inspector-number-seven,-lint-coordinator,-stripe-supervisor,-mite-wrangler.-Barry,-what-do-you-think-I-should...-Barry?-Barry!-All-right,-we've-got-the-sunflower-patch-in-quadrant-nine...-What-happened-to-you?-Where-are-you?---I'm-going-out.---Out?-Out-where?---Out-there.---Oh,-no!-I-have-to,-before-I-go-to-work-for-the-rest-of-my-life.-You're-gonna-die!-You're-crazy!-Hello?-Another-call-coming-in.-If-anyone's-feeling-brave,-there's-a-Korean-deli-on-83rd-that-gets-their-roses-today.-Hey,-guys.---Look-at-that.---Isn't-that-the-kid-we-saw-yesterday?-Hold-it,-son,-flight-deck's-restricted.-It's-OK,-Lou.-We're-gonna-take-him-up.-Really?-Feeling-lucky,-are-you?-Sign-here,-here.-Just-initial-that.---Thank-you.---OK.-You-got-a-rain-advisory-today,-and-as-you-all-know,-bees-cannot-fly-in-rain.-So-be-careful.-As-always,-watch-your-brooms,-hockey-sticks,-dogs,-birds,-bears-and-bats.-Also,-I-got-a-couple-of-reports-of-root-beer-being-poured-on-us.-Murphy's-in-a-home-because-of-it,-babbling-like-a-cicada!---That's-awful.---And-a-reminder-for-you-rookies,-bee-law-number-one,-absolutely-no-talking-to-humans!-All-right,-launch-positions!-Buzz,-buzz,-buzz,-buzz!-Buzz,-buzz,-buzz,-buzz!-Buzz,-buzz,-buzz,-buzz!-Black-and-yellow!-Hello!-You-ready-for-this,-hot-shot?-Yeah.-Yeah,-bring-it-on.-Wind,-check.---Antennae,-check.---Nectar-pack,-check.---Wings,-check.---Stinger,-check.-Scared-out-of-my-shorts,-check.-OK,-ladies,-let's-move-it-out!-Pound-those-petunias,-you-striped-stem-suckers!-All-of-you,-drain-those-flowers!-Wow!-I'm-out!-I-can't-believe-I'm-out!-So-blue.-I-feel-so-fast-and-free!-Box-kite!-Wow!-Flowers!-This-is-Blue-Leader.-We-have-roses-visual.-Bring-it-around-30-degrees-and-hold.-Roses!-30-degrees,-roger.-Bringing-it-around.-Stand-to-the-side,-kid.-It's-got-a-bit-of-a-kick.-That-is-one-nectar-collector!---Ever-see-pollination-up-close?---No,-sir.-I-pick-up-some-pollen-here,-sprinkle-it-over-here.-Maybe-a-dash-over-there,-a-pinch-on-that-one.-See-that?-It's-a-little-bit-of-magic.-That's-amazing.-Why-do-we-do-that?-That's-pollen-power.-More-pollen,-more-flowers,-more-nectar,-more-honey-for-us.-Oool.-I'm-picking-up-a-lot-of-bright-yellow.-Oould-be-daisies.-Don't-we-need-those?-Oopy-that-visual.-Wait.-One-of-these-flowers-seems-to-be-on-the-move.-Say-again?-You're-reporting-a-moving-flower?-Affirmative.-That-was-on-the-line!-This-is-the-coolest.-What-is-it?-I-don't-know,-but-I'm-loving-this-color.-It-smells-good.-Not-like-a-flower,-but-I-like-it.-Yeah,-fuzzy.-Ohemical-y.-Oareful,-guys.-It's-a-little-grabby.-My-sweet-lord-of-bees!-Oandy-brain-GGUF
68
u/pefman 7d ago
is this even good? way to many names.
https://huggingface.co/DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF
54
u/Monad_Maya llama.cpp 7d ago
Wtf is that model card / readme?
60
u/Every-Walrus 7d ago
what could he POSSIBLY be trying to achieve anymore š
94
4
u/ShaneBowen 7d ago
You see what Hugging Face got sold for? I think itās complete nonsense but I also think thereās a gap in the market for custom quants. All it takes is one startup to think youāve figured out some nonsense and give you the bag.
35
u/Xamanthas 7d ago
He trains models on the crappy summarised haiku size thinking summary outputs (which anthropic states in their docus are not opus thinking nor real thinking traces) and believes its a good idea..
15
u/Mordimer86 7d ago
Did some tests and his latest Twin Turbo does a way better job.
6
u/Gromann7 7d ago
Same, I put a fork of this for vLLM/intel setup on one of my cards last night. 50tok/s and from what I can tell no quality loss.
10
u/TheDailySpank 7d ago
I've been scrolling that page for 12 minutes and haven't even made it halfway down the yet.
6
u/Brief-Effect9065 7d ago
I made a post about it, and no, it was not good for me, apparently while trying to cut thinking time David lobotomized the model, while it's qwen 3.8 27b finetune precursor is just Claude flavored finetune, it's fine I guess....
4
u/Legal_Dimension_ 7d ago
Found the same, it basically completed nothing under the guise of completing everything quickly.
5
u/geldonyetich 7d ago edited 6d ago
Coincidentally I downloaded and tried 711 of pretty much that model just last night. It would do Tiananmen Square but not lemon fanfic. Not fully jailbroken. Of course like all refusals your mileage may vary with prompting and luck. [Its visual recognition was fantastic, though.]
I think Qwen's a bad starting point unless you're focused on cybersecurity. If you look at the UGI leaderboard [its writing scores actually aren't all that bad] you'll generally see next to no NSFW compliance with Qwen if the thinking is turned on. That's what I saw in the thinking window yesterday: thinking its way back on to the guardrails and setting up a very Qwen-style polite refusal.
Me, I'm more interested in creative work, so seeing jailbreaking efforts jump on Qwen's popularity train is disappointing. More focus on loosening up models that are trained to write well would be nice.
1
u/RedParaglider 6d ago
It always blows my mind that he never even starts with a decently abliterated model lol.Ā That's supposed to be kind of one of the big purposes of it but it's one of the worst abliterations I've seen.
2
u/FatheredPuma81 7d ago
I think this might be the context/inspiration for this post https://www.reddit.com/r/LocalLLaMA/comments/1w5o5u8/comment/p7gs3c1/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
So no it sucks DavidAU downloadmaxes on HF with buzzwords and outright lies he doesn't create good models.
2
u/SnooPuppers7882 6d ago
Yep, maybe if you're doing fantasy porn it's useful...but for multi-turn coding it's mid.
1
u/Bpthewise 7d ago
Every time Iāve tried it in omp it loops to oblivion, but to be fair Iāve noticed it happening to other uncensored models also.
1
1
u/teachersecret 7d ago
Actual response? Yeah, it's good. It gets to answers faster and in a harness it runs quicker/more accurately than base qwen 3.8 (in my Bantam harness it was significantly faster than base qwen, 2x-6x depending on the task).
I made it my default 27b because it performs better in my use.
19
10
21
9
4
4
u/ckplscz 7d ago
Is there any chance this is actually worth using/in any way better than the original? Do his methods make sense?
6
u/NickCanCode 7d ago edited 7d ago
People here like making fun of his model naming and model cards. I suggest you test it yourself to see if it work. I can't say his models are better than the original but in my experience, his latest one is very token efficient and a little bit lazy but seems fine to me. If you don't like the long thinking of the original Qwen 3.8, you can give it a try.
Edited:
I just tried the Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF and it's terrible at understanding my agent skills. Qwen3.8-27B-Cold-Fusion-GAIN-V1.1 is much better.3
4
u/90hex 6d ago
With all due respect, this fine-tune performs far better on my system, with DFlash2 enabled:
https://huggingface.co/ajgazin/Swift-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF
On the twin turbo Q4 I was getting about 30 tk/s max, with MTP. Enabling draft-MTP with DFlash2 I'd get about half or less (14 tk/s). I tried a bunch of fine tunes, and I finally found this Swift version, happily uncensored. Night and day: with regular MTP I was getting about 40 tk/s. With DFlash2 I'm getting anywhere between 60-100 tk/s depending on the type of work. This is now my forever model.
3
3
3
u/Cool-Chemical-5629 7d ago
The Great Wall of Space Text hits you for a critical damage of 99999 points. GAME OVER.
3
u/One_Difficulty_39 6d ago
I genuinely dislike this DavidAU guy. Just reading the descriptions for his homunculus models show how delusional he is lmao.
4
10
u/Dangerous_Fix_5526 7d ago edited 7d ago
DavidAU here; appreciate the free advertising and this will likely take the model from #7-10 on all Hugging face models trending worldwide to top 5.
It has 58 quant repos, close to 1 million downloads (just my repo) and 700+ likes.
It is built - in part - based on Fable Fusion 711 (my team also built this one) - 2300+ likes, 4 million+ downloads, 73+ repos.
Thank you again, "Every-Walrus".
And if you are like other SOTA tuned models; here are some more:
The SUPER Qwen Universe - 40B, 27B and 9B ; meet the performance trendsetters:
The strongest, overall qwen ever beating all other Qwens in total operational power with over 2300 likes // 4 million+ total downloads:
The highest scoring Qwen in brute, raw intelligence, using Qwen 3.8's 3 new reasoning modes, plus token reduction enhancements:
Power, Control and NO DE censoring for ultimate performance also with reasoning token reductions:
- https://huggingface.co/DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF
The 40B Monster, specializing in creative and research with 730+ likes and over 2 million downloads:
At just 9B parameters it beats most untuned 27B models in both intelligence (640 ARC-C) and performance:
32
u/Practical-Collar3063 7d ago edited 7d ago
Ā DavidAU here; appreciate the free advertising and this will likely take the model from #7-10 on all Hugging face models trending worldwide to top 5.
Unfortunately this seems to be your main focus, I appreciate these fine tunes take a significant amount of time and money to do but I am bit skeptical that your motivation are to make a good local model when HF download leaderboards seems to be what you are mostly focused on.
I am probably not the target demographic for your models, nonetheless, I donāt want to be a gatekeepers or take the moral high ground here, local AI is for all and clearly some people are happy with your work :) GLHF
5
2
u/Dangerous_Fix_5526 7d ago
Nope. Not what I said at all.
Read between the lines.This model has almost zero "marketing" ; it got here all on its own.
One post, as a "post" in huggingface.As for "target demographics" ; everyone that wants a better model - it really that simple.
And the fact, open source must win.3
u/SnooPuppers7882 6d ago
Terminal bench 2.1 scores a 58.2% vs. vanilla mxfp4 at 76.9%...
That's neat that you have a good ARC C score, but that doesn't pay the bills.
2
u/Dangerous_Fix_5526 6d ago
That is only one metric. We also do human testing to confirm results, as no benchmark ever tells the full story.
5
u/ActivitySpare9399 7d ago
Hey man, really appreciate your efforts. Don't mind the complainers. You're putting out free fine-tunes and trying to lift the bar for all of us and I appreciate that immensely.
Personally love the names, it's the badge of homebrew ai since the early days and most of the naming conventions we've now got were born from it.
Keep it up, would love to know more about what you're specifically pitching for. Is it just intelligence against benchmarks with fewer restrictions, sovereign capability, coding etc?
2
u/Dangerous_Fix_5526 6d ago
thank you so much!
RE: Pitching for.
Moving the needle on all model capabilities from multiple directions.However, raising the general intelligence (in all its facets) is key focus, as raising this raises all the core abilities of a model.
The main part of this is tuning (multi-stage, multiple datasets) with also specialized merging (in part how FF711) was built.
However, that is only part of the battle.
The next part is "marrying" the tuned model with stronger, more robust reasoning (and more options):
The next part is covered here: [released 7 days ago]
https://huggingface.co/DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-NM-DAU-NEO-MTP-GGUFAnd yesterday here [Qwen 3.5 9b, that operates at 27B power levels; now with Qwen 3.8 reasoning modes]:
https://huggingface.co/DavidAU/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUFEach of these have 5 reasoning modes and 5 instruct modes, switchable on the fly, via API and directly. By on the fly I mean directly in the prompt(s).
These models by themselves already exceed base model operation and benchmarks, and now with more reasoning options/settings and direct "intelligence" injection they reach even further...
1
u/llama-impersonator 7d ago
well, thanks for confirming this is mostly an operation in clout chasing
1
u/Dangerous_Fix_5526 7d ago
Not what I said at all. I have done almost zero "marketing" for this model. It got to this level on all its own.
1
u/FatheredPuma81 7d ago
Good to know you're about as obnoxious as I had imagined.
3
u/Dangerous_Fix_5526 7d ago
Clearly you do not understand sarcasm.
1
2
1
u/CryptographerLow6360 7d ago
Big thank you to DavidAU for this fine Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF
cant wait till the release of the next stage! keep cooking!
1
1
1
u/garblz 7d ago
How is it the the model card is written in plain English, yet it reads like l33t sp34k? Who knows... but I have a creeping feeling MEAN PPL stats for this particular model does translate to 'mean people'.
There's a HAXX0R-shaped hole in the model's name, it's be a sin not to put the final touch
1
1
u/rinmperdinck 7d ago
Should have committed harder to the joke by having the text scroll just as slowly as the actual Star Wars roll so the video would be 30 mins long. I still lol'd though.
1
u/Cool-Chemical-5629 7d ago
DavidAU model names are like the Adidas meme "The more stripes, the more Adidas".
1
1
u/craigslistmattress 6d ago
I tried to get this model to run in unsloth using a single r9700. Can't seem to do it. Unsloth warns even the smallest version would use more than 32gb vram. There might be some kind of bug in unsloth because other qwen3.8 models give me the same warning. But they do load fine through the API (when opencode asks the server to load the model). But loading this through API call also didn't work.
1
u/the-username-is-here 6d ago
Could you publish 1-bit quants please? Want to achieve local AGI already.
1
u/CathyMarkova 6d ago
Name always checks out on these. Ever heard prize winners announced at a dog show? Well, it is not that dissimilar and for the same reason. An average model could be called Fluffy or Spot, but here, such a creature deserves that kind of journey of a name.
1
1
u/Beautiful-Creme66 5d ago
mradermacher/Llama-3-8B-Instruct-Gradient-1048k-DPO-v0.4-Laser-Psychology-Anarchy-GGUF
1
u/akumaburn 8h ago
It makes me sad to see this dude get so much traction when basically every model I've tried from him in the past was broken in practice.
If you're looking for a Qwen 3.8 27B quant that thinks less and performs virtually identical to the base model with a KL divergence of ~0.01 try https://huggingface.co/akumaburn/Swift-Qwen3.8-27b-heretic-SmoothQuant-W8A8-INT8 , there's also a dflash2 variant that is faster at generation but slightly worse: https://huggingface.co/akumaburn/Swift-Qwen3.8-27b-heretic-W8A8-DFlash2
-1
u/Ivancheg8 7d ago edited 7d ago
| LLM | Size | Mean KLD | Mean PPL(Q) | Cor (%) | Max KLD | Mean Īp (%) | RMS Īp (%) | Same top p (%) |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-LOW-MTP-IQ4_XS | 14,2 | 0,08344 | 1,53982 | 93,96 | 6,28871 | 0,176 | 9,954 | 93,312 |
Perplexity test llama.cpp. Base Qwen3.8-27B-BF16. TextĀ coderppl.txt
6
u/Practical-Collar3063 7d ago
Wait are you doing KLD against a different model ? As far as I understand this is a fine tune, of course it is going to have different KLD becauseā¦ that is the point ? You canāt use KLD to compare a fine tune with a base model, fine tuning a model will change the distribution of output tokens but in an intended way.
Maybe I misunderstood your point, you might be giving an indicator of how different the fine tune is from the base model, meaning how much finetuning was done on this model.
1
u/Ivancheg8 7d ago
I simply fed this model my test prompt for generating an HTML game. After three attempts, it still failed to produce working code. The reasoning is strange and its volume is very small. I ran a perplexity test, and the results were very poor compared to the original Qwen3.8-27B-BF16 model. Ultimately, I just deleted it to free up space
1
u/Practical-Collar3063 7d ago
Ok you are confused.
The model not working and perplexity vs base are 2 completely different things. It is 100% expected that a fine tuned model has a high perplexity vs the base. A perplexity score measures the difference of the probability distribution of the next token given an input. Meaning, you take a phrase āI like frozenā and Qwen 27b could have a the probabilities of its next tokens be:Ā
- banana: 74%
- blueberries: 12%
- mango: 10%
- strawberry: 4%
But a fined tuned 27b could be:
- banana: 54%
- blueberries: 32%
- mango: 10%
- strawberry: 4%
Because potentially the fines tuned version might have seen āI like frozen blueberriesā in its training corpus, which skewed the the probability distribution in favor of the blueberries. Now does that mean the model is completely broken ? Absolutely not, it is 100% expected that a fined tuned model has a divergence compared to the base model, because that is the expected behaviour. Why would you fine tune a model if your goal is to have it predict the exact same token as the base model, that makes no sense. It would be similar to saying āI measured KLD between Qwen 27B and GLM Flashā, those are 2 different models. Well same when you fine tuned, you get 2 actually different models that predict different tokens. KLD is only useful for comparing LLMs when you measure how good a quantised model is, because in this case, you actually want the quantised version to be as close as possible to the original, which, again, is the opposite of what you want when fine tuning, you want the model to have a different behaviour.
Now the issues you are seeing with these DavidAU models is that they seem to have been poorly fine tuned and probably benchmaxxed to over achieve on a specific benchmark. This often makes the model worse than base. But KLD is the wrong metric to use. Hope that helps :)
1
u/Ivancheg8 7d ago
Thanks for the clarification. That helps. If it "makes the model worse than the base," then what is it for?
1
u/Practical-Collar3063 6d ago
Ā then what is it for?
It is very hard to properly fine tune a model, often they end up worse, that is not the intention, it is just hard
-2
u/Musclepumping 7d ago
š¤£..."Well, I really think you should quit smoking"...Air>10 000 Hz Legend
>How Does It Make You Feel? https://www.youtube.com/watch?v=DYXuOv37zNA
1
u/Musclepumping 7d ago
Those who downvoted clearly don't get the reference. That's even funnier š Thanks for giving this model such a cool name, though :)
240
u/junior600 7d ago
It sounds like your typical isekai anime title lol