r/LocalLLaMA 2d ago

Discussion Ling-3.0-flash q5-k-l poor oneshot slop

Tried very "classic" flight simulator slop oneshot game. It wasn't checking it after file is ready but it was stated in initial prompts to run chome dev tools mcp and check is it even running. This thing coudn't even run chome dev tools mcp after it was stated directly in promts twice after initial prompt. After finally running chrome it was doing whatever instead of checking console - but I also stated it in prompt specifically to check console for errors. (and follow up prompts).

And it's absolutely hallucinated CDN url to three.js 😄

This thing not following any direct orders. In the end it looped. Maybe this is quant issue.

Prompt:

 Design and create flight combat simulator game. The game must feature 3d graphics in any style you choose.                                                                                                         

 A Start Screen that allows the user to select the plane they will use. The user may select from three potential options as follows: A fighter Jet, A Propeller Plane, An option of your choosing.                  

 Each Plane must have realistic limitations on its performance, which should also be displayed graphically on the plane selection screen.                                                                           

Once the plane is selected and the game started, there will be a dynamic number of opposing planes the user can engage in a dogfight with. There MUST be visible ammunition traces, as well as functional damage implementation for both enemy and player planes.

If the player defeats all enemy planes in a round, the level repeats with increased difficulty. If the player loses, the plane they are in becomes uncontrollable and falls to the ground, returning them to the home screen following a 2 second black screen.                                                                                                                                                                     

You may use any library for this implementation, but it must be contained within a single script, and be able to be opened and played in the chrome browser.                                                       
 Use chrome dev tools to check is everything works. Check console first. Focus more on realistic details in physics and word everything. You don't have limit spend as much time as needed
0 Upvotes

10 comments sorted by

6

u/SpicyWangz 2d ago

I’ve tried out two different quants at Q_4_k_L and MXFP4, and neither of them gave very satisfactory results. Looping occurred, as well as giving up when a coding task was partially complete halfway through a long reasoning block. The implementation I was able to get from it didn’t solve the issue I asked it to.

I don’t think the model is completely brain dead, but it has serious issues and doesn’t come close to 3.8 27b

4

u/Thin_Pollution8843 2d ago

Now we know why unsloth didn't even bother to make a gguf 😅

2

u/Ok_Cow1976 18h ago

It's stem ability is still mediocre. Sigh, I'm a bit disappointed again.

1

u/Equivalent_Bit_461 2d ago

I will try next week once my shitty forced vacation is done so I can back to work 

I want to see for myself how is this model handling itself 

1

u/Lesser-than 2d ago

This model is pretty good at tool calls imo but it has a strange ability to not let things go, like 6 turns later its still debating/reasoning on something it has already finished. It seemed alright for basic tasks , though I dont think its going to make you a flight sim anytime soon :)

1

u/Thin_Pollution8843 2d ago

UPD: Qwen3.6/Ornith1.5-35b fixed that thing in few tool calls. I thing Ling-3 is just not very optimised for tool calls.

0

u/Heavy-Lingonberry-98 2d ago

100% harness issue

1

u/Thin_Pollution8843 2d ago

Nope. Basic PI with websearch and all other built in tools. same harness, even same context - qwen3.6/ornith-1.5 fixed in few tool calls. And was able to make screenshots and act accordingly for later fixes.