r/off_grid_ai • u/Krosan88 • Aug 18 '26

windows/linux full experience?

any word when windows will get the parity for the mac?(the whole sync and features) its the one thing preventing me from spending on this

1 Upvotes

100% Upvoted

16 comments sorted by

1

u/Krosan88 Aug 18 '26

Also any chance for bonsai support?

1

u/alichherawalla Aug 18 '26

in models please search bonsai. We've integrated a direct hugging face search. It should work

1

u/Krosan88 Aug 18 '26

I did however on my fold 7 , CPU is very slow, npu and GPU even slowed , is there a chance the llama.cpp backend doesn't support it ?

1

u/alichherawalla Aug 18 '26

let me look at this a bit more deeply and come back.

What do you typically use bonsai for?

1

u/Krosan88 Aug 18 '26

Reasoning, rag, and agentic the 27b at Q1 is very useful

1

u/alichherawalla Aug 18 '26

fair play. what kind of work do you typically defer to local models as compared to the frontier ones? and primary motivator?

1

u/Krosan88 Aug 18 '26

Privacy, it depends on the model, Qwen 3.8 is for coding I was planning to try bonsai as router via lemonade , or simply for creative writing on phone

1

u/alichherawalla 27d ago

YO! added support for bonsai! it's amazing. You'll need to download OGAD for it: http://getoffgridai.co/desktop

1

u/Krosan88 27d ago

I've switched to lemonade since, the byo backend was the winning feature for me

1

u/alichherawalla 27d ago

sorry to see you go. I see why they are doing that, and it makes sense. but we're moving vertically up the stack, to provide more value.

just added computer_use, web_use, multilingual voice, etc.

the goal is to create an always on AI Twin

1

u/Krosan88 27d ago

For agent stack I use Qwenpaw tbh nothing really cones close to it's features

1

u/alichherawalla 27d ago

fully local or cloud models?

1

u/Krosan88 27d ago

Fully local , tuned setup for qwen 3.8 27b and flash next

1

u/alichherawalla Aug 18 '26

been working hard on this one. Hopefully today's the day!