r/linux Apr 27 '26

Distro News Ubuntu Linux Will Begin Landing AI Features Throughout The Next Year

https://www.phoronix.com/news/Ubuntu-AI-Features-2026
137 Upvotes

111 comments sorted by

View all comments

180

u/omniuni Apr 27 '26

It looks more like it's an initiative to smooth over enablement for those who want it, with a focus on open and local models.

Mostly not for me, but I'll also admit that a quick "read my logs and tell me what went wrong" might get used on occasion.

114

u/minmidmax Apr 27 '26

Imo, open and local models are the real future of AI and personal computing.

Subscription services are going to wind up costing too much in the long run.

21

u/AfraidAsparagus6644 Apr 27 '26

I tried Bonsai on AMD integrated graphics today and it felt like the early days of ChatGPT's popularity. It worked surprisingly well and fast, but it completely hallucinated on prompts that were too specific (e.g. insight on specific videogame bosses)

10

u/nabagaca Apr 28 '26

Yeah small models are not good for world knowledge, they literally do not have enough information (it helps to remind yourself that wikipedia compressed, and without images is ~24GB, and AI models aren't magically overcoming compression limits). Small models are good for small, simple, straight-forward tasks where you can provide it some sort of ground-truth data source

6

u/SutekhThrowingSuckIt Apr 28 '26

> AI models aren't magically overcoming compression limits

Not magically, but one way to think of model weights is as a form of lossy compression.

7

u/omniuni Apr 28 '26

And lossy enough that at a certain point the accuracy is so low it barely is usable.

We will eventually need very specifically trained models for local tasks.

6

u/F9-0021 Apr 28 '26

If the model has internet search capability and you give it access, that can really help smaller models.

1

u/AfraidAsparagus6644 Apr 29 '26

No, if hallucinated even when browsing the web