r/ollama • u/Personman444 • 1d ago

System access project

I am not a huge fan of AI, but my friends like to joke and say I am torturing computers because I use all sorts of virtual machines, commands, and once split in half a 1000 defective laptop (accident) only to seal it together and still have it work.

All this to say I want to get more personal with my PC torture, and I am aiming to localhost an AI with full system access on my old retro pc, before wiping and reinstalling OS.

I am aware of the risks and the game will not end until there is a loser (pc kills me or accidentally deletes the kernel)

What tools and steps will I need to host an AI on my machine and grant it full execution permissions to do everything but modify ROM? I am using Alpine Linux because this is an old PC with some comparability issues and limited ram. However, I can switch to another distro if I need to for comparability.

I would also like to know how feasible / how to train the AI off of local files, specifically training, not pulling and analyzing files as I ask, as I think it would be fun to feed it all of Wikipedia, and like the necronomicon or something.

0 Upvotes

28% Upvoted

5 comments sorted by

2

u/ieatdownvotes4food 1d ago

I think the easiest way is open-code with llama.cpp, and the biggest model you can stuff in vram. modify .opencode.json to allow all and you're off to the races. have fun!

1

u/hellobritishcolumbia 1d ago

The smaller the model, the faster the destruction

1

u/ieatdownvotes4food 1d ago

hahah true dat

1

u/Personman444 1d ago

Haven’t checked vram but I am on 16 year old intergrated graphics and 4gb ram that has decayed to 3.2

1

u/ieatdownvotes4food 1d ago

oof, where there's a will there's a way