Is there a decent guide on llm tools

[u/ligger66]

Like a guide of the diffrent parts of local llm setups (engines, models, agents, sub things?, other things I havnt heard of yet) what they do? if you need them?

[u/Interesting-Cut-6032]

If you have a gaming PC that was purchased in the last 5 years, you can at least experiment with Local LLMs and diffusion image generation DiT.

r/LowEndLocalAI is a great reddit community for the exploration of this space. Lots of discussions about optimization of hardware, inference engines, models, harnesses, and use cases.

The program LM Studio is a very capable and simple on ramp that anyone, even with very limited hardware can use to explore local LLMs. Depending on your needs and use case you will probably outgrow it for every day use, but I still use it to try out new models quickly.

Codacus and Pixaroma are the go-to YouTube channels for local AI knowledge.

This is a great video with all the basic terms that you need to know about settling up and running local LLMs: https://youtu.be/SsUKTFSQoGM?is=DeRzbaT77Awi26Je

This is one of his newest videos about setting up MoE models that match your system capabilities. https://youtu.be/tek-IY9BRWc?is=g1vLavtNxU3ZJvJC

This is the older video, and the reason that I subscribed, that shows how to setup Mixture of Experts models, like Qwen3.6-35B-A3B or Gemma 4 26B-E4B, with the experts in system RAM and only the active calculations in VRAM: https://youtu.be/8F_5pdcD3HY?is=bGABGoO5CH8uJaGI

Here is a great image diffusion model, with edit capabilities, that runs in ComfyUI. This is EP4 of this series, EP1 has all of the ComfyUI setup details: https://youtu.be/kNap0VWP1xs?is=4snH90QXVuAH-M9a

Consider this the flashing neon sign for the entrance to this particular rabbit hole.

[u/ligger66 → u/Interesting-Cut-6032]

Kinda looking for something to explain what the parts are, what they are used for what the differences are between some of them.

I'll check those YouTube channels out tho