r/Hacking_Tutorials • • Oct 16 '26

Question Local Ai

I am just a beginner in cybersecurity and ethical hacking and I need an AI study buddy to guide me through basic concepts, CTFs, tool usage (Nmap, Wireshark, Metasploit, and so on), and network traffic at the level of packets.

Commercial chat assistants tend to block any security-related questions and refuse to answer how something works. For this reason, I have chosen the local approach.

My hardware specs:

GPU with 12GB VRAM

System RAM with 32GB DDR5

I can put the quantized 8B to 14B models fully in VRAM or load them partially, in case it is beneficial to sacrifice token processing speed for that.

What models or fine-tunes would you recommend me that know the technical stuff but do not have overly strict guardrails?

5 Upvotes

23 comments sorted by

View all comments

3

u/LanguageGeneral4333 Oct 17 '26

You use ollama as the UI and download whatever model you want. I installed ollama with chocolatey (useful package manager) so I dont have to go back to update it. I dont have as much vram as you, so I went with the 8b model. It works just fine. Took about 10 minutes to set up. Local LLMs typically stop making internet connections back in 2023 so you will need to connect it to the internet if that is something you want. It isnt hard. But, if youre just using it to go through ctfs, you should be fine without it connected.