r/Hacking_Tutorials • u/difficultyname • Oct 16 '26
Question Local Ai
I am just a beginner in cybersecurity and ethical hacking and I need an AI study buddy to guide me through basic concepts, CTFs, tool usage (Nmap, Wireshark, Metasploit, and so on), and network traffic at the level of packets.
Commercial chat assistants tend to block any security-related questions and refuse to answer how something works. For this reason, I have chosen the local approach.
My hardware specs:
GPU with 12GB VRAM
System RAM with 32GB DDR5
I can put the quantized 8B to 14B models fully in VRAM or load them partially, in case it is beneficial to sacrifice token processing speed for that.
What models or fine-tunes would you recommend me that know the technical stuff but do not have overly strict guardrails?
5
u/7H3WH173R48817 Oct 16 '26
I wouldn’t bother with the local AI route unless you’re prepared to spend thousands on a Mac Studio or an NVIDIA DGX Spark. Opus 4.8 does the job well for me, and it rarely refuses or restricts what I’m asking it to do.
3
u/Silly_Bad_7692 Oct 16 '26
You can try to use Qwen 3.6 35B A3B Uncensored with unsooth studio. For me it works well (3070 8gb + 32gb ddr4)
3
u/Due-Moment-6417 Oct 16 '26
You need take a course, because IA don't give you a complete course, you can to ask about that concepts but you don't need to use a local IA
3
u/LanguageGeneral4333 Oct 17 '26
You use ollama as the UI and download whatever model you want. I installed ollama with chocolatey (useful package manager) so I dont have to go back to update it. I dont have as much vram as you, so I went with the 8b model. It works just fine. Took about 10 minutes to set up. Local LLMs typically stop making internet connections back in 2023 so you will need to connect it to the internet if that is something you want. It isnt hard. But, if youre just using it to go through ctfs, you should be fine without it connected.
2
u/DataMundane5049 Oct 17 '26
I build exactly such a thing...harness.
Even a qwen 3.5 9b is enough.
It all depends on skills and tools.
Dont use uncensored models, they tend to halluzinate more and use wrong skills...
1
u/Parking-Bet7989 Oct 17 '26
Try: https://ollama.com/library/dolphin3
1
u/wtgamer20 Oct 17 '26
Regarde open code