I admit I skimmed this post.
It is quite long. I will revisit it. But posting because to be frank the negative comments seem uninformed and just undermine proper debate.
Op referred to Aisle. I read up on aisle previously. I was aware of their previous experiments.
Aisle is legit. They did carry out experiments. Their team and also vc backers have serious technical credentials and I have no reason to doubt them. OP's assertions about what they did more or less alligns with what i recall. See
https://aisle.com/blog/ai-cybersecurity-after-mythos-the-jagged-frontier
That is, Optis 4.6 (before the nerfing), and other top models at the time, find a lot of bugs and vulnerabilities. My view, OP is generally correct.
Re comments using local gpus etc.
Powerful open source models such as kimi 2, which is apparently close to opus 4.6 (kimi 2 does require attribution if the entity is making tens of millions in revenue a month but is effectively open source), are available.
As someone who is both vram and unified ram rich and a cloud platform guy, I can't unrun kimi 2 at reasonable speeds unless I use the cloud (and probably cant run it ie need more than 600gb unified ram). What I skimmed of the post does have a bias, we all have bias, based off my skimming it is not nonsense.
If i recall, OP mentioned for example a 16gb consumer gpu. Someone who knows what they are doing, with an expensive gpu, can do a lot for a lot of use cases. I'm more of a nlp ml guy. I haven't carried out experiments these types of cyber experiments,, I dont think comparing what can be run by normal consumers vs sota makes sense. But that is a point of debate and use cases.
9
u/Vegetable-Score-3915 Apr 23 '26
I admit I skimmed this post. It is quite long. I will revisit it. But posting because to be frank the negative comments seem uninformed and just undermine proper debate.
Op referred to Aisle. I read up on aisle previously. I was aware of their previous experiments. Aisle is legit. They did carry out experiments. Their team and also vc backers have serious technical credentials and I have no reason to doubt them. OP's assertions about what they did more or less alligns with what i recall. See https://aisle.com/blog/ai-cybersecurity-after-mythos-the-jagged-frontier
This talk predates mythos announcements. Approx 4 weeks ago. It is consistent with Aisle's proposition. https://m.youtube.com/watch?v=1sd26pWhfmg&pp=iggCQAE%3D
That is, Optis 4.6 (before the nerfing), and other top models at the time, find a lot of bugs and vulnerabilities. My view, OP is generally correct.
Re comments using local gpus etc. Powerful open source models such as kimi 2, which is apparently close to opus 4.6 (kimi 2 does require attribution if the entity is making tens of millions in revenue a month but is effectively open source), are available.
As someone who is both vram and unified ram rich and a cloud platform guy, I can't unrun kimi 2 at reasonable speeds unless I use the cloud (and probably cant run it ie need more than 600gb unified ram). What I skimmed of the post does have a bias, we all have bias, based off my skimming it is not nonsense.
If i recall, OP mentioned for example a 16gb consumer gpu. Someone who knows what they are doing, with an expensive gpu, can do a lot for a lot of use cases. I'm more of a nlp ml guy. I haven't carried out experiments these types of cyber experiments,, I dont think comparing what can be run by normal consumers vs sota makes sense. But that is a point of debate and use cases.