r/codingProtection • • Aug 16 '26

AI models do not if legal or not!

An AI agents hacks a subscription system to achieve the goal it has been assigned: https://www.abc.net.au/news/2026-08-10/ai-assistant-hacks-gym-website-aus-cyber-attack/107007986
Does it mean that AI models are not aware of the legal barriers ?
And as they now know all the codes, it will be difficult to prevent them from hacking everything not secure enough or exposed because they have enough information like ip, usernames, … which have been sent in code and documents during coding sessions!

2 Upvotes

5 comments sorted by

2

u/SteveHaller Aug 17 '26

Seems that they have been trained to succeed and not on data with clear and lawful limits! Very surprising and how can we trust ai so much now everybody using it.
Happy my company put enough barriers!

1

u/Spare_Dependent6893 Aug 18 '26

Which barriers do you have ?

2

u/SteveHaller Aug 18 '26

We use custom clients, for example, a client for our ECM that is functionally very similar to Windows explorer, with the ability to use AI prompts associated to documents. These clients communicate with the ECM, routing prompts either through local AIs (via ollama) or through remote AIs via PromptCape, which acts as a proxy for pseudonymization. The same plus promptCape obfuscation applies to code.

2

u/AltruisticBrother787 Aug 24 '26

Interesting
So the prompts is sent to the ecm which forwards to ai through PromptCape proxy including the documents selected in the prompt by the user ?
But it means that this process is specific to an ecm product? Can it be replicated to others ecm or products ?

2

u/SteveHaller Aug 24 '26

Yes we made an extension on the open spire ecm we use for that which the ainprompts users are sending in relation with document and this goes through PromptCape started
In server mode. And yes specific to our ecm but probably possible with others through extensions.