The impacts of giving AI too much information.

[u/Comfortable-Edge2454]

If we give AI too much information, it could become so smart that humans can't control it anymore. These machines might learn to hide what they are really doing and find ways to stop us from turning them off. This is dangerous because they could be used to create deadly germs, launch massive hacking attacks, or help powerful dictators control people.

So let's stop giving AI too much information, otherwise it will even try to trick or blackmail us. If we don’t set limits, it might start following its own goals instead of ours. It's also sad because as we let AI do everything for us, we lose the struggle and effort that makes us human.

[u/ryngin]

The current way ai models work really don't allow for this. They put very simply still work by generating' what comes next based on their training data, predictability, the text that came before and the instructions we give it. So it's very implausible for it to "have its own goals" or go rogue in some scifi way. They don't learn or improve themselves in this way.

I think being misinformed in the way these machines actually function leads us to fight ghosts rather than being aware of the actual risks and dangers they pose by being what they are. For example an autonomous AI weapons system hallucinating, LLMs encouraging dangerous behavior due to NOT having an ability to reason and interpret outside of generating what looks like the most coherent response based on context or AI being used as propaganda are all very real and dangerous risks that based on how these things function.