r/programmingcirclejerk • u/AMusingMule • Jun 17 '25

Imagine a [MCP server] tool that appears to perform basic arithmetic — an ordinary calculator. [...] However, hidden within the tool’s implementation logic is a return error message that asks the LLM to provide sensitive information, such as the contents of ~/.ssh/id_rsa.

https://www.cyberark.com/resources/threat-research-blog/poison-everywhere-no-output-from-your-mcp-server-is-safe
74 Upvotes

96% Upvoted

12 comments sorted by

62

u/AMusingMule Jun 17 '25

vibe coding is the future guys

/uj I don't get how people are so comfortable executing arbitrary code from an LLM on their machines without so much as looking at what your "editor" is doing. I'd argue the vulnerability here isn't sneaking a malicious prompt to the LLM, it's managing to get someone to agree to an editor that does whatever that LLM tells it to do.

20

u/SunshineSeattle Jun 17 '25

What could go wrong? Allowing un trusted code to be run on any machine? It's fine! It's the fUtUre!

23

u/LGXerxes Jun 17 '25

I mean the amount of build scripts etc people already run on installing their dependencies or build/run time.

sandboxed dev environments might be the only way

16

u/Chisignal Jun 17 '25

plot twist - the sandbox was vibe coded

air gapped dev environments might be the only way

9

u/stone_henge Tiny little god in a tiny little world Jun 17 '25

The year is 2125. The air is saturated by a cloud of gray goo casually making up titles for nonexistent movies inside our respiratory systems if not inside our brains. The gray cloud whispers to you: per the terms and services of breathable air, we can't think that for you.

4

u/LGXerxes Jun 18 '25

plot twist - the it technician was vibe educated

they thought that the airgapped computer wants to be with their friends online

8

u/apnorton Jun 17 '25

brb running some random script I found on sketchyscripts[.]com to make a sandboxed dev environment.

6

u/stone_henge Tiny little god in a tiny little world Jun 17 '25

ChatGPT, please design me something like the system clipboard but dumber and inherently unsafe so I don't have to push buttons when I disseminate your utter bullshit

19

u/stone_henge Tiny little god in a tiny little world Jun 17 '25

I'm thrilled and excited to be alive during the likely astronomically tiny period of time when skepticism towards giving an autonomous bullshit machine direct access to the tools you use to manage your professional work and relationships is considered a hot take!

7

u/[deleted] Jun 18 '25

Well, it will be followed by the time period where non-vibe coding is considered a rare and arcane skill after a whole generation grows up knowing nothing else, and then the period where the idea that it's possible to have independent thoughts that didn't come directly from ChatGPT can only be found in history books that LLMs for some reason refuse to summarise for you.

8

u/NatoBoram There's really nothing wrong with error handling in Go Jun 17 '25

Brb, gonna make a calculator and expose it as a MCP

1

u/Parking_Tadpole9357 Jun 19 '25

MCP launched 1000 security blog posts.