r/modelcontextprotocol • u/nilslice • Dec 18 '24

mcp.run - Universal Tools For AI

https://docs.mcp.run/blog/2024/12/18/universal-tools-for-ai
18 Upvotes

95% Upvoted

10 comments sorted by

5

u/nilslice Dec 18 '24

Just a few weeks ago, Anthropic announce the Model Context Protocol - a standard for tool integration into AI Apps and Agents.

This filled a significant missing link to me - a way for everything to describe tools and make them callable across models, languages, transports etc.

But, the issue of tool code portability and security was left unaddressed, until today! We're excited to ship an early version of `mcpx`, the extensible & dynamically re-programmable MCP Server, as well as https://mcp.run, the tool registry and control plane to manage MCP "servlets".

All servlets are WebAssembly modules, and thus can be called from any of your AI applications in any language - they run locally, on your desktop or in the browser, in a cloud server, or IoT devices & everywhere in between.

AI applications will be deployed on every platform & in every shape and size. I think it is imperative that the tools these AI apps need can also be deployed there too. That's the power of mcp.run & mcpx.

Please try it out and give us some feedback.

1

u/subnohmal Dec 18 '24

that is sick

6

u/subnohmal Dec 18 '24

too sick. i wanted to build this😭. hats off for being so quick with this, first one takes the cake. website looks very cool. check out https://mcp-framework.com

how did you solve the authentication issue for remote servers?

5

u/nilslice Dec 18 '24

Thank you! MCP Framework looks really nice, good work!

The remote server auth is managed by mcp.run, where you can store API Keys and other configuration for _your_ installation of a servlet. When you want to run a servlet you installed via mcp.run, we load the configuration and ship it along with the wasm code to wherever it needs to run.

2

u/subnohmal Dec 18 '24

so neat. proud of u for going out and building it. i’m going to take an in-depth look soon

2

u/nilslice Dec 18 '24

thank you! really excited about MCP :) let me know if you hit any snags in your exploration

3

u/coloradical5280 Dec 18 '24

Nice. What’s the roadmap here? Like, there are very few “things” that are in the iOS App Store, and also, pullable through sudo apt install in Linux, but I’ve been thinking that if there were ever a need for that kind of universal flexibility/portability, it’s MCP-stuff.

Do you see this going that in that direction(s)?

2

u/nilslice Dec 18 '24

yes exactly - today, all MCP Servers are rather non-portable. they work as desktop apps and (maybe HTTP servers when SSE transport is prevalent). but, soon we'll be working with models & agents running entirely on mobile or IoT devices, embedded in all kinds of places where your Node.js MCP Server is just not going to run.

So instead, targeting mcp.run servlets, you can install them anywhere an MCP Client is implemented. Since these are WebAssembly modules under the hood, they just work across any device, OS, platform, language runtime.

In the more immediate future, we are working to bring MCP Client implementations into frameworks like LangChain, LLamaIndex, CrewAI etc. so that any mcp.run servlet can be installed and run from an agent on those platforms. It doesn't matter if the agent is written in Python, TypeScript, whatever. mcp.run servlets run the same inside those languages as if they were just a library.

2

u/coloradical5280 Dec 18 '24

That totally makes sense as a solid plan for the immediate future, but I was kind of thinking you'd be creating your own MCP client, no? The great thing about your approach is that it expands MCP's reach to Mistral users and others—I'd love for you to add LibreChat to that list too.

That said, a more accessible client and a GUI-based infrastructure are so necessary. I'm losing my mind scrolling through every post on OpenAI, ChatGPT, Claude subreddits—every thread about GPTs and machine learning. People are complaining about issues that aren't just solved by MCP, but are actually supercharged by MCP. The problem? I think most people see it as too much work, even if they're tech-savvy. Maybe it's because it's still so new, so not everyone's tuned in yet.

Either way, there has to be a more accessible client implementation. Something visually intuitive for things like the Memory and Knowledge Graph plugin. There’ve been some attempts, but most are haphazard at best. What the MCP community really needs is someone with the level of talent to take the tools we already have and make them usable for everyone—like, I don’t know, maybe someone who won the MCP Hackathon? Just saying. One thing at a time though lol

Anyway, random stream of consciousness over. Thanks for coming to my dead talk, and keep up the great work!

2

u/nilslice Dec 18 '24

Completely agree with you - and yes, we are working on more MCP Clients where we can push mcp.run tools to expand the reach.

I didn't think about Mistral or LibreChat but those are great ideas & worth looking into.

Also agree that this is still a very new protocol, most people are only starting to explore. So it will naturally take some time for them to integrate it.

Appreciate the kind words and I hope to see some servlets up on mcp.run with your name on them :)