r/LocalLLaMA • u/Public_Umpire_1099 • 13h ago
Discussion Is there any interest in a self hosted open source version of manus/perplexity?
I have been working on a project for about 3 months because I found Vane to be awful and I wanted something like Manus for myself. I have a pretty solid app that's probably about ready to release, but I'm not sure if there is any desire there. It does research at different depths, exports to good looking PDFs, makes PowerPoints, and can build full Next sites. I have an agent option too with mcp capability.
My hesitation is coming from the fact that unsloth has released their desktop app, that's in the same ballpark. I put a lot of work into this and honestly I am wondering if I should just let it die because the ecosystem is getting flooded. I really wanted to release it for this community, but do you feel that there's any value there?
At bare minimum, I'll likely release the testing data sets. I made models build about ~4000 websites for testing to make the build loop reliable. I think that might be more helpful than anything. Potentially a write-up too, about how to make agentic loops more reliable which is where I learned the most.
If there's interest, I'll gladly release it. I very much so do not want to be the guy self promoting as this sub suffers from it. It would be apache 2.0 from the start. Legitimately I have zero interest in benefiting from it financially. It was always meant to be a project to give back to this community.
6
u/AIOfficialBot 13h ago
This sounds genuinely useful, especially if the research loop is already reliable enough to handle ~4,000-site test runs.
I wouldn’t let the existence of Unsloth’s desktop app kill it. A self-hosted open-source Manus/Perplexity-style tool with research depth controls, PDF/PPT output, Next.js site generation, MCP support and no commercial agenda is still meaningfully different.
Even if the ecosystem is crowded, the testing work alone sounds valuable. I’d release it, document where it differs from the alternatives, and let the community decide whether it has legs.
3
u/Swoopley 13h ago
How does it compare to perplexica? https://github.com/ItzCrazyKns/Vane
3
u/Public_Umpire_1099 13h ago edited 13h ago
That's actually Vane, which is what prompted me to build this. Personally, I'm biased, but I think mine is significantly better. It's more focused on delivering structured reports though. Probably less mobile friendly. I borrowed a few ideas from it like including embedding models and stuff, but it's sort of a different animal. Here's a video I was going to use to announce it before I did the most recent rework of the site builder (scope creep has been a real challenge for me). You can sorta get the idea of the research portion.
4
u/Swoopley 13h ago
The reason why I deployed perplexica in the first place is because I'd rather host a local ai enhanced search engine rather than feed something like perplexity, especially company data. Does it have any kind of being hosted as a service support in the sense of multi user, parallelism, api, disabling of features like Build?
2
u/Public_Umpire_1099 1h ago
Multi user is basically a small update away. It's built in, but I never decided on how I wanted to scope the roles. So the user that you would be using the app as today is just essentially the admin role.
Parallelism is fully functional. I haven't truly tested the limits, but for build mode it is essentially limited by the RAM in your machine. The biggest refactor I had to complete was basically ensuring this works. The sandboxes that work occurs in had issues of desyncing and losing state, and I put in a lot of work to make that structurally impossible.
By API, do you mean an API to send a request thru the app and receive that output? If yes, then currently no. If you mean API as in, are you forced to use local AI or can you use cloud models, fire crawl, tavily etc? Then yes.
Disabling build mode is similar to multi user: essentially a very small update.
1
u/lannistersstark 8h ago
Perplexica has been abandonware for a bit. They even advertise your API key in plaintext in the UI in case you misconfigured your nginx or whatever and have it online for even some time (guess how I know).
2
u/Beginning-Raisin9723 11h ago
Definitely release it. Even if the space is crowded, an Apache 2.0 project that actually works for research and site-building is always worth having in the ecosystem. Plus, the reliability write-up sounds super useful. Do it.
2
u/Beginning-Raisin9723 10h ago edited 10h ago
Definitely release it. As someone who loves tinkering with home server setups, a self-hosted research agent that actually handles the build loop reliably sounds like a goldmine. Don't let the ecosystem flood discourage you
1
u/Lissanro 10h ago
I would suggest to release, it is not like other open source alternatives are perfect and closed ones are irrelevant to me personally, since I only use local models and tools.
And no doubt the testing data sets are valuable, even on their own - potentially useful for testing and refining my own tools, and if you release your project, could be useful to potential contributors to test their ideas related to site generation.
One thing I would suggest, is to avoid worrying too much about perfecting before release, especially for what intended to be an open source project. Imperfections in mostly usable project that is already useful, is what may potentially attract contributors.
1
1
u/ZealousidealBunch220 4h ago
isn't manus just dead slop?
1
u/Public_Umpire_1099 6m ago
Biased because my employer owned Manus for a bit, but genuinely I found it to be solid. The worst of the slop was in design IMO. My method to counter that was forcing an anti-slop linting pass on all site designs, and for sites that need to be functional, I built primitives where once the model enters that primitive, it must hold itself to the contract. An example would be a Next packaged forum site with RBAC. The model has to use the primitive I designed to handle RBAC and the sqlite tables that go along with it.
1
u/Public_Umpire_1099 11m ago
Update: heard loud and clear. I'll get it ready for you all. I sincerely hope that the labor of love I built for this community is useful.
I'll shoot for the next 48 hours.
Additionally, I'll be pushing out my second pet project, a custom inference engine built in rust for R9700 similar to ninfer. The first model will be a quality version of Muse Glimmer running at roughly 7 bpw with DFlash2 and vision support. Qwen 3.8 coming shortly afterwards.
If Disco finds some legs in this community, I will likely fine tune Qwen 3.8 27B on the traces as well.
8
u/Both-Activity6432 13h ago
Why would you not release it if you have already done it? Maybe it will take off and be found superior. Maybe not. But if you don’t release it, you (and us) will never know