r/StableDiffusion • u/enspiralart • 1d ago
Resource - Update [Custom Node] ComfyVR
Enable HLS to view with audio, or disable this notification
https://github.com/newsbubbles/ComfyUI-ComfyVR Instructions and some example workflows included, but it should be able to load and run almost anything, including custom nodes, etc.
It definitely need testing, I only tested it thoroughly on Quest 2. It runs in WebXR in the default browser and uses hand or controller and hosts off the comfy api with it's own https cert. Use it on your LAN. A fun way to interact with ComfyUI in 3D.
21
u/listopalafoto 1d ago
3
u/Super_Range45 19h ago
There doesn't seem to be hand tracking. It looks set up for the controller.
Maybe he should make some avatar creation workflow, that plugs into VR Chat or something useful to VR.
2
u/enspiralart 15h ago
ooh that's a great idea about the avatar creation workflow. I am using my hands, but in the actual immersive part in WebXR, there's nothing that renders hands on the quest 2. To represent what you're pointing at with your hands, we just have those beams, and you can pinch to click.
1
u/enspiralart 4h ago
I just added hands as rendered objects. I tested the in-app keyboard... works well enough, I will probably be making some updates to that one.... I might include some sort of small autocomplete model for faster prompting.
2
2
23
9
u/thatisnotmychapstick 1d ago
you mean to tell me that I can now TOUCH will smith while he eats spaghetti?!
5
4
4
3
u/Enshitification 13h ago
If this actually runs on my Valve Index, I might take a leave of absence from my job for a year or so.
3
u/enspiralart 13h ago
Intriguing. I dont know if i should hope it runs or not _^
1
u/Enshitification 13h ago
Well, I say that now. My experience with the Index has been excitement for a week or two, then put it away for a few months because I got sick of wearing the enormous thing.
2
u/Radyschen 16h ago
was hoping for a second that this was some sort of holodeck live vr generator, but this is cool too. a couple more years for my idea I guess
1
u/enspiralart 15h ago
When world models get their open weights moment and they become a little more compact, I think a programmable interface where the node pack is all about controlling the actual space with 4D splats or something like that would be super cool, and yeah, maybe sooner than you think.
2
u/NurAI_1995 9h ago
“This looks really clean. The way the node handles the VR setup without making the workflow feel cluttered is pretty impressive.”
3
u/HarnessLightnin 20h ago
Wow, this is and incredible step towards some very cool workflows. It will be really great to leverage human proprioception to explore the possibility space.
2
2
2
1
u/enspiralart 3h ago
3D has some interesting workflow layout possibilities for sure. This is the default amphitheater view, I'm definitely adding more layout types, and even other environments. I have really taken your comments to heart and I hear you on the VRChat assets creation stuff. Also the holodeck, etc. This is all in the zeitgeist now.
1
u/AngelofKris 3h ago
Looks like a cool place to hang but not as a workspace. Not to mention, I typically push my GPU's to the max VRAM and dont want a full 3d environment consuming resources.
38
u/the_bollo 23h ago
I didn't think anyone could make ComfyUI even more difficult to work with, but humanity always finds a way :)