Best bet would be running an AI segmentation algorithm on your PC to remove the background ahead of time and generate an alpha mask video, which can be synchronized with the actual video during playback to remove the background. It’s on the to-do list, but probably won’t be ready until early next year. Realtime AI background removal on a Quest headset (without a precomputed alpha mask) probably isn’t feasible due to lack of compute power.
Interesting. I figured it might be a pipe dream, but it’s encouraging to know it may be viable and implemented in the near future. AI PT is the only reason I occasionally use Deo still, so it’d be great to get that working in Heresphere and streamline my app usage.
Thanks so much for the quick response and as well for the great product in general.
I have a quick question. When using a Quest controller I can click ‘A’ button to show the distance from an object (when menu hidden and video paused), but I can’t find a button to do this with a keyboard or mouse. Which option in ‘Key Bounding’ is related to this?
It’s just the toggle play/pause button. Default for keyboard is spacebar, for mouse it’s the left click button (when the menu is hidden). If you’re using the Quest standalone version of the app, you’ll need to go to the key bindings menu, and press the “Load Default Keybindings” for keyboard and mouse (though I don’t recommend using a mouse on the Quest standalone version, since the cursor tracking doesn’t work properly at the moment).
Why just precompute the segmented version of the video and just key passthrough from that. Anyone can install SAM and ffmpeg, no?
will the heresphere app ever support 2 bluetooth devices, i.e. Kiiroo Keon and powerblow at the same time like the DeoVR app?
Multiple interactive devices is on the to-do list with the new UX update later this year.
Hi @HereSphere I use your video player very often and like how easy it is to use. What I miss is playing a video from lets say MilfVr directly in your browser. I just see this:
I know I can start downloading it but then the integration with “The Handy” isn’t working anymore. MilfVr supports “The Handy” out of the box by there website. With the download this support is broken and I am hoping with the support of WebXR or WebGL (don’t know what this means ) in HereSphere this is working…
HereSphere’s web browser doesn’t currently support WebXR, so the web browser itself is unable to play the video in VR mode. You can stream the video in the native HereSphere video player by clicking on the download link, but as you’ve mentioned, scripts for the Handy won’t work. I don’t think MilfVR provides script downloads (they’re part of the POVR network, which does provide CMscript downloads, but apparently not for MilfVR content). There probably currently isn’t a way to get this to work for MilfVR. POVR does support streaming scripts for studios like WankzVR through HereShere, though. Go to povr’s website, play an interactive wankzvr video, there’ll be a notification in the bottom right that says device not connected, click on it, input your handy key. Then in HereSphere, go to povr.com/heresphere, and then play an interactive wankzvr video.
Is there a big update still coming this year @HereSphere ? a lot of script related features we are waiting for. Whats your ETA?
It’s looking less likely that the big update will be ready by the end of the year. Currently still finishing up the Apple Vision Pro port. The UX on the AVP port is excellent so far, and I’m hoping to replicate that with the big UX update for the Quest/PC version of HereSphere. It’s a massive amount of work, though, so I’m aiming for the update to be ready early next year.
That is a good hint because that is what I see on the MilfVr side as well. In the bottom right I see a smal button which allows me to connect to my device. It looks like they share the same page since I have access to POVR, WankzVr etc.
I’ll give it a try.
@HereSphere looks like it is working with povr.com/heresphere. For Milfvr not although they are using the same content platform:
Just wanted to let you know that.
Anyways, just want to ask something different. If I use povr.com/heresphere with Heresphere it is quite slow to forward or backward a sceene. It tooks quite long to load. Is this due to the fact that Heresphere basically downloads the scene instead of using WebXR?.
I am using a Quest 3.
If thats the case I would highly recommend implementing WebXR. At least for me it’s not working that seamles with povr/milvr how I would like to see it.
HereSphere just streams the video from the download link. However, POVR’s content delivery network is sometimes slow when it comes to streaming from the download link.
Thanks for letting me know. It look like other studios like CzechVr are also using your API and offer the possibility to stream with heresphere. Maybe I’ll give it a try with CzechVr. I think currently the best Studio offering quite good and easy integration with a headset (at least with Quest 3 and “The Handy”) is SLR together with DeoVr. But I would like to see more studios do something similar with Heresphere. That would be a game changer in my opinion.
So the big UI update will look like the new Vision OS version?
There’s also the new Meta UI assets that were recently released.
Right now, the goal is to make it similar to Vision OS, but HereSphere for Quest and PCVR is built with Unreal Engine, so I have to build the UI components from scratch to emulate it. Meta’s UI assets are only available for Unity at the moment.
Btw, I can confirm that statement. Last time I used it, it was quite fast. Equal to DeoVr and SLR. It seems that the network is sometimes slow. Maybe to much users at the same time.
Another question. It would be awesome if you could show the heatmap for this “use case” as well. It plays the POVR content and “The Handy” is also working as expected. But in conjunction to locally played content I don’t see any Heatmap…
@HereSphere Is the scan bluetooth device available on PC using Steam VR? I cant see it after clicking the play button with radio waves around it and activating p… only to add a connection key?
Native bluetooth isn’t currently supported on PC. You can use the HereSphere timestamp server with apps like ScriptPlayer or MultiFunPlayer to control your bluetooth devices, though.