HereSphere VR Video Player for Quest 2/Pro/3 supports Handy, Keon, Launch and Passthrough

Steam PCVR version doesn’t support bluetooth yet. I’d recommend using ScriptPlayer, Multifunplayer, and/or Intiface, with the HereSphere timestamp server on the PC.

I’d like to add my voice to this as well. I switch between the Handy and the OSR2+ depending on how much setup I feel like doing for a session, so having the heatmap available in VR would make a real difference. MFP displays it on the monitor, but that doesn’t help much when the headset blocks my view entirely.

Some way for Heresphere to load an accompanying heatmap file when the Handy isn’t in use would be incredibly useful; even basic support for a PNG with the same filename would solve most of the problem. Any option that brings the heatmap into the VR interface would be appreciated.

2 Likes

I know it isn’t highest priority, but is their a roadmap to implement this for Steam PCVR, or is it just planned to remain that way?

Extra curious now since the Steam Frame was announced.

Yeah, the script system will be overhauled with the new UX, with the option to always show heatmaps, as well as manually selecting scripts, controlling multiple devices at the same time, inverting scripts, etc.

2 Likes

Bluetooth support for PCVR is on the to-do list, though last time I tried implementing it, bluetooth connectivity was difficult in Unreal Engine 4. Maybe it’s easier in UE5.

HereSphere update v0.12.2 is now available Meta Quest devices on the Meta App Store RC channel and itch.io. This update adds support for external alpha videos for passthrough, audio track switching, and the vacuglide.

External Alpha:

  • Separate videos can be used to control the opacity of a passthrough video. Black areas of the video will have no opacity (transparent), while colored portions of the video will be opaque. The final opacity is the sum of all color channels (RGB in linear color space). If generating your own alpha videos, 480p seems sufficient for the resolution. Make sure to match the keyframe spacing of the original video to keep seeks aligned.
  • Name the external alpha video the same as the original video, but place “_XALPHA” at the end of the name right before the video extension.
  • If a matching “_XALPHA” video is detected, an eye symbol will appear near the upper left corner of the seekbar. Click on it to switch between external alpha passthrough and no passthrough. You can also change the mask type to “Alpha External” in the advanced video settings under the “Environment” group.
  • If using the HereSphere web API, external alpha videos can be provided using the “alphaExternal” field, which is a string with the url of the external alpha video.
  • An eye icon will appear near the top left of the web API thumbnail if an external alpha video url is provided for that scene.

Audio Tracks:

  • If a video has multiple audio tracks, a drop down box will appear above the seekbar. Switch between the audio tracks by using the drop down box. Currently, the player can only switch between tracks if the labeled languages are different.

Other Changes:

  • Default opacity multiplier is increased to 2.0
  • The encoding and resolution drop down boxes are now properly hidden when not streaming from the HereSphere web API
  • Added support for the vacuglide
2 Likes

How do i resolve this issue when i try to start up Heresphere?

rebooted pc:

1.) Start up Meta Horizon link
2.) start up Heresphere (paid version )

and then i get this error:

I’ve reinstalled Heresphere but i still get this error

In windows file explorer, go to %localappdata%/HereSphere and delete the folder to remove all the saved settings. Then try launching the app again.

1 Like

That did the trick, thanks alot!

Is there a way to bypass heresphere crashing when attempting to create large playlists? I swapped to using an external manager via the web browser but would love to find a real solution for playing directly through heresphere.

It works when only creating a playlist of a folder containing 50 or so videos but any more than that heresphere immediately dies.

If you’re using SMB, there currently isn’t a way to bypass this issue yet. I need to add a proper background thread to scan the SMB files and add it to the playlist.

1 Like

I am using SMB, thanks for the info. I’ll stick to the built in web browser and StashVR for now then.

Hey there, @HereSphere !
Thank you for making the best VR App with Handy integration.

Will there be a „direct control peripherals“ option to use with the Handy over Wifi or still just for Bluetooth devices? I couldn‘t get it to work with the Handy.

Thanks!

1 Like

I would love a Reset button that resets all the settings to default (zoom, tilt, etc)

Running into an issue on the latest Quest firmware (v2.1.1034) and Heresphere v0.12.3 from Itch.

Only the first video I load works. Eventually, after a minute or two, the connection is permanently lost to the Handy (pausing, seeking, etc do not affect the handy. it just keeps playing), although Heresphere doesn’t seem to recognize this and the blue haptics icon remains. Once I enter this state, there’s nothing I can do to get out of it. Rebooting the handy hardware itself doesn’t fix it, nor does hitting the loop/reconnect button in the haptics panel of Heresphere, nor does toggling haptics on and off in Heresphere (it tries to connect but eventually times out). The only resolution appears to be closing Heresphere entirely, waiting a minute, restarting it, and then rapidly opening whatever I want to play (if I wait long enough, I can’t even get one video to play with haptics working, even from a cold boot).

Oddly, when I close Heresphere after it enters this state, my quest becomes unresponsive for 5-10 seconds on the main quest menu before becoming usable again after which I can reopen Heresphere.

I’ve tried removing and reinstalling Heresphere and still have the same issue. Only thing I haven’t tried is a complete factory reset of the entire device which I’d rather like to avoid.

It used to work great! I think the latest quest update may have broken it. My headset shows that it was installed Mar 5th and this broken behavior began after that update.

I’m on Quest 2 with v2.1.1034 and HereSphere v0.12.2, and I don’t have this problem. Did you try installing another version of HereSphere like the v.0.12.2?

I did run into another bug with HereSphere and the latest Quest firmware: When I finish my session and exit HereSphere, the Horizon living room thing refuse to load. I just get stuck on the loading screen and have to restart or shut down. Luckily, this is fixed by not using the horizon background and instead just the passthrough camera.

Will it ever support Pico 4?

Hi all, I got meta quest 3, and the handy, and I bought heresphere.

Connection via connection key wifi was not working this morning, and it was saying the firmware cannot be checked, I suspect the handy servers to be down at that time.

I have my stash instance with stashvr, I have my .funscript files along with videos files, I’d like to avoid connecting to handy servers, which put latency and does not feel so good for privacy.
I also like to avoid having my windows computer always on, so scriptplayer and multifunplayer are no otpion.
Stash and stashvr actually run on my openwrt.
I installed intiface on my meta quest 3, it seems to have detected the handy, but I don’t find how to connect heresphere to it. I put 127.0.0.1 and the ip of my quest too to try in timestamp server, along with correct port, but in the interactive menu of heresphere it keeps complaining about wrong connection key
Can I use that intiface in my quest 3 to send orders from heresphere to the handy ? If yes how ? If no any other solution to propose me as I understand BT support for handy is not available yet

Thanks guys

I don’t think HS timestamp server can communicate directly with Intiface. You’ll have to use scriptplayer or multifunplayer to receive the HS timestamp server messages, and have those interact with Intiface for bluetooth support for the Handy.

Oh ok
Thanks for reply
Then I guess i’ll do with handy servers until bluetooth is implemented