HereSphere update v0.10.0 adds support for passthrough with chromakey and alpha masking, as well as some quality of life features. The update is available on App Lab (RC channel) and itch.io. Try the free demo.
Passthrough:
- Added support for passthrough. You can switch to passthrough mode on a global basis (for all videos) by going to the user settings, clicking on the background dropdown box under the environment group, and then select passthrough. If you want to only enable passthrough for the current video, go to the advanced video setting when the video is playing, and then change the background dropdown box under the environment group to passthrough.
Chroma key masking:
- Added chroma key masking, which removes parts of an image based on the color (useful for removing green screens for passthrough). To enable chroma key masking, go to the advanced video settings, and under the environment group, change the mask dropdown box to chroma key. Press the cogwheel icon next to the dropdown box to edit the chroma key mask settings. You can define up to three different chroma key colors, a light despill color, and a light injection color. Click on the eyedropper icon to select a color by choosing a location in the image. Pixels that are similar in color to the chroma keys will be made transparent. You can define a cutoff value, soften value, exponent, and spill mask for each chroma key to specify the range of affected pixels. Pixels that are close to the light despill color will have their color adjusted to remove the tint of the despill color. This helps with removing green screen halos and skin tinted by the green screen. After the light despill operation, the color may look unnatural, so the light injection can be used to add color back into the image to make it more natural. For more details, view the tooltips by holding the grip button when hovered over the settings. (Note: for the best performance, leave the exponent settings at 1, and the despill spill mask at 0).
Alpha packed masking:
- Added alpha packed masking, which defines the alpha (opacity) of the image by packing it into another region of the image. To enable alpha packed masking, go to the advanced video settings, and under the environment group, change the mask dropdown box to alpha packed. Press the cogwheel icon next to the dropdown box to edit the alpha packed mask settings. The alpha coordinates shift x and shift y settings define the position of the alpha image relative to the normal colored image. The alpha coordinates scale x and scale y settings define the size of the alpha image relative to the normal colored image. For more details, view the tooltips by holding the grip button when hovered over the settings.
Quality of life improvements:
- AB Loop times are now saved per video
- Enabled keyboard and mouse support. Go to the keybindings menu, and then add your keybindings to the keyboard or mouse group (you can also press the load default keybindings button). There are some known issues. When typing in a number box, you will need to press esc first, and then press enter after youâre finished typing in a number. The mouse cursor movement doesnât work correctly. Iâll try to fix in this in a future update.
- Added heatmap opacity setting to the synchronized peripherals menu. Lowering the opacity will make the heatmap more transparent, so itâs easier to see the current playback position.
HereSphere Web API:
- Added âalphaPackedSettingsâ and âchromaKeySettingsâ field, which can be used to load settings for alpha/chroma key masks. Check the HereSphere discord for more details on the HereSphere web API.
- Added âhspArrayâ field, which contains the url of hsp file and the version of the hsp file. Newer hsp files arenât backwards compatible with older HereSphere installations, so the version number is used to determine which hsp file can be read.
