Offline AI passthrough?

General
11

Thanks for the mention! :slight_smile:

Funnily enough I’ve tried a lot of the methods discussed here and ran into a few problems:

  1. Not enough compute power to do this quickly and painlessly
  2. AI Segmentation models i’ve tried can’t seem to produce high-definition masks that could handle hair or fine details, and models that could would take too long to produce just 1 frame. Masks generally looks Blobby

So I started on a journey to DIY my own offline passthroughs in a somewhat cheap way without requiring AI/ML or crazy expensive GPUs

https://discuss.eroscripts.com/t/how-to-make-your-own-passthrough-videos

And the post above illustrates how to set it up yourself and get started making your own Passthrough videos even on 8K resolution VR

(I’ve not considered using stable diffusion to create masks though, that’d be interesting!)