How to make your own Passthrough videos!

howto
41

Sounds like a plan! I’d definitely be keen to test it out! :slight_smile: In the mean time i want to try working on 4D Gaussian

My ultimate goal is to really get to the next step of AR Porn, so to start I’d be using something like VAM to generate the input data to make into 4D Gaussians!

And then making something akin to heresphere in Unreal to display the 4D Gaussians; and if it goes well I might try hiring some professionals to produce some videos with the camera set-up for it as a proof-of-concept

1 Like
42

Updated Github repo with a new change!

Was experiencing some choppiness trying to playback an 8K passthrough that i had proccessed, and it turns out that the videowriter was writing to H264 instead of HEVC (H265) and since most VR videos are gonna be more than 2K anyway (maximum resolution of H264 at 60 fps) I decided to permanently set the codec to H265

1 Like
43

I only have an AMD7900XTX graphics card, can’t I use it?

44

hmm unfortunately not!

Most AI/Neural Network/ML solutions rely on CUDA (which relies on having an Nvidia CUDA-capable GPU) this one included :frowning:

45

thanks T.T

1 Like
46

This might be obvious but it looks like a couple tweaks can be made to SETUP to make the install go smoother for newbies.

2 Likes
47

Oh wow
That’s cool
How do you like SLR PT AI videos Passthrough AR VR Porn Videos | SexLikeReal?

That’s how we got there

We also did comparison of different methods back in the days

1 Like
48

Oh yeah that’s a good catch!

totally forgot that sometimes people with cuda-capable GPUs may not have the cuda toolkit installed :slight_smile:

Updated!

49

Oh yeah I’m subbed to SLR! and I do like those AI passthrough videos!

They are pretty decent in a pinch but I find that a lot of fine detail such as hair gets lost when it comes to AI passthrough; and those fine details are really what makes it immersive (especially with 6 DOF that’s properly calibrated, it’s mindblowing)

I much prefer the SLR originals passthrough videos that were shot on greenscreens but even then the mattes don’t seem to have enough detail and can seem aliased or too feathered :frowning:

Just a thought; it might be a cheaper way to do passthrough videos by taking clean plates for stationary shots and processing them with BackgroundMattingV2 and then using the AI Passthrough model to matte out the male actors or handle situations where the camera is moving

I imagine it would probably require less studio setup like in the green screen videos but you retain very similar level of detail

Or you could even offer it as a service to other studios to convert their catalogue into high-fidelity passthrough videos; if you could have access to their RAW source footages or cleanplates :exploding_head:

1 Like
50

You should be able to make every video PT soon SLR Drive development logic - SLR Forum: VR porn videos and interactive sex toys

Checking on BackgroundMattingV2

1 Like
51

That’s cool!

So do you basically upload the video onto SLR drive, and then if it’s enabled to be passthrough; it will be processed offline on the SLR servers to be passthrough?

Or will the passthrough matting be performed in realtime as the video is streamed? :exploding_head:

52

it’s more like cloud streaming service

1 Like