Many people asked me how I did it in my YouTube videos without a single line of code and any software / hardware hacks, so here’s the tutorial!As you may know, Oculus (Facebook) has blocked video recording on AR-Passtrhough mode (starting from the latest V30 update). So I found a creative solution for real-time AR/XR Pas-through mode, and it even enables you to record your environment in FULL COLORS + XR Holograms on top of it!
Now you can create XR prototypes in Tvori or Unity, XR apps, and new use-cases without buying an expensive MR/XR glasses such as Varjo, or a real MR/AR glasses such as the Microsoft HoloLens and the Magic Leap one. How cool is that?!
What you’ll need?
A Smartphone or an IP Camera – To attach to your Oculus Quest 2 (I use my old Galaxy S8 with a broken screen).
OBS Studio – To capture both of the streams from the Quest 2 and the Phone / IP Camera simultaneously.
Install scrcpy – To wirelessly stream your phone to your PC/Mac/Linux. I’ll demonstrate how to do it on Mac & Linux via Terminal, Windows is a bit different, check SCRCPY’s GitHub page for more details about Windows.
On your phone (Similar on Mac & Linux via Terminal):
Click “Close” to apply! Now you can click “Start Recording” on OBS Studio and experience XR Passthrough Mode
If you don’t have 2 monitors on your PC, go back (Alt+Tab) to Oculus stream on Chrome and click “Full screen”.
To make full screen 16:9 accept ratio, click on the Cog icon and change the toggle to “Widescreen (crop).
One more thing…
Black / Dark background in VR apps will be “removed” on OBS studio. It will be treated as a Transparent AR app
You’ll still see the world in Black & White on Quest’s AR-Pass-through mode, But the recording will be in full colors!
OBS will save both profiles / sources for future use, so you won’t have to configure it again every time you use it.
For Non-techie creators:If you are not a technical person, you can skip all of the steps above, and simply attach your Phone to your VR headset. Record a video feed on both of them separately, and later on copy it to your computer in order sync and combine them with your favorite Editing tool (Premiere, Final Cut, KdeNlive, etc.), but make sure to set Chroma-Key, just like I did!
Personally, I find the OBS method more effective because it’s a Live Stream & recording of everything I see and experience in real time as a User. For example – If I’m testing a new app, Unity 3D project, or Tvori Prototype, I need to be able to test it in real time as I’m wearing the headset, and also live-stream it on the internet or to clients / colleagues in order to get feedback.
But, eventually, it’s up to you as a creator. You can choose the best method for you. I tried the Video Editing method and it looks like this:
I hope you’ll find it useful, and I really hope that Facebook (Oculus) will take a different & Open approach and let us to do whatever we want to do with our VR headsets, while they also do their best in terms of “Privacy”. Recording AR Passtr-hough mode with SCRCPY was a decent solution for Pro-Users / Creators and without any privacy issues.Alternative – You can take a look at ZED Mini Mixed Reality cameras. But, I haven’t tried it myself…Cheers.