I thought this was pretty cool.
I am intrigued by the concept of mixed reality. Real cockpit hardware on the inside and VR outside…
12 Likes
I think mixed reality is probably the future of training and simulation for everything but multicrew aircraft.
3 Likes
And i was just about to say “training” too. Looks awesome
1 Like
Varjo are already deep into this with their XR-3 and the upcoming XR-4.
I don’t see why not?
All crew members would need VR googles with pass through, obviously, seated in the same cockpit.
But imagine doing multicrew training in a mixed reality environment via multiplayer…
2 Likes
Fair point.
what does this mean in your case? 
I wonder if the best solution, for me, is a physical cockpit and VR outside view…
That or if someone solves naked hand tracking that is good enough for manipulating switches and knobs.
I’m probably stating the obvious again, but my initial reaction is that it will be extremely useful for cockpit builders/operators. A way to combine the super realistic virtual with the physical world. Most likely a boon for those companies building sim hardware. Seems ironic that VR only pilots might one day seem as minimal or entry level.
Oculus does a pretty good job of naked hand tracking, albeit it doesn’t work in PCLink mode. I’m hoping that they solve this, because if they do, it would solve our need to purchase remotes.
Will it be so precise that one can manipulate switches in two directions and turn knobs…?
I think that actual physical switches and knobs will be better than hand tracking. At least in the near future…
Very interesting stuff!
A software that creates a passthrough image of your hands and the immediate area around them.
2 Likes
Throwing this here as I have nowhere else to put it. If you are struggling with what I will call “banding”, a pale or pink horizontal distortion on the lower 1/5th of your Quest screen under heavy GPU load, he is a solution I found from the Meta Quest forum:
reg add “HKEY_CURRENT_USER\SOFTWARE\Oculus\RemoteHeadset” /v “numSlices” /t REG_DWORD /d “1” /f
You may not care to edit your registry and I get it. I’ve been flying for a week after this edit with no issues and no performance hit (and no banding. Yay!) Still, use at your own risk.
3 Likes
Now we’re talking!
If you don’t already know about The Warthog Project it’s an Aussie building a really cool and reeeally advanced A-10C pit, with external views projected onto a curved screen.
In this video he’s using a Quest 3 for Mixed Reality, in his cockpit…!
MR is really starting to go places…
4 Likes
Heck, in that video it looks like it has arrived! 
It’s come a long way in the last two years.
1 Like
That is super cool and mad respect to the guy for getting it all working (and making the cockpit in the first place!), but I do wonder how much longer until someone combines the hand recognition that Quest 3 has with a pair of haptic gloves to get a similar effect but totally computer generated?
2 Likes
While that would indeed be cool, Mixed Reality has advantages such as being able to use a real notebook, looking at a real folded map, drinking beer 
while flying, etc. And I don’t see handtracking ever being able to follow your hand and fingers where they are obstructed or shadowed by cockpit geometry and peripherals like the stick and throttle. But, hey… I’d love to be proven wrong here!
2 Likes
I’m more referring to only having a stick and throttle bolted to a seat and fully virtualizing the other cockpit controls, but that’s a bit beyond the scope of this thread.
3 Likes
Yeah, I get it, but even just the stick and throttle may be enough to interfere with hand tracking to a larger or lesser degree. And, unless tracked by external cameras, you’d have to look at your hands, to track them.
But, OTOH, to have a fully functioning Mixed Reality experience, you have to have a fully functioning physical cockpit. So it’s a question of use cases… I can totally see MR working really well in real world training, making external view projection, onto huge curved screens, a thing of the past.
2 Likes
Funny you mention that.
2 Likes
Spill it, Mr. Linea! 
1 Like
Well, let’s just say there’s several big players in the field preparing that technology.
(source : me after trying exactly that)
2 Likes