Google's mixed reality tech shows faces behind VR headsetsFebruary 22, 2017 - 16:12 AMT PanARMENIAN.Net - YouTube has already perfected the art of mixed reality videos that show the VR world and the real world at the same time. A great example is the video of Conan O'Brien's virtual trip to outer space taken when he visited YouTube's VR Lab. The video platform's technique still can't capture the whole picture, however, since VR headsets get in the way. Google Research and Daydream Labs had to team up to solve the problem, and they did just that with the help of machine learning, 3D computer vision and advanced rendering techniques, Engadget reports. In order to "remove" the VR headset in a video, the user's face has to be scanned with a camera and reconstructed as a dynamic 3D model that blinks and looks in different directions. Next, the VR headset -- Google used an HTC Vive for its tests -- has to be outfitted with eye-tracking tech in order to detect where the user is looking. Google's and Daydream's technique superimposes the 3D model on the face of the real person. It doesn't completely remove the VR headset, though: it just replaces it with a transparent version to prevent the uncanny valley effect. As you can guess, the technique will benefit YouTube creators the most at this point in time. In fact, Google is exploring ways to make it accessible to YouTubers. It could become a lot more useful when VR becomes more widespread, though. For instance, it could be adapted to show people's faces in VR video conferences or the faces of friends playing VR games together. Top stories Yerevan will host the 2024 edition of the World Congress On Information Technology (WCIT). Rustam Badasyan said due to the lack of such regulation, the state budget is deprived of VAT revenues. Krisp’s smart noise suppression tech silences ambient sounds and isolates your voice for calls. Gurgen Khachatryan claimed that the "illegalities have been taking place in 2020." Partner news Most popular in the section | U.S. welcomes Armenia, Azerbaijan’s border delimitation announcement Blinken said it is an important step towards concluding a durable and dignified peace agreement. Residents Of border villages protest as Armenia, Azerbaijan agree on delimitation Residents of several Armenian communities in the northeastern Tavush province began protests late on Friday. Up to 10% cashback from GetTransfer with IDBank cards IDBank clients who make their booking on GetTransfer will receive an exclusive cashback. European Parliament to discuss repression in Azerbaijan The European Parliament will discuss repression of civil society in Azerbaijan on April 24 |