[Chemy JMHT]

A new device could bring the needed popularity to virtual reality interactions. The Veeso is a Kickstarter VR headset, that uses cameras to track your eyes, eyebrows, mouth, and head position, to have your virtual avatar mirror your real life actions.

VR headset that relays facial expressions to the virtual world

Veeso is claimed to be the world's first VR headset that tracks a user's facial expressions and conveys them in real time to digital avatars

VR hardware is already capable of tracking your head, your hands, your eyes and in some cases, your feet, but Veeso is claimed to be the first VR headset to capture your face and transmit your expressions and as a result, your emotions onto a virtual avatar in real time. With it, the company is emphasizing emotional connections through chat apps and social games like poker.



Like the Samsung Gear VR and Google Cardboard, Veeso is a smartphone-based VR headset, which the company claims is compatible with Android and iOS devices. Unlike those aforementioned headsets, however, Veeso has two infrared cameras mounted on it to capture the wearer's facial expressions.

One of these cameras is located between the eyes to capture pupil movements, eyebrows, and how open or closed the eyelids are, while the second hangs off the bottom of the unit, taking in the jaw, lips and mouth. Together, from what we see in the videos, they seem to do a pretty solid job of covering the whole face and mimicking the facial expressions on a digital avatar in real time.


The facial tracking works through two infrared cameras inside the headset: one between the eyes, tracking eyebrows, pupils and how open or closed the eyelids are, and the second hanging off the bottom, taking in the jaw, lips and mouth

In most current VR games, you don't usually see your character's face, and if you do, having them copy your expression probably isn't going to add much to the experience. But if we're going to spend time interacting with other actual people in virtual worlds, be it multiplayer games or social applications, which is where a lot of those involved with VR see the technology heading, then being able to see people's real world facial expressions in real time will be key.

Potential applications suggested by the company so far include a kind of VR video call, where people sit together in virtual rooms and have a chat through the mouths of cartoon frogs and squirrels, and more traditional social games like poker and charades. Veeso says it plans to release at least 10 applications and games for the platform in the first six months.

As interesting as the tech sounds, keep in mind that the best Veeso can do content-wise is use existing Google Cardboard content for smartphones. The best mobile VR library is locked behind the Gear VR's Samsung/Oculus walled garden. With that in mind, the product itself may not end up being as enticing as the general prospect of VR facial tracking.


Veeso is focusing on social apps and games, such as poker and charades, more than traditional gaming

Veeso is currently seeking funding on Kickstarter in order to begin Phase 2 of the product's development. An Early Bird pledge of US$70 will get you a unit, or if you're a developer or interested tinkerer, you can get your hands (and face) on the headset and dev kit for $80. If all goes to plan, the company says the device will ship in December.

The team demonstrates the Veeso headset in the video below.

You can back this project here: https://igg.me/at/veeso/x/14527140

Sources:
- Veeso virtual reality headset captures facial expressions - Business Insider
- VR headset that relays facial expressions to the virtual world
- Www.veeso.com

[VirtuaTyKing]

A very cool feature. Could eventually add a whole new level to VR interaction. Love it!

[Chemy JMHT]

I was browsing and it'amazing the amount of projects to have a more field of view, physical interaction, feedback, less weight, and more, so it's just the best time to be alive in the VR world.

[Firegold21]

I like this idea, but do poker players REALLY want their facial expressions shown? Most professional ones try to hide their emotions, lol.

That joke aside, I agree. This is cool and the amount of effort people are putting into expanding the VR experience is awesome.

Posted via the VRHeads App for Android

[EgoAnt]

Can you imagine seeing someone's REAL expression in an FPS when you drop them with one of the weakest weapons?

Ooooo, this makes me want to make a game called "Conformity" where you have to pass unnoticed in groups of people who are under some sort of mind control. The only way to pass unnoticed is to mimic their facial expressions or the robot overlords will know you are a rebel.

[EgoAnt]

Oh man! Another idea! Capture people's faces for a jump scare! This would be AMAZING for the classic mirror scare.