Eye tracking and head tracking on iPhone… Eyewear beam

Eyeware has released an application that enables eye tracking and head tracking using the iPhone and iPad Pro.

Eyewear is a company that develops software that enables 3D gaze tracking without glasses using a depth detection camera. Eyeware Beam, the company’s first consumer product, is a program that allows easy use of eye tracking and head tracking without purchasing a separate system.

Specifically, it uses the TrueDepth camera in the iPhone and iPad Pro that supports Face ID. It is a structure that transmits information to software running on a PC without going through a genuine Apple AR kit, using proprietary 3D eye tracking and head tracking technology.

Uses help you track which parts of your social media are attracting attention through the viewer’s gaze movements, create more engaging videos or make presentations easier to understand. You can visualize whether you are looking more at a dog or a cat.

It also explains that it is ideal for coaching to learn where to improve by comparing and shifting one’s perspective in gameplay. In addition, if you combine a simulator game or a head tracking function for gaming, you can experience an immersive visual experience, and there is no need for equipment that puts a burden on the body such as a headset, cable, or battery.

Demand for the iPhone as a replacement for a web camera could also be high. It states that a web camera that identifies the user from any angle can be used in all video conferencing apps such as Zoom, Skype, and Google Meat.

Eyewear Beam can only be used by beta testers who have applied for a closed beta state, but it is preparing to be released for general use. The current version only supports iPhone XS, XR, 11, 11 Pro and iPad, but when it is officially released, it will run on all models supporting Face ID.

First, the iPhone recognizes the user’s gaze and head movements and transmits the data to the PC, so it may be difficult to manipulate a 3D action game with a lot of movement in real time to track a path. Related information can be found here .