Apple shows how exactly the new control with gestures and looks should work

It is possible to connect a Magic Keyboard and trackpad to the Vision Pro. (Image: Apple)

Little by little, more and more new bits of information about the new Vision Pro headset from Apple are coming to light. In a video for developers, the company shows how the virtual keyboard works and what other ways there are to control the device.

It is controlled with eyes, hands and voice

The Vision Pro should primarily be controlled with eyes, hands and voice. Apple has already confirmed that you can also connect a physical keyboard or trackpad. The controllers of the major console manufacturers can also be connected to play. A Dualsense from Sony can be seen in the presentation video.

Apple wants users to primarily use the Vision Pro her hands in her lap use and UI elements only with Look choose. In a developer video in which two members of the design team demonstrate the various control options, they admit that for some applications it makes more sense to raise your arms and interact directly with the UI elements that appear.

Apple calls this feature »Direct Touch«. Coincidentally, Meta (formerly Facebook) unveiled a similar feature for its Quest headsets of the same name just a few months ago.

With Direct Touch elements can be moved by pressing and holding them or by enlarging and rotating them with both hands.

Apple also showed in the video how to use Direct Touch write and draw can. All you have to do is press your thumb and forefinger together and hold your arm up to the virtual screen. If you want to continue writing or drawing somewhere else, all you have to do is look elsewhere and release your finger contact.

These are six gestures supported by the Vision Pro. (Image: Apple)

This is how the virtual keyboard works

According to Apple designer Eugene Krivoruchko, audiovisual feedback is particularly important in the design of the Vision Pro virtual keyboard because it no tactile Feedback gives.

If the keyboard is displayed, users can hold their fingers over it. Any key that has a finger over it will then be highlighted. The closer your finger gets to a key, the brighter it lights up. For the distance measurement, the built-in LiDAR-Sensor used. As soon as the fingers make contact with the keys, you can see and hear it clearly.

This is what the virtual keyboard should look like. (Image: Apple)

Who the headset over voice commands just glance at the microphone icon in the search bar and then start talking.

If you want to learn more about the Vision Pro from Apple, take a look at our overview:

What do you think of the different ways to control the Vision Pro? Do you think these will work as well in practice as Apple plans? Will you get the headset or are you waiting for a cheaper non-pro variant? Or maybe you are not interested in such a device at all? Tell us what you think about it in the comments!