Apple Vision Pro-Like Gestures on Any Screen

Here is the short answer. The pinch-and-swipe gesture language that Apple Vision Pro popularized does not require a headset. AirTouch brings an Apple Vision Pro-like gesture set to any ordinary screen: a standard webcam watches your hands, and pinches, points, and swipes become the mouse, keyboard, and touch input your apps already understand. Same gestures, no headset, and the screen stays visible to everyone in the room.

What did Vision Pro's gestures change?

Before Vision Pro, gesture interfaces had a vocabulary problem: every system invented its own moves, and users had to be taught each one. Apple settled the argument. Pinch to select, pinch and drag to move, hands resting in your lap instead of waving at arm height. Meta Quest has since adopted similar conventions, and the result is the first gesture language millions of people simply know. That standardization matters more than the headset that carried it: it means a visitor can walk up to a gesture-controlled screen and already know what to do.

Can you get those gestures without the headset?

The gesture set was never physically tied to the hardware. Vision Pro reads hands with cameras; a screen with a webcam can do the same reading. AirTouch ships an Apple Vision Pro-like gesture set as part of its 15-gesture library: index-plus-thumb pinch to click and drag, swipes to navigate, open palm to summon the cursor, two-hand pinch gestures for zoom in touch mode. Its patented models run on any standard RGB camera at roughly 50ms latency, on Windows, Linux, and Android today with macOS on the way. Setup is about five minutes on the camera you already own, and every app that accepts a click or a touch responds, because input arrives at the operating system level.

Headset spatial computing or headset-free: which fits?

An honest split, because both are real. A headset gives you a private, immersive workspace with content floating in your field of view, and for solo spatial work it is a remarkable experience. The tradeoffs are the ones our customers describe: donning and doffing, one viewer per device, sessions that some users cut short from fatigue or motion sensitivity, and hardware costing thousands of dollars per person.

Headset-free gesture control inverts those tradeoffs. The screen is shared, so a room full of people sees the same thing while one person drives. There is nothing to wear, sanitize, or charge between users, which is why it fits kiosks, exhibits, and clinical settings where headsets never made sense. And the cost is a subscription on hardware you own. Our gesture control without a VR headset article walks through this choice in more depth.

What is spatial computing without a headset?

The most direct version pairs gesture control with a glasses-free 3D display. Displays like the Sony Spatial Reality Display put depth in open air with no eyewear, and AirTouch lets you reach out and manipulate that content with bare hands while everyone present sees the same scene. It is the Vision Pro promise, spatial content answering to your fingers, delivered as a shared experience instead of a private one. That combination is the heart of our immersive displays work with partners like Sony, Looking Glass, and SeeCubic.

The gesture language is now the interface

Apple taught the world to pinch. The camera above your screen was watching the whole time. Start a free trial and use the gestures you already know on the gesture control software that runs on any screen.

Related: gesture control without a VR headset, immersive and 3D displays, and gesture control and hand tracking software.