MediaPipe Hand Tracking: Build It or Buy It?

MediaPipe is Google's open source framework for on-device machine learning, and its Hand Landmarker returns 21 landmarks per hand from an ordinary camera. It is an excellent starting point for building your own hand tracking feature. It is not gesture control. Turning landmarks into a cursor that people can use all day, in a room with other people in it, is the part you still have to build. AirTouch is that finished layer: patented software that converts hand gestures into mouse, keyboard, and touch input for any application, with no code.

What is MediaPipe Hands?

MediaPipe Hands is the name most developers know for Google's hand tracking solution, now shipped as the Hand Landmarker task. It detects hands in an image or video stream and outputs 21 hand-knuckle coordinates per hand, in image and world coordinates, along with handedness. Google documents it for Android, Python, and the web, and it is released under the Apache 2.0 license. A companion Gesture Recognizer task classifies a small set of static poses such as thumbs up or open palm. The 21 landmarks are the wrist plus four points along each finger and the thumb, ending at the fingertip.

It is fast, free, and well documented. If you have ever seen a weekend project that moves a cursor with a fingertip, MediaPipe was probably underneath it.

What is AirTouch?

AirTouch is finished gesture control and hand tracking software. You install it, point a standard RGB camera at the user, and hand movement becomes the mouse, keyboard, and touch input that every application already understands. Fifteen gestures map to any shortcut or mouse action, saved per profile. It runs on Windows, Linux, and Android, with macOS on the way. Through our partnership with Orbbec, it also takes advantage of 3D depth sensing and IR cameras when a deployment calls for them, as described on the Orbbec page.

Want to test it on the camera you own? Start a free trial.

How do MediaPipe and AirTouch differ?

• Layer of the stack. MediaPipe is a perception component. AirTouch is a complete input product. One gives you coordinates, the other gives you a working cursor.

• Intent. Landmarks tell you where a hand is. They do not tell you whether the person means to control the screen. Every hand that scratches a nose or waves at a colleague produces landmarks too. AirTouch's patented intent detection identifies the primary user and filters out incidental movement in most setups.

• Cursor feel. Raw landmarks jitter. A usable pointer needs smoothing, acceleration, click stability while pinching, drag handling, and a reset gesture. This is months of tuning that never shows up in a demo video.

• Operating system input. To control other applications you must inject mouse, keyboard, and touch events at the OS level on each platform you support, including multi-touch and multiple displays.

• Sensor range. With AirTouch, range is limited by the camera, not the software. With AutoZoom and a suitable camera it works at 20 feet and beyond.

• Sterile and soiled environments. AirTouch models are trained for gloved hands, including surgical glove colors, and track through glass. It is deployed in clinical settings today.

• Maintenance. Your own build is yours to maintain through every OS update, camera driver change, and model revision.

Where does MediaPipe win?

• Cost and license. It is free and open source. AirTouch is a paid subscription.

• Raw landmark access. If your application needs finger joint coordinates, for sign language research, a custom creative tool, or a game mechanic, you want the landmarks themselves. AirTouch outputs input events, not skeleton data.

• Web and mobile embedding. MediaPipe runs inside a browser tab or a phone app. AirTouch is installed software.

• Offline operation. MediaPipe runs with no network connection. AirTouch processes video locally and requires an internet connection to run.

• Learning. If the goal is to understand how hand tracking works, build it.

Is MediaPipe hand tracking good enough for production?

It depends on what production means for you. As a landmark detector, MediaPipe is accurate and fast enough to ship inside many apps, and plenty of products do. As gesture control for a screen that other people use, the landmarks are the easy part. Intent detection, cursor smoothing, click stability, multi-user filtering, OS-level input on every platform, and years of maintenance are what turn a demo into something a receptionist or a surgeon can rely on, and none of that comes in the box.

A useful test: run your prototype in a busy room with three people talking with their hands. If the cursor stays with the person who meant to control it, you are close. If not, that gap is the product you would be building, and it is the product AirTouch already is.

What are the alternatives to MediaPipe for hand tracking?

The alternatives fall into three groups. Other open source building blocks, such as OpenCV-based pipelines, give you similar raw material and the same build work. Sensor-based SDKs, such as the tracking software for the Leap Motion Controller 2 or the SDKs that ship with depth cameras from Orbbec and Intel RealSense, add infrared or depth data on dedicated hardware. Finished gesture control software, such as AirTouch, skips the landmark layer and delivers mouse, keyboard, and touch input directly. Leap Motion alternatives walks through the wider field.

Which should you choose?

Can you use both?

It is a sensible path. Prototype with MediaPipe to prove that gestures belong in the product, see how much work sits between landmarks and a shippable interface, and then decide whether to license the finished layer. If you build interactive experiences, the Unity, Unreal, and TouchDesigner integration page shows how AirTouch input arrives in those tools with no SDK.

Where to start

Start a free trial and compare it against your prototype on the same webcam. For product teams weighing a license, book a demo and bring your requirements.

Related: best hand tracking software for Windows, Leap Motion alternatives, what is a touchless interface, gesture control for OEM products, and gesture control and hand tracking software.