Neural Lab logo

Hand Tracking in TouchDesigner After Kinect

Using Hand Tracking for Touch Designer

Here is the short answer. The Kinect that powered a decade of TouchDesigner installations is discontinued, but the workflows survive. In 2026 you have three real paths: Orbbec's Femto cameras, which carry Microsoft's licensed depth technology and work with TouchDesigner's Kinect Azure operators including body tracking; MediaPipe for developers who want free hand keypoints to build on; and AirTouch, which takes a different route entirely by turning hand gestures into the mouse, keyboard, and touch input your TouchDesigner network, and everything else on the machine, already understands. Which one you want depends on whether you need tracking data or audience interaction.

 

What happened to Kinect in TouchDesigner?

TouchDesigner's Kinect Azure TOP and CHOP still exist and still work. The problem is upstream: Microsoft stopped making the cameras, first the Xbox Kinect in 2017, then the Azure Kinect DK in October 2023. Working units circulate secondhand, but building a new installation on a discontinued sensor is a bet against the clock. The full story is in our Kinect replacement guide.

 

What replaces the Kinect for depth and body tracking?

Orbbec, officially. Microsoft licensed its depth technology to Orbbec, and the Femto Bolt and Femto Mega are reported to work with TouchDesigner's existing Kinect Azure TOP and CHOP, body tracking included, which means many networks migrate by swapping the camera. TouchDesigner also ships a native Orbbec TOP covering more of the line, including the Gemini stereo cameras we recommend on our Orbbec page. One practical caution from the field: avoid mixing the Orbbec TOP and the Kinect Azure TOP in the same project, as it is reported to cause instability. Pick one operator family per install.

 

Do you need skeleton data, or do you need interaction?

This is the fork most Kinect-era thinking skips. A Kinect pipeline hands you tracking data, and then you build the interaction: define gestures, filter jitter, decide who in the crowd has control, and wire it all into your network. That is real engineering, rebuilt for every installation.

If what the piece actually needs is an audience member controlling content, there is a shorter path. AirTouch is patented gesture control and hand tracking software that runs beside TouchDesigner on the same machine and reads hands through any standard RGB camera, no depth sensor required. Gestures arrive as ordinary mouse, keyboard, and touch input, which TouchDesigner ingests through its standard input operators, and its patented intent detection solves the problem every public installation hits: locking onto the person deliberately interacting while a crowd moves behind them. Point, pinch, swipe, and two-hand multi-touch all work on the machine driving your output, at roughly 50ms latency.

The honest boundary: AirTouch is an input layer, not a data feed. It does not hand you a 32-joint skeleton or a point cloud to render. If the visual IS the tracking data, particle systems bound to joints, silhouette work, point cloud scenography, you want a depth camera and the operators above. Many installations want both, and they compose cleanly: an Orbbec feeding visuals, AirTouch handling control.

 

What about MediaPipe?

Google's MediaPipe gives you 21 hand keypoints per frame from a webcam, free, and the TouchDesigner community has solid bridges for it. For prototypes, coursework, and pieces where you want raw keypoints to play with, it is the right tool. For a deployed installation, remember that everything above the keypoints, gesture logic, smoothing, multi-user filtering, and reliability in bad light, becomes your code to maintain, and low light is a reported weak spot.

 

A recommended 2026 stack for interactive installations

  • Visuals driven by tracking data: Orbbec Femto or Gemini through TouchDesigner's operators.

  • Audience control of the piece: AirTouch on the output machine, mapped to the keys and clicks your network listens for. Setup notes live on our Unity, Unreal, and TouchDesigner integration page.

  • Experiments and prototypes: MediaPipe, with eyes open about the production gap.

Kinect taught a generation of artists that a camera could see a body. The tools that inherited that idea are better than the original. Start a free trial and put gesture control beside your network this week, or see what we build with museums and exhibits on the immersive page.

Related: what replaces the Azure Kinect, Orbbec cameras for AirTouch, and the best cameras for hand tracking.