Does Gesture Control Work With Surgical Gloves?

Camera-based gesture control tracks the shape and movement of a hand, not the electrical contact of skin, so gloves are not the obstacle they are for touchscreens. AirTouch hand tracking models are trained for gloved hands, including colored surgical gloves, on a standard RGB camera. Strongly colored gloves such as blue, purple, or green use a setting named Support Color Glove. Results depend on lighting, contrast, and camera placement, so clinical teams test with their own gloves in their own rooms.

Why do touchscreens struggle with gloves?

Most touchscreens are capacitive. They sense the small electrical change when bare skin meets glass. A glove gets in the way of that, double gloving more so, and a sterile drape over the screen adds another layer. The familiar result is a clinician jabbing at a button three times, then peeling off a glove.

Glove-friendly touch modes exist and help. They do not change the larger issue, which is that a shared touch surface in a clinical room has to be reached, touched, and cleaned.

How does a camera track a gloved hand?

Hand tracking software looks for the structure of a hand: palm, fingers, joints, and how they move. A glove keeps that structure intact. The model needs to have seen gloved hands during training, and ours has.

Color is the variable. A light or skin-toned glove generally looks like a hand to the model. A saturated blue, purple, or green glove looks less like one, so AirTouch includes a Support Color Glove option for those cases. It is off by default. Turn it on in Advanced settings, choose the color, and test. The advanced settings guide walks through it.

What affects accuracy with gloves?

• Contrast with the background. A blue glove in front of a blue drape or blue scrubs is harder than the same glove in front of a plain wall. Camera angle usually fixes this.

• Lighting. Surgical lights are harsh and some rooms are dimmed. Tracking holds up within reason, and a few environments may call for a specialized camera. Through our partnership with Orbbec, AirTouch also takes advantage of 3D depth sensing and IR cameras when a deployment calls for them. Details are on the Orbbec page.

• Frame rate. Aim for 20 frames per second or more. Below 15, expect lag. See the camera setup guide.

• Soiled or wet gloves. Reflections and staining change how a glove looks on camera. This is an edge case worth including in your evaluation.

• Holding instruments. Gestures need a visible hand. Most clinicians set the instrument down or use the free hand for the moment it takes.

Does it work with gloves outside the OR?

The same principle applies to nitrile exam gloves in a pathology lab, cleanroom gloves, and work gloves on a factory floor. Thick or bulky gloves hide finger detail, so simpler gestures such as open palm and pinch tend to be the most dependable. Anywhere people remove a glove to use a screen is a candidate.

How should a clinical team test it?

• Use the exact gloves you stock, in every color you stock.

• Test in the real room, under the real lights, with the usual drapes in view.

• Stand where the clinician stands, at the usual distance from the display.

• Run the five actions you use most in your viewer, not a generic demo.

We would sooner find a limit with you in an evaluation than have you find it during a case.

Where to start

Book a demo and we will test against your environment, gloves included. AirTouch is computer input software, not a medical device. If you want to try it today, start a free trial, put on a glove, and see for yourself.

Related: how surgeons review imaging without breaking scrub, touchless image control in the IR suite and cath lab, gesture control for medical environments, and gesture control and hand tracking software.