Factory Floor Screens: Gloves, Voice, or Gesture?

On a factory floor or in a warehouse, the screen is usually the easy part and the input is the problem. Gloved hands do not register on a capacitive touchscreen, voice loses to the machines, and a bank of physical buttons only does what it was wired to do. Gesture control is the fourth option: AirTouch reads a worker's gloved hand through a standard RGB camera in a housing and sends the same touch and key input the HMI, MES terminal, or work-instruction display already accepts, from a step back, through a guard, with dirty hands. It does not replace an emergency stop and it is not for every station. Here is where each input belongs.

Why do touchscreens struggle on the floor?

Capacitive screens want a bare fingertip. Nitrile and leather gloves either do not register or register unpredictably, so operators pull a glove off, tap with a knuckle, or keep a stylus on a lanyard. Grease, dust, and coolant smear the glass until the sensor misreads. Screens near wash-down stations get sealed behind a membrane that dulls touch further. Resistive screens accept gloves and wear out faster. We covered the detail in using a touchscreen with work gloves.

Where touch wins: clean, dry stations where gloves come off anyway, and complex HMIs with dense controls that need a fingertip.

Does voice control work in an industrial environment?

Voice is attractive because hands stay on the work. Warehouse picking has used voice headsets for years, and it works well when the vocabulary is small and the headset microphone is close to the mouth. On an open floor it struggles: presses, conveyors, compressors, and hearing protection make recognition unreliable, and a respirator or face shield muffles the speaker. Voice also handles discrete commands, not continuous ones, so scrolling a drawing or zooming a work instruction becomes a string of spoken steps.

Where voice wins: hands-on tasks with a short, fixed command list and a headset already on the worker, such as pick confirmation.

What about physical buttons and HMI panels?

Pushbuttons, selector switches, and membrane keypads are the industrial default for a reason. They work with any glove, they survive wash-down, and an emergency stop should always be a physical button. Their limit is that every function is wired once. A screen that shows work instructions, quality photos, a 3D model, or an MES form needs a pointer, and a button panel cannot provide one without a trackball or a keypad that brings the glove problem back.

Where buttons win: safety functions, machine start and stop, and fixed-function stations. Keep them.

How does gesture control fit on the floor?

AirTouch gesture control and hand tracking software runs on the Windows, Linux, or Android computer behind the display and uses a camera mounted in a housing with a clear view of where the operator stands. A raised open palm takes the cursor, a pinch taps, and mapped gestures send the keys or touch events the application expects, so an operator advances a work instruction, acknowledges an alarm on the HMI, or zooms a drawing without touching the screen or removing a glove. The models are trained for gloved hands, with the Support Color Glove setting for saturated colors, and the camera tracks through a guard or a window, so the display can sit behind a machine enclosure or in a clean room while the operator stays outside. Patented intent detection filters out people passing behind the station in most setups.

The limits are real. Steam, heat shimmer, welding flash, and heavy particulate degrade tracking, so camera placement and a wipeable housing are part of the install, and some stations may call for a specialized camera. Through our partnership with Orbbec, AirTouch also takes advantage of 3D depth sensing and IR cameras when a deployment calls for them. See the Orbbec page. AirTouch is computer input software; it is not a safety-rated control and should never stand in for an interlock or an emergency stop.

Which should you choose?

Can they coexist at one station?

They should. The right station keeps its physical buttons for the machine, its headset for picks if it has one, and adds a camera so the information display answers to a gloved hand. Because AirTouch outputs standard input, the HMI, MES, or work-instruction software does not change, and the IT team installs software rather than rewiring a panel. The food-plant version of this setup is in touchless screens for food plants and warehouses.

Where to start

Choose the station where operators pull their gloves off most often. Book a demo with a photo of the station and its lighting, and we will propose camera placement and a gesture map for the software it runs. To try the interaction first, start a free trial on any PC with a webcam and a pair of work gloves.

Related: touchscreens with work gloves, gesture control for Linux, gesture control for Android displays, gesture control for OEM products, and gesture control and hand tracking software.