Explanation
EMG (electromyography) measures the electrical signals produced by muscles during contraction. In XR, this technology enables detection of finger and hand movement intent via a wristband, without a camera or controller. Meta is actively developing this approach with its neural wristband for interacting with AR glasses through imperceptible micro-gestures.
Real-world example
With an EMG wristband on your wrist, you lightly pinch your thumb and index finger to click in an AR interface, without anyone around noticing your gesture.
Practical applications
- Discreet interaction: controlling AR glasses through invisible micro-gestures
- Fine precision: detecting movement intent before the visible gesture occurs
- Accessibility: an alternative for users with limited mobility
- Hand tracking complement: works even when hands are not visible to cameras
EMG applications in XR
Neural wristband (Meta)
- EMG sensors at the wrist
- Micro-gesture detection
- Paired with Orion AR glasses
Example: Pinch to select, slide to scroll in an AR interface
Rehabilitation and healthcare
- Measuring muscle activity
- Gamified VR exercises with biofeedback
- Tracking rehabilitation progress
Example: A patient rehabilitating their hand in VR with real-time EMG feedback
Prosthetic control
- Controlling prosthetics via muscle signals
- VR training before fitting
- Personalized calibration
Example: VR training to learn how to control a hand prosthesis
VR scenario
A surgeon wears AR glasses and an EMG wristband during an operation. They consult medical imaging projected in their field of view and navigate between views with subtle finger movements, without letting go of their instruments. No assistant notices their commands.
Why it matters in professional VR
- EMG paves the way for XR interaction without a controller or visible gesture
- A key technology for consumer AR glasses (discreet social use)
- Complementary to hand tracking and eye tracking
- Meta considers EMG the primary input interface for its future glasses