Gesture Controls
Gesture control is the core intelligence of Gestro, allowing you to execute complex system and application commands using simple hand signs.
How It Works
Gestro uses a lightweight, highly optimized neural network to track 21 distinct 3D landmarks on your hand at 30-60 frames per second. It evaluates the relative positions of your fingers to determine if a specific gesture is being held.
Supported Gestures & Default Actions
Below is the standard library of recognizable gestures. You can map these to almost any action in the application.
| Gesture | Icon | Common Purpose | Example Action |
|---|---|---|---|
| Peace | ✌️ | Alternate action / Navigation | Switch Tabs, Next Track |
| Rock | 🤘 | Heavy action / Media | Maximize Window, Play Heavy Metal |
| Open Hand | 🖐️ | Pause / Stop / Attention | Pause Media, Pause Gestro Tracking |
| Raised Palm | ✋ | Stop / Cancel / Block | Close Application, Cancel Voice Macro |
| OK / Pinch | 👌 | Select / Click / Precision | Confirm Dialog, Enter Air Mouse |
| Thumbs Up | 👍 | Confirm / Positive / Up | Volume Up, Scroll Up |
| Thumbs Down | 👎 | Reject / Negative / Down | Volume Down, Scroll Down |
| Closed Fist | ✊ | Close / Grab / Action | Close Window, Grab Screen |
| Joined Hands | 🤝 | Hybrid / Special | Trigger specific macro |
Important Concepts
- Gesture Confidence: The AI requires a certain confidence threshold (default 80%) before triggering an action to prevent accidental fires.
- Gesture Cooldown: After an action is triggered, Gestro enforces a brief cooldown (e.g., 500ms) so you don't accidentally trigger an action 30 times in one second.
- Detection Environment:
- Distance: Optimal distance is 0.5m to 1.5m from the camera.
- Lighting: Ensure your room is moderately lit. Harsh backlighting (e.g., a bright window behind you) will severely degrade accuracy.
- Visibility: Your entire hand must be visible within the camera frame.
Customizing Mappings
You are not locked into our defaults! Navigating to the Mappings tab allows you to completely remap any gesture. Crucially, gestures are context-aware. A Thumbs Up can mean "Volume Up" on the Desktop, but "Like this video" when YouTube is your active window. Read more in Application Mapping.