Skip to content

GestureBasedNavigation is a Unity plugin for hands-free UI control using real-time hand gestures. Perfect for AR/VR, kiosks, and interactive displays.

Notifications You must be signed in to change notification settings

realmoctopus/GestureBasedNavigation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 

Repository files navigation

GestureBasedNavigation Plugin for Unity

GestureBasedNavigation Thumbnail

πŸŽ₯ Demo Video
https://www.youtube.com/watch?v=4YJS3TQ0Sy4

πŸ›’ Unity Asset Store
https://assetstore.unity.com/packages/tools/ai-ml-integration/gesturebasednavigation-336492

πŸͺ Publisher Page
https://assetstore.unity.com/publishers/103532


πŸ“Œ Introduction

GestureBasedNavigation is a Unity plugin that enables hands-free UI interaction using real-time hand gestures.

Instead of traditional input devices such as mouse, touch, or controllers, users interact with UI elements using natural hand movements like pointing, swiping, holding, and sliding.

The plugin tracks the index finger position, converts it into screen coordinates, and triggers UI actions such as button clicks, scrolling, page navigation, and carousel switching.

It works from up to 18 feet away, supports left and right hands independently, and is fully Inspector-driven, requiring no code changes to use or customize.

This makes it ideal for immersive experiences, kiosks, AR/VR environments, exhibitions, and gesture-controlled applications.


πŸš€ Key Features

  • Gesture-Based Button Click (point & hold interaction)
  • Gesture-Based Page Navigation (swipe left / right)
  • Gesture-Based Scrolling (vertical & horizontal)
  • Gesture-Based Sliding (UI panels, images, carousels)
  • Gesture-Based UI Hover & Selection (3D & canvas UI)
  • Gesture-Based Filter Swiping (ideal for product browsing)
  • Gesture-Based Lens / Effect Carousel
  • Real-Time Hand Tracking (left & right hands detected separately)
  • Works from up to 18 feet distance
  • High-performance processing (up to 60 FPS)
  • Fully Inspector-configurable
  • 5 Pre-configured Demo Scenes included

🌍 Platform Support

  • βœ… Windows
  • βœ… macOS
  • βœ… Linux
  • ⚠️ Android & iOS
    • Requires additional camera setup
    • Uses Lite model inference for optimal mobile performance

🧩 Use Cases

  • Virtual Mirror Product Selection
  • Hands-Free UI Button Interaction
  • Page Navigation on Virtual Screens
  • Gesture-Based Product Scrolling
  • Retail & Event Kiosks
  • Museum & Exhibition Installations
  • AR / VR Navigation Interfaces
  • Gesture-Controlled Product Filters
  • Custom Gesture-Driven Experiences

⚑ Performance Notes

  • Optimized for real-time interaction
  • Best results in well-lit environments
  • Supports smooth cursor motion and natural gesture flow
  • Designed for both large displays and close-range interaction

πŸ“© Support & Contact

For support, feedback, or feature requests:

  • πŸ“§ Email: realmoctopus@gmail.com
  • 🌐 Unity Asset Store Support:
    Contact via the plugin’s Asset Store page

⭐ Support the Project

If you find this plugin useful:

  • ⭐ Star this repository on GitHub
  • πŸ“ Leave a review on the Unity Asset Store
  • πŸ” Share it with other Unity developers

Happy building with gestures! πŸš€

Releases

No releases published

Packages

No packages published