Gesturio
The main goal of this project is to create an app for learning sign language (particularly dactil alphabet) in a game form. This work can as well be considered as just an application of the algorithm of static gestures recognition.
There are lots of other uses of this algorithm. For example, in magic games the player can be given the opportunity to cast a spell as a sequential combination of different gestures (as in my favourite game Magica), or perform various operations on the object using just gestures and without any need to open a context menu.
The app currently supports two languages (American and Russian) and one experimental mode with various assumed gestures such as: Like, Dislike, Lizard etc. While in a SandBox mode user can as well add his own gesture.
Also available on Github pages
The source code and the installation instruction can be found in official repository
Also available as a single library gesturio.js
Dear C# developers, this library needs your help to be rewritten on C# =)
Some information about the recognition method.
In conclusion it's worth mentioning that precision of gesture recognition depends on the quality of gesture capture done by LeapMotion controller. The current level of quality of gesture capture is enough for successful recognition of the majority of gestures. But there are some gestures that are difficult to recognition (distinguish the gesture meaning "S" from the gesture "A" or the gesture "V" from "K", "M", "N").
Status | Released |
Platforms | HTML5, Windows, macOS, Linux |
Rating | Rated 5.0 out of 5 stars (3 total ratings) |
Author | Aitem |
Tags | 3djam, Leap Motion |
Code license | MIT License |
Average session | A few minutes |
Languages | English, Russian |
Inputs | Leap Motion |
Download
Install instructions
Extract containing files to your localhost folder.
For run full development environment see official repository.
Comments
Log in with itch.io to leave a comment.
Opening the index.html from the git zip produces a "The file or directory could not be found" error.
Hi!
I uploaded new archive. Just try again
index.html file in the root of repository is just iframe to release folder for github pages
Release folder contain all builded files, and archive them. This archive also uploaded in intch.io adn playing in game page
There are two ways how you can run this app locally
Looks good embedded in the page, that definitely makes it much easier to check out!