Read the Blog Post on Tensorflow's Blog Coming Soon
This project has been shared extensively across social media, and covered in the press: BBC, Verge, Mashable, Fast Co, Kottke, VentureBeat, NowThis and others
Run the demo in latest Chrome/Firefox to train the model using your own words and corresponding signs/gestures. If you have an Echo plugged in closeby, it should respond, otherwise simply play around and have fun. You will need to give permission to access your webcam and microphone.
To use the code, first install the JavaScript dependencies by running
npm install
Then start the local budo web server by running
npm start
This will start a web server on localhost:9966.
-
Allow permission to your webcam and microphone.
-
Add some words you want to train on.
To learn more about the classifier used in this repo go to KNN Image Classifier
There is a newer version of this classifier released in the new tensorflow.js which can be found here