An automated bar ordering system for making orders in a bar using hand gestures.
The purpose of this project was to develop an ordering system for a bar where orders were made only by using static hand gestures. With the help of a Leap Motion controller, we used Machine Learning to train a model to recognize 8 different hand gestures, in which the user could (with the support of the UI) navigate the ordering system ordering any number of drinks, foods and even to select payment option solely by using hand gestures.
Paper available here.
- Static hand gesture recognition.
- Voice and written response to different gestures.
- Simple to add new gestures.
$ py mainProgram.py
Save each gesture multiple times using: $ py saveGesturesRaw.py #
Where # is an integer representing each gesture.
$ py training/training.py
Flow chart of the UI. The user interacts using gestures and receives both
written and spoken response.
- Init.
- Alcoholic drink.
- Non alcoholic drink.
- Food.
- Undo.
- Checkout.
- Pay with cash.
- Pay with credit card.
See our blog from the project here.
