Skip to content
/ Signia Public

An interactive machine learning-based system for learning sign languages [school project]

Notifications You must be signed in to change notification settings

Lermex/Signia

Repository files navigation

Signia

Signia is an interactive system for learning sign languages that uses Machine Learning to recognize the user's signs through his PC camera. The general teaching style is inspired by Duolingo

This is a programming demo project created for UEL.

Screenshot

Technologies

We combine JavaFX and JFoenix for the UI with OpenCV for direct camera access and TensorFlow running Google's ImageNet neural network for image recognition.

Building / Running

This project is built using Gradle. Install Gradle on your machine or use the supplied wrapper, then either:

  1. To build an executable uberjar (i.e. a jar containing all dependencies)
gradle shadowJar
  1. To run directly from Gradle:
gradle runShadow

Retraining the image recognition neural network (a TensorFlow graph)

The ML graph used by this project can be reproduced or modified by following the TensorFlow for Poets tutorial from Google

About

An interactive machine learning-based system for learning sign languages [school project]

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages