Sign-Language

This project allows our 3D Printed robot arm to hold a conversation by responding to microphone input with sign language. Credit for Cleverbot.py goes to rpbeltran

Required software

• Python 2.7
• SpeechRecognition (Not required for server usage)
  • pip install SpeechRecognition
• PyAudio (Not required for server usage)
  • On Windows/Linux: pip install pyaudio
  • On Linux, it can be installed through APT, but is usually behind in version development
  • On OSX: brew install portaudio && sudo brew link portaudio && pip install pyaudio
• Selenium
  • pip install selenium
• Phantomjs
  • Place the executable on your PATH

Useage

The arm can be operated through the use of a server or through the use of a sole python script. The server crashes fairly often, and is in the process of being replaced. The python script is still in development and has not been fully tested yet. For either, you will need a microphone.

Without using the .NET Server

1. Power Arduino Motor Controller
2. Plug the Arduino Into Computer
3. Upload serial.ino onto the arduino
4. Open the Arduino Environment and go to tools/port in the top menu bar to see wht port the Arduino is using
5. Open the code for server_to_serial.py and change the value of arduino_port on line 4 to the port name the Arduino Environment is showing.
6. Run the bot_to_serial.py script
7. Talk to it, and it will respond

Using the .NET Server

1. Power Arduino Motor Controller
2. Plug Arduino Into Computer
3. Start Webserver. If on Unix or Linux, install mono and run server with mono NetServer.exe
4. Open the Arduino Environment and go to tools/port in the top menu bar to see wht port the Arduino is using
5. Upload serial.ino onto the arduino
6. Open the code for server_to_serial.py and change the value of arduino_port on line 4 to the port name the Arduino Environment is showing.
7. Run the server_to_serial.py script
8. Open the web interface in a recent version of Chrome. Web Speech API wants chrome.
9. Make sure that the interface has permission to access your microphone
10. Talk to it, and it will respond.

Dealing With Bugs

1. NetServer.exe needs to get phased out eventually.
2. If the whole thing crashes, starting the steps over from scratch usually works
3. If the web interface hangs, restart it. This is web speech API acting up.