Face Tuner is an openFrameworks application that visualizes pitch accuracy through human facial emotions.
This application currently allows the user to select a target note, takes in audio input from the external microphone, and matches it to a corresponding facial emotion that is then displayed on a 3D facial animation.
See the project proposal and documentation for more specific details.
The only dependencies needed are openFrameworks addons.
- ofxGui was used to create the display panel in the window. This is automatically installed along with openFrameworks.
- ofxAubio was used to analyze the input audio. Only the pitch detection method was used, which measures in MIDI number rather than hz.
- ofxFacialBlendShape was used to generate a 3D face model and display facial emotions.
- ofxDropdown was used to create a dropdown menu that allows the user to select a target note.
Below are some screenshots of the application's main window.
No target note selected:
Measured pitch matches target pitch:
Measured pitch is not accurate:
