This is a short tutorial for using the CMU-MultimodalSDK.
First of all you need to download the SDK from here.
After that you will need to clone this repo and set up some file paths in ./constants/paths.py
. The comments there should be self-explanatory.
If you have downloaded pretrained embeddings such as GloVe on your hard drive, you can setup the path to them in ./constants/paths.py
for improved performance.
Note that in the ./data/
directory there is a ./CMU_MOSI_ModifiedTimestampedWords.csd
. This is an updated copy of transcripts compared to what the SDK is currently offering by default and improves the performance by a observable margin. If you are changing the DATA_PATH
in ./constants/paths.py
, please also copy this file to your specified location.
Then you are good to go, just open the ./tutorial_interactive.ipynb
notebook in jupyter notebook and walk through its content!