monolingual sentence similarity measure
Please cite our NAACL2018 paper if you use our measure or annotations.
title={Reference-less Measure of Faithfulness for Grammatical Error Correction},
author={Choshen, Leshem and Abend, Omri},
booktitle={Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)},
volume={2},
pages={124--129},
year={2018}
}
As USim uses currently the TUPA parser it should be installed
pip install tupa
you should also have a trained model, pretrained ones could be acquired from here.
In addition ucca and the modules for required align submodule should also be installed
pip install ucca
pip install zss
pip install distance
pip install munkres
Usage example (assuming parser module was changed in the code, otherwise add -p flag): python USim.py parse out.out -ss "I love rusty spoons", "nothing matters" -rs "he shares pretty cars", "nothing indeed"