"rasa test core --evaluate-model-directory" should have directory as default #4896
Labels
area:rasa-oss 🎡
Anything related to the open source Rasa framework
type:bug 🐛
Inconsistencies or issues which will cause an issue or problem for users or implementors.
Steps to Reproduce:
rasa init
)rasa train
)rasa test core --evaluate-model-directory
Problem:
By default
rasa test core
has the latest model in the./models
directory as default value for the--model
parameter.This can lead to the following error:
In case there is a regular model in the
models
directory, this will be assumed as latest model. However,rasa test core --evaluate-model-directory
expects a directory and will fail with an error like this:Proposed Solutions
This can by automatically taking the directory instead of the file in case the user used the
--evaluate-model-directory
flag.Other things to check and potentially create a new issue for it:
In case the models directory is empty (except the
run
folders from the comparison training) the default value for--models
isNone
. So we have to actively check if there is aNone
value in the passed models list.The text was updated successfully, but these errors were encountered: