Some CLI commands are unexpectedly slow #8058
Labels
area:rasa-oss/cli
Issues focused on the rasa command-line-interface
area:rasa-oss 🎡
Anything related to the open source Rasa framework
effort:atom-squad/4
Label which is used by the Rasa Atom squad to do internal estimation of task sizes.
type:bug 🐛
Inconsistencies or issues which will cause an issue or problem for users or implementors.
type:maintenance 🔧
Improvements to tooling, testing, deployments, infrastructure, code style.
Rasa version: 2.3.1 (used
main
branch, commit hash:2574c46e9576607a7b8de39f823ff3e5c01a475c
)Rasa SDK version (if used & relevant): 2.3.1
Rasa X version (if used & relevant):
Python version: 3.7 / 3.8
Operating system (windows, osx, ...): MacOS / Windows
Issue:
We made an investigation of how long it takes to execute tests, and one of the conclusions that can certainly be made is that some CLI tests are unexpectedly slow.
Several examples:
tests/cli/test_rasa_train.py::test_train_help
,tests/cli/test_rasa_train.py::test_train_nlu_help
and other similar commands often take 5 seconds. But all of them are just some simple commands that only print some help information.tests/cli/test_cli.py::test_cli_start
might take up to 20 seconds on Windows (it just executesrasa --help
and should be really fast)Here you can find more information about the time it takes to execute CLI tests: https://gist.github.com/alwx/fc3334473b046231f1ed35b0bd6e30e3
See more details about time measurements: https://docs.google.com/spreadsheets/d/1tDRD0vWaLW91W1wPj5h__dwXuXioRt9aBPYyF1n4MjI/edit#gid=57091041
Definition of done:
--help
commands run in less than 1sCommand or request that led to error:
The text was updated successfully, but these errors were encountered: