Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

当我跑Run Evaluation Benchmarks的Basic NLP Tasks出现错误 #8

Open
guoguo1314 opened this issue Aug 6, 2024 · 0 comments
Open

Comments

@guoguo1314
Copy link

guoguo1314 commented Aug 6, 2024

执行main.py
CUDA_VISIBLE_DEVICES=0 python main.py --models hf_opt_125m --datasets SuperGLUE_BoolQ_ppl --work-dir ./outputs/debug/api_test --w_bit 8
出现这个错误
(qllm_eval) lyg@lyg-System-Product-Name:~/Codes/score/qllm-eval$ CUDA_VISIBLE_DEVICES=0 python /home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py --models /home/lyg/Pth/ai-modelscope/opt-125 --datasets SuperGLUE_BoolQ_ppl --work-dir ./outputs/debug/api_test --w_bit 8
Traceback (most recent call last):
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py", line 356, in
main()
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py", line 224, in main
cfg = get_config_from_arg(args)
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/utils/run.py", line 101, in get_config_from_arg
for dataset in match_cfg_file(datasets_dir, args.datasets):
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/utils/run.py", line 62, in match_cfg_file
raise ValueError(err_msg)
ValueError: The provided pattern matches 0 or more than one config. Please verify your pattern and try again. You may use tools/list_configs.py to list or locate the configurations.
+------------------------+

Not matched patterns
SuperGLUE_BoolQ_ppl
+------------------------+
当我将dataset文件夹改为如下这样
CUDA_VISIBLE_DEVICES=0 python /home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py --models /home/lyg/Pth/ai-modelscope/opt-125 --datasets /home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/data/data/SuperGLUE/BoolQ --work-dir ./outputs/debug/api_test --w_bit 8
还是会出现上面的错误,
(qllm_eval) lyg@lyg-System-Product-Name:~/Codes/score/qllm-eval$ CUDA_VISIBLE_DEVICES=0 python /home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py --models /home/lyg/Pth/ai-modelscope/opt-125 --datasets /home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/data/data/SuperGLUE/BoolQ --work-dir ./outputs/debug/api_test --w_bit 8
Traceback (most recent call last):
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py", line 356, in
main()

File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/main.py", line 224, in main
cfg = get_config_from_arg(args)
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/utils/run.py", line 101, in get_config_from_arg
for dataset in match_cfg_file(datasets_dir, args.datasets):
File "/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/utils/run.py", line 62, in match_cfg_file
raise ValueError(err_msg)
ValueError: The provided pattern matches 0 or more than one config. Please verify your pattern and try again. You may use tools/list_configs.py to list or locate the configurations.
+----------------------------------------------------------------------------------------------+

Not matched patterns
/home/lyg/Codes/score/qllm-eval/qllm_eval/evaluation/q_opencompass/data/data/SuperGLUE/BoolQ
+----------------------------------------------------------------------------------------------+
请问,这种该怎么解决?谢谢
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant