Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

coco测试指标问题 #43

Open
WHL182 opened this issue Oct 9, 2022 · 2 comments
Open

coco测试指标问题 #43

WHL182 opened this issue Oct 9, 2022 · 2 comments

Comments

@WHL182
Copy link

WHL182 commented Oct 9, 2022

您好！
我想关于coco指标问题想向您请教一个问题，我加载了您提供的5-shot coco预训练权重，在test_num为1000的时候，我得不到您论文所给的结果，基本下降了3个百分点，在测试文件我也固定了随机因子，我将yaml文件的shot改为了5。我想问一下你论文中的结果是test_num为1000的结果还是多少？
@happycoding1996
Copy link

happycoding1996 commented Oct 13, 2022 •
edited
Loading

1000个test sum太小，波动太大，通过这样得到的结果，和其它方法对比不同种子的话实验很不公平。

同样涉及不公平对比的问题，还请作者回答一下

#42

@caoql98
Copy link

caoql98 commented Jan 13, 2023

我一般采用随机选多个种子，多跑几次测试，最后取最高的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@happycoding1996 @WHL182 @caoql98