Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduce results on Office-31 #8

Open
kuztown opened this issue May 20, 2020 · 2 comments
Open

Reproduce results on Office-31 #8

kuztown opened this issue May 20, 2020 · 2 comments

Comments

@kuztown
Copy link

kuztown commented May 20, 2020

Hi!
I'm trying to reproduce results on Office-31.
I've trained each experiment 10 times. I've selected the best results in each train(not the last one). I've calculated average of 10 samples and it is worse in D->A: in paper result is 78, my result is 77,
in D->W: in paper result is 99.1, my is 98.3 and W->A: in paper result is 77, my result is 75.6.
Can you help me with this issue?

@kuztown kuztown changed the title Reproduce Office-31 Reproduce results on Office-31 May 20, 2020
@Ledzy
Copy link

Ledzy commented May 26, 2020

Same problem for me.
Actually i found the parameter "FILTER_THRESHOLD" in the config file makes big difference. According to what i found, set it to 0.05 would increase about 2% accuracy on a->d, compared with 1, i.e. no filtering. You may try different values for the parameter to see if it works.

@kuztown
Copy link
Author

kuztown commented Jun 4, 2020

Thank you for your reply
I've trained with different FILTER_THRESHOLD(0.05, 0.5, 0.75) on d->a. Unfortunately, accuracy wasn't increased

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants