Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Best Hyperparameter Settings #66

Closed
Demirrr opened this issue Jul 27, 2020 · 5 comments
Closed

Best Hyperparameter Settings #66

Demirrr opened this issue Jul 27, 2020 · 5 comments

Comments

@Demirrr
Copy link

Demirrr commented Jul 27, 2020

Dear Tim,

thank you for the great work.

  • I was wondering whether you could provide the best found hyperparameter settings of ConvE on WN18RR, FB15k-237, UMLS and Kinship.

  • 209 number of the entities that occur on test split of WN18RR can not be found on the train split of WN18RR. Consequently, I was wondering whether you are aware of it. If so, what is the supporting argument for creating entities that are do not occur during training.

Cheers

@TimDettmers
Copy link
Owner

Thanks for the questions and sorry for getting back so late. Here my answers:

  • I did not explore hyperparameters fully but it seemed that the default configuration by the code works best for most datasets and for FB15k-237 you want to use a bit extra regularization. See No able to reproduce results on FB15K237 #52 for more information.
  • Yes, I am aware of this. This is rather unfortunate and I did not realize this when I created the dataset. However, if everyone is using the same dataset then this does not matter. It just inflates the test error slightly for everyone but the scores are still comparable.

@Demirrr
Copy link
Author

Demirrr commented Aug 29, 2020

Appreciated!

@Demirrr
Copy link
Author

Demirrr commented Sep 9, 2020

Sorry @TimDettmers but I forgot to ask whether one could find the number of parameters of DistMult, ComplEx and ConvE on YAGO.

@TimDettmers
Copy link
Owner

Please see issues #57 #64. If these issues do not answer your question, please let me know!

@Demirrr
Copy link
Author

Demirrr commented Sep 11, 2020

I have the all info needed!

Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants