Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The experimental results are not satisfactory. #12

Open
wangkaibo12138 opened this issue Apr 29, 2024 · 2 comments
Open

The experimental results are not satisfactory. #12

wangkaibo12138 opened this issue Apr 29, 2024 · 2 comments

Comments

@wangkaibo12138
Copy link

Hello, after I followed the readme you provided for the experiment, why is the displayed effect significantly different from what is proposed in the text? Is it due to equipment or parameter settings?

@yzhangee
Copy link
Collaborator

Hi, can you post your equipment, parameter setting, and the displayed effect here?

@jsh-hit
Copy link

jsh-hit commented Nov 26, 2024

hi,i have the same questions(inductive),mainly on the fb237 dataset.The results of the wn18rr dataset are basically similar to those in the paper.I haven't tried the nell dataset yet.
`fb15k-237_v1 [TEST] MRR:0.3514 H@1:0.2798 H@10:0.4623 [Paper]MRR:0.369 H@1:0.302 H@10:0.483

fb15k-237_v2 [TEST] MRR:0.4314 H@1:0.3405 H@10:0.6019 [Paper]MRR:0.469 H@1:0.381 H@10:0.629

fb15k-237_v3 [TEST] MRR:0.4078 H@1:0.3200 H@10:0.5595 [Paper]MRR:0.445 H@1:0.351 H@10:0.603`

Hyperparameter settings follow exactly from your code.
my equipment:RTX4090 with 24GB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants