Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

finetung使用自回归还是非自回归的效果差异？ #16

Open
bigprince97 opened this issue Jan 7, 2021 · 0 comments
Open

finetung使用自回归还是非自回归的效果差异？ #16

bigprince97 opened this issue Jan 7, 2021 · 0 comments

Comments

@bigprince97
Copy link

unilm在fine-tuing时可以使用自回归，类似于语言模型的训练，不过没法充分利用上预训练时的decode能力，也可以使用和预训练阶段一样的非自回归的形式，但是这样感觉训练效率较低，实际比较过后，两者的效果差异不明显，请问下作者有没进行过类似的比较？
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bigprince97