Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

t5-pegasus输出异常 #70

Open
GzmCR opened this issue Jul 13, 2023 · 2 comments
Open

t5-pegasus输出异常 #70

GzmCR opened this issue Jul 13, 2023 · 2 comments

Comments

@GzmCR
Copy link

GzmCR commented Jul 13, 2023

您好，我在跑imxly/t5-pegasus时发现模型输出特别大，导致loss一致在80多降不下来，您知道是什么原因吗
image
@renmada
Copy link
Owner

renmada commented Jul 18, 2023

原版的tf权重没有100%转过来，微调时多训练几个epoch，loss会正常

@GzmCR
Copy link
Author

GzmCR commented Jul 18, 2023

原版的tf权重没有100%转过来，微调时多训练几个epoch，loss会正常
感谢解答！还想问问能分享一下如何将tf权重转pytorch嘛，想学习学习

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@renmada @GzmCR