预训练时epoch设置问题
#803
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
预训练时epoch设置成多少合适？和输入语料的大小有关吗？输入语料越多，epoch应该是设置得越大还是越小？
比如ptsample.txt ,设置成多大合适，如果我截取ptsample.txt的前面10%的数据用来预训练，epoch需要相应放大还是缩小？
谢谢
Beta Was this translation helpful? Give feedback.
All reactions