New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

有关构造dataloader的问题 #55

Open

oulin1031esti opened this issue Nov 10, 2022 · 1 comment

oulin1031esti commented Nov 10, 2022

预训练代码中哪部分确保在每个训练batch中包含了pair，record，text三种数据

hudaoling commented Nov 21, 2022

目前来看只能学一种，我也是想三种任务一起学。
论文里面也降到了loss 相加，但是预训练代码该如何该呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment