Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transfer promptsource.seqio_tasks to https://github.com/bigscience-workshop/t-zero #703

Closed
VictorSanh opened this issue Dec 21, 2021 · 2 comments
Assignees

Comments

@VictorSanh
Copy link
Member

Separate promptsource from the tooling specific to the T0 paper

@VictorSanh
Copy link
Member Author

also change the mixture name to something self-explanatory....

@thomasw21
Copy link
Member

Unrelated to the move exactly, but I think we should mention somewhere that running with HF_DATASETS_OFFLINE=1 saves a lot of time when importing those tasks:

> DATASETS_VERBOSITY=error time -p python3 -c "from promptsource import seqio_tasks"
real 199.22
user 36.44
sys 14.02
> HF_DATASETS_OFFLINE=1 DATASETS_VERBOSITY=error time -p python3 -c "from promptsource import seqio_tasks"
real 8.17
user 10.51
sys 12.72

This holds true even if one doesn't actually use the datasets and has already cache the tasks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants