Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

updates readme for releases #157

Merged
merged 3 commits into from
Apr 16, 2024
Merged

updates readme for releases #157

merged 3 commits into from
Apr 16, 2024

Conversation

edbeeching
Copy link
Collaborator

adds more details of the datasets and contributing.

@qgallouedec
Copy link
Member

srun accelerate launch $WORK/gia/scripts/train_jat_tokenized.py \
    --output_dir $WORK/checkpoints/jat_small_v100 \
    --model_name_or_path jat-project/jat-small \
    --tasks all \
    --trust_remote_code \
    --per_device_train_batch_size 20 \
    --gradient_accumulation_steps 2 \
    --save_steps 10000 \
    --run_name train_jat_small \
    --logging_steps 100 \
    --logging_first_step \
    --dispatch_batches False \
    --dataloader_num_workers 16 \
    --max_steps 250000 \
    --resume_from_checkpoint checkpoints/jat_small_v100/checkpoint-220000

@edbeeching edbeeching merged commit cb75f39 into main Apr 16, 2024
3 checks passed
@edbeeching edbeeching deleted the update-readme branch April 16, 2024 09:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants