Skip to content
This repository has been archived by the owner on Oct 24, 2024. It is now read-only.

Commit

Permalink
fix(axolotl): set dataset prepared path
Browse files Browse the repository at this point in the history
  • Loading branch information
kwaa committed Apr 22, 2024
1 parent 522db19 commit ec11da8
Show file tree
Hide file tree
Showing 4 changed files with 8 additions and 2 deletions.
6 changes: 5 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,11 @@ datasets/**
models/**
!models/.gitkeep

# Huggingface Cache Dir
# Dataset Prepared Path
last_run_prepared/**
!last_run_prepared/.gitkeep

# Huggingface Cache
huggingface/*
!huggingface/accelerate/
!huggingface/.gitkeep
Expand Down
1 change: 1 addition & 0 deletions docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ services:
- ./datasets/:/workspace/datasets/
- ./models/:/workspace/models/
- ./out/:/workspace/out/
- ./last_run_prepared/:/workspace/last_run_prepared/
- ./huggingface/:/root/.cache/huggingface/
environment:
- HF_HUB_OFFLINE=1
Expand Down
Empty file added last_run_prepared/.gitkeep
Empty file.
3 changes: 2 additions & 1 deletion lora.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,8 @@ datasets:
# - path: mhenrichsen/alpaca_2k_test
- path: /workspace/datasets/alpaca_2k_test/alpaca_2000.parquet
type: alpaca
dataset_prepared_path:
# dataset_prepared_path:
dataset_prepared_path: /workspace/last_run_prepared
val_set_size: 0.05
# output_dir: ./lora-out
output_dir: /workspace/out
Expand Down

0 comments on commit ec11da8

Please sign in to comment.