Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Training PEFT models with new tokens being added to the embedding layers and tokenizer #1147

Merged
merged 20 commits into from
Nov 29, 2023
Merged

Training PEFT models with new tokens being added to the embedding layers and tokenizer #1147

Show file tree
Hide file tree
Changes from 19 commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
0584b07
add support for saving base layers weights along with adapter weights
pacman100 Nov 17, 2023
a9e088f
Update save_and_load.py
pacman100 Nov 17, 2023
6993d9a
Add an example showing the usage of the added feature
pacman100 Nov 17, 2023
5dbdc08
refactor the functionality
pacman100 Nov 28, 2023
c65326b
fix
pacman100 Nov 28, 2023
53dd74b
refactoring code
pacman100 Nov 28, 2023
f6e997e
update example
pacman100 Nov 28, 2023
565e533
fix the model card
pacman100 Nov 28, 2023
8b32e5a
fix model card
pacman100 Nov 28, 2023
8211bd9
😅
pacman100 Nov 28, 2023
bd5841f
fix model card
pacman100 Nov 28, 2023
dba9fac
automate setting `is_embedding_layer_resized`
pacman100 Nov 28, 2023
479a3a4
nits
pacman100 Nov 28, 2023
ff5f8dd
Merge branch 'main' into smangrul/add-support-for-additional-tokens-t…
pacman100 Nov 28, 2023
49fc5fa
Update peft_lora_clm_with_additional_tokens.ipynb
pacman100 Nov 28, 2023
d6193c8
add test
pacman100 Nov 29, 2023
43225fc
fix tests
pacman100 Nov 29, 2023
bc15216
maybe fixes the issue?
pacman100 Nov 29, 2023
245f9fe
address comments
pacman100 Nov 29, 2023
3a336f4
Apply suggestions from code review
pacman100 Nov 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading