Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fine Tune with other languages #7

Open
Hilal-Urun opened this issue Mar 24, 2021 · 2 comments
Open

Fine Tune with other languages #7

Hilal-Urun opened this issue Mar 24, 2021 · 2 comments

Comments

@Hilal-Urun
Copy link

Hi, I want to ask that when we are fine tune gpt2 english model with other languages such as Turkish, because of having historical data before fine tune, will there a conflict like when we are chatting the bot can it be use english words? If so, How can we fix it?

@Plkmoi
Copy link

Plkmoi commented Apr 5, 2021

Does the code work nowadays?

@Hilal-Urun
Copy link
Author

Hi @Plkmoi Actually no, In part 5, when visualizing dataset I was getting stuck because for example I run the code in the morning and it did not gave me any results.
This part ;

lang = 'tr'
fname = f'all_texts_{lang}wiki.csv'
df = pd.read_csv(path_data/fname)
print(len(df))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants