Code for finetuning GPT models and its variants for text data in Tensorflow
Text dataset is saved in the same directory as 'data_input.txt'
The model used : GPT-2
Packages used:
- Tensorflow
- Transformers
Note:
- Maximum tokens : 1024
- Model : GPT LMHead Model