Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Docs] Add resources of OpenAI GPT #20084

Merged
merged 8 commits into from
Nov 16, 2022
Merged

[Docs] Add resources of OpenAI GPT #20084

Changes from 3 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
b25fcdd
Add resources of OpenAI GPT
shogohida Nov 6, 2022
714dde1
Delete Deploy section and add .
shogohida Nov 8, 2022
e17ac2e
Add scripts
shogohida Nov 13, 2022
051cc90
Update docs/source/en/model_doc/openai-gpt.mdx
shogohida Nov 15, 2022
f994e7b
Delete causal-language-modeling section
shogohida Nov 15, 2022
f8daf42
Add TFOpenAIGPTLMHeadModel
shogohida Nov 15, 2022
3c1d4e0
Add resources from community
shogohida Nov 15, 2022
25be418
Delete a link
shogohida Nov 16, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions docs/source/en/model_doc/openai-gpt.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,27 @@ python -m spacy download en
If you don't install `ftfy` and `SpaCy`, the [`OpenAIGPTTokenizer`] will default to tokenize
using BERT's `BasicTokenizer` followed by Byte-Pair Encoding (which should be fine for most usage, don't worry).

## Resources

A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with DistilBERT. If you're interested in submitting a resource to be included here, please feel free to open a Pull Request and we'll review it! The resource should ideally demonstrate something new instead of duplicating an existing resource.

<PipelineTag pipeline="text-classification"/>

- A blog post on [outperforming OpenAI GPT-3 with SetFit for text-classification](https://www.philschmid.de/getting-started-setfit).

<PipelineTag pipeline="text-generation"/>

- OpenAI GPT is supported by this [example script](https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-generation/run_generation.py) and [notebook](https://colab.research.google.com/github/huggingface/blog/blob/main/notebooks/02_how_to_generate.ipynb).
shogohida marked this conversation as resolved.
Show resolved Hide resolved

<PipelineTag pipeline="token-classification"/>

- A course material on [Byte-Pair Encoding tokenization](https://huggingface.co/course/en/chapter6/5).
- A course material on [training a causal language model from scratch](https://huggingface.co/course/en/chapter7/6).
stevhliu marked this conversation as resolved.
Show resolved Hide resolved

<PipelineTag pipeline="causal-language-modeling"/>
shogohida marked this conversation as resolved.
Show resolved Hide resolved

- OpenAI GPT is supported by this [example script](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py).

## OpenAIGPTConfig

[[autodoc]] OpenAIGPTConfig
Expand Down