A fork of AIDungeon2 with numerous improvements. Now supporting GPT-Neo.
Also take a look at AIDungeonPastes for some drawn gameplay examples.
- GPT-Neo support
- Complete rewrite of the user interface
- Colored text
- Suggested actions
- Console bell dings when the AI finishes
- Much improved prompt selection
- Ability to save custom prompts
- Half precision floating point using significantly less GPU memory
- Repetition Penalty to reduce AI looping behavior
- A much larger library of fan made starting prompts
- Challenge added with your actions not always succeeding
- A simple config file
- Lots of changes to story history sampling/truncation to hopefully stay on track with longer games
- Eventually hope to improve the AI itself, but this will take some time
Officially we only support local installs. We encourage and recommend installing and running the game locally. However since the beginning most people have been playing it for free on Google's servers through their Colab platform. Allegedly it requires no effort to get started. Try this link and go to the 4chan threads for help and info.
To play with GPU acceleration, you need an Nvidia GPU. (Though some anons claim to have gotten it working with on AMD with ROCm) The original "XL" 1558M parameter model requires at least 4GB of VRAM. Smaller models may consume much less. On CPU, response times vary from about a minute on the XL GPT-2 1558M model, which is slow but usable, to about 6 minutes on GPT-Neo.
After any of the following install steps, you must get one of the models.
- Download this repo. Github has a green download button to the top right that looks like:
[⤓ Code]. Click it, select "Download Zip", then unzip it to a folder. Or you can use the git commandgit clone --depth=1 "https://github.com/cloveranon/Clover-Edition/"if you have git installed. - Go to your Clover Edition folder.
- Run
install.batand follow the on-screen instructions.
- Users have reported that some anti-virus (specifically Kaspersky) isn't happy with the install.bat script. Please whitelist or temporarily disable anti-virus when installing.
- You can partially uninstall by deleting the
venv/folder, and fully uninstall by just deleting the entire Clover Edition folder.
- Install Python or use your package manager (e.g.
sudo apt-get install python3orsudo yum install python3or something). - Download this repo. Github has a green download button to the top right that looks like:
[⤓ Code]. Click it, select "Download Zip", then unzip it to a folder. Or you can use the git commandgit clone --depth=1 "https://github.com/cloveranon/Clover-Edition/"if you have git installed. - Go to your Clover Edition folder.
- Run
sh install.shand follow the on-screen instructions.
- Install Python. The installer should install
pipand it should add it to yourPATHautomatically. Make sure you have the relevant options selected if the installer gives you any options. - Download this repo. Github has a green download button to the top right that looks like:
[⤓ Code]. Click it, select "Download Zip", then unzip it to a folder. Or you can use the git commandgit clone --depth=1 "https://github.com/cloveranon/Clover-Edition/"if you have git installed. - Open a command line or terminal and go to your Clover Edition folder.
- Run:
pip --no-cache-dir install -r requirements/requirements.txt - Install PyTorch (you must do one of the following):
- If you're using an Nvidia GPU with CUDA, run:
pip install -r requirements/cuda_requirements.txt - If you're planning on just using your CPU, run:
pip install -r requirements/cpu_requirements.txt
- If you're using an Nvidia GPU with CUDA, run:
You can have multiple models installed, but you need at least one.
| Model Name | Model Type | Parameters | File Size | RAM | VRAM | Links |
|---|---|---|---|---|---|---|
| finetuneanon's horni - light novel | GPT-Neo | 2.7 billion | 5 GB | 8 GB | 8 GB | [mega] [gdrive] [torrent] |
| finetuneanon's horni | GPT-Neo | 2.7 billion | 5 GB | 8 GB | 8 GB | [mega] [gdrive] [torrent](same as above) |
| EleutherAI | GPT-Neo | 2.7 billion | 10 GB | 12 GB | 8 GB | [huggingface] * |
| Original Clover Edition | GPT-2 | 1.56 billion | 6 GB | 12 GB | 5 GB | [torrent] |
| Collection of 4 models | GPT-2 | 774 million | 3 GB ea | 8 GB | 4 GB | [mega] |
* For EleutherAI's GPT-Neo-2.7B, Download only pytorch_model.bin and make sure it's named that, put it into a new folder named gpt-neo-2.7b (see below for the structure), then copy config.json, merges.txt, and vocab.json from one of finetuneanon's models and put them in the same folder.
16-Bit models are half the size, and load 20 times faster (probably because they run out of RAM and hit the swap space). I found the original AID2 model (pytorch-gpt2-xl-aid2-v5) took 12.6 minutes to load, while the 16 bit version took 37 seconds.
Once downloaded, your model folder should look like this:
./models
└── <MODEL-NAME>
├── config.json
├── merges.txt
├── pytorch_model.bin
└── vocab.json
- Windows: double-click
play.bat - Linux:
sh play.sh - OS-agnostic install:
python launch.py
Install Windows Terminal (recommended) or cmder and use that as your terminal.
I threw together a quick page of some tips here. I plan to throw any links to interesting datasets or guides for training and fine-tuning the AI there. Please send me anything interesting.
Fine-tuning is not currently a push button thing and requires some minimal technical ability. Most people are using the program gpt-simple. You may have more luck with the much more advanced Huggingface-Transformers program that we use to power Clover-Edition. This seems to be their documentation on fine-tuning.
I have made the convert_gpt2_model.py script an idiot proof simple way of quickly converting tensorflow models to PyTorch models. Just run it on the folder containing a tensorflow model and you will get a PyTorch model. You can use the --full flag to get a full 32bit model, but do try 16bit models as they will be potentially half the size for the same accuracy.
See the test-models.py script to test the accuracy of 16 bit mode if you doubt the chad 16BIT models. My tests were well within expectations:
See that github issues page? Post any questions, requests, or problems there if you are willing to create a github account. Unless MicroAndSoft deletes us. Otherwise see:
- Website: 4chan Discussion
- Email: [email protected]
Contributions are more than welcome. You can fork the thing and send a pull request from your fork.
finetuneanon's GPT-Neo-2.7B-horni and horni-ln:
magnet:?xt=urn:btih:31d956ff4a248dcf914b1b7e474cbac02d70d6a4&dn=gtp-neo-horni
Original AIDungeon2 Clover Edition GPT-2:
magnet:?xt=urn:btih:17dcfe3d12849db04a3f64070489e6ff5fc6f63f&dn=model_v5_pytorch&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounce&tr=udp%3a%2f%2fopen.stealth.si%3a80%2fannounce&tr=udp%3a%2f%2fp4p.arenabg.com%3a1337%2fannounce&tr=udp%3a%2f%2ftracker.coppersurfer.tk%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.cyberia.is%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.moeking.me%3a6969%2fannounce&tr=udp%3a%2f%2f9.rarbg.me%3a2710%2fannounce&tr=udp%3a%2f%2ftracker3.itzmx.com%3a6961%2fannounce