Python CLI tool for converting models into npc-engine server format.
You can install it via pip. Import wizards might have their own extra requirements.
e.g.
pip install npc-engine-import-wizard[transformers]
You can use the CLI tool to convert models from popular libraries into npc-engine services.
To start the wizard, run the following command:
npc-engine-import-wizard import --models-path <path-to-models> <model-path-or-id>
It will prompt you to select the import wizard for the model.
Each service has its own set of import wizards for each library.
It will also omit import wizards that lack their extras installed
(i.e. with npc-engine-import-wizard[transformers] you will only see
import wizards for transformers library).
1. HfChatbotImportWizard
ImportWizard for converting HF transformer models into text gen services.
2. HfClassifierImportWizard
ImportWizard for converting HF classification transformer models.
3. HfSimilarityImportWizard
ImportWizard for converting HF semantic similarity transformer models.
You can also list all available import wizards which will also give you detailed readme for each one.
npc-engine-import-wizard list-wizards
- 🤗 Transformers
There are three import wizards for transformers available for different tasks:
1. HfChatbotImportWizard
ImportWizard for converting HF transformer models into text gen services.
2. HfClassifierImportWizard
ImportWizard for converting HF classification transformer models.
3. HfSimilarityImportWizard
ImportWizard for converting HF semantic similarity transformer models.
- NVIDIA's Flowtron + Waveglow import wizard for TTS.
- ESPNet2 import wizard thanks to the espnet_onnx project.