Skip to content

Commit

Permalink
add supported models
Browse files Browse the repository at this point in the history
Signed-off-by: Kevin-Yang <[email protected]>
  • Loading branch information
jason9693 committed Oct 26, 2024
1 parent 5a6c30b commit 4f50cb8
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions docs/source/models/supported_models.rst
Original file line number Diff line number Diff line change
Expand Up @@ -324,6 +324,28 @@ Reward Modeling
.. note::
As an interim measure, these models are supported via Embeddings API. See `this RFC <https://github.com/vllm-project/vllm/issues/8967>`_ for upcoming changes.

Classification
---------------

.. list-table::
:widths: 25 25 50 5 5
:header-rows: 1

* - Architecture
- Models
- Example HF Models
- :ref:`LoRA <lora>`
- :ref:`PP <distributed_serving>`
* - :code:`Qwen2ForSequenceClassification`
- Qwen2-based
- :code:`jason9693/Qwen2.5-1.5B-apeach`, etc.
-
- ✅︎

.. note::
As an interim measure, these models are supported via Embeddings API. See `this RFC <https://github.com/vllm-project/vllm/issues/8967>`_ for upcoming changes.


Multimodal Language Models
^^^^^^^^^^^^^^^^^^^^^^^^^^

Expand Down

0 comments on commit 4f50cb8

Please sign in to comment.