Separate Secret and ISVC YAML for Hugging Face runtime example (#409)

* Separate Secret and ISVC YAML for Hugging Face runtime example Signed-off-by: Yuan Tang <[email protected]> * Update README.md Signed-off-by: Dan Sun <[email protected]> --------- Signed-off-by: Yuan Tang <[email protected]> Signed-off-by: Dan Sun <[email protected]> Co-authored-by: Dan Sun <[email protected]>
kserve · Oct 20, 2024 · c3d1b52 · c3d1b52
1 parent f2af31a
commit c3d1b52
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md b/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md
@@ -13,6 +13,7 @@ If the model is not supported by vLLM, KServe falls back to HuggingFace backend
 Create a secret with the Hugging Face token.
 
 === "Yaml"
+
     ```yaml
     apiVersion: v1
     kind: Secret
@@ -23,6 +24,8 @@ Create a secret with the Hugging Face token.
         HF_TOKEN: <token>
     ```
 
+Then create the inference service.
+
 === "Yaml"
 
     ```yaml
@@ -190,6 +193,7 @@ Create a secret with the Hugging Face token.
     stringData:
         HF_TOKEN: <token>
     ```
+Then create the inference service.
 
 === "Yaml"