Skip to content

Commit

Permalink
docs: fix caikit paths in install script/docs
Browse files Browse the repository at this point in the history
  • Loading branch information
dtrifiro committed Jan 12, 2024
1 parent 4b8de48 commit 5b13980
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
4 changes: 2 additions & 2 deletions demo/kserve/deploy-remove.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ Note: The **flan-t5-small** LLM model has been containerized into an S3 MinIO bu
By default, it requests 4CPU and 8Gi of memory. You can adjust these values as needed.

```bash
oc apply -f ./custom-manifests/caikit-tgis/caikit-tgis-servingruntime"$INF_PROTO".yaml -n ${TEST_NS}
oc apply -f ./custom-manifests/caikit/caikit-tgis/caikit-tgis-servingruntime"$INF_PROTO".yaml -n ${TEST_NS}
```

d. Deploy the MinIO data connection and service account.
Expand All @@ -88,7 +88,7 @@ Note: The **flan-t5-small** LLM model has been containerized into an S3 MinIO bu

```bash
ISVC_NAME=caikit-tgis-isvc$INF_PROTO
oc apply -f ./custom-manifests/caikit/"$ISVC_NAME".yaml -n ${TEST_NS}
oc apply -f ./custom-manifests/caikit/caikit-tgis/"$ISVC_NAME".yaml -n ${TEST_NS}
```

f. Verify that the inference service's `READY` state is `True`.
Expand Down
6 changes: 3 additions & 3 deletions demo/kserve/scripts/test/deploy-model.sh
Original file line number Diff line number Diff line change
Expand Up @@ -52,15 +52,15 @@ oc get ns ${TEST_NS}
if [[ $? == 1 ]]
then
oc new-project ${TEST_NS}
oc apply -f ./custom-manifests/caikit/caikit-tgis-servingruntime"${INF_PROTO}".yaml -n ${TEST_NS}

oc apply -f ./custom-manifests/caikit/caikit-tgis/caikit-tgis-servingruntime"${INF_PROTO}".yaml -n ${TEST_NS}

oc apply -f ${BASE_DIR}/minio-secret-current.yaml -n ${TEST_NS}
oc apply -f ${BASE_DIR}/serviceaccount-minio-current.yaml -n ${TEST_NS}

### create the isvc. First step: create the yaml file
ISVC_NAME=caikit-tgis-isvc"${INF_PROTO}"
oc apply -f ./custom-manifests/caikit/"$ISVC_NAME".yaml -n ${TEST_NS}
oc apply -f ./custom-manifests/caikit/caikit-tgis/"$ISVC_NAME".yaml -n ${TEST_NS}

# Resources needed to enable metrics for the model
# The metrics service needs the correct label in the `matchLabel` field. The expected value of this label is `<isvc-name>-predictor-default`
Expand Down

0 comments on commit 5b13980

Please sign in to comment.