Skip to content

A simple server supports CPU inference for the port of llama2 model. Use Ktor as http server structure

Notifications You must be signed in to change notification settings

Snowishyl/ko-ahead

Repository files navigation

ko-ahead

About

A simple server supports CPU inference for the port of llama2 model. Use Ktor as http server structure

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published