Skip to content

Repository files navigation

ko-ahead

About

A simple server supports CPU inference for the port of llama2 model. Use Ktor as http server structure

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages