docs: nits

This commit is contained in:
Nicole Zhu 2024-03-14 21:12:16 +08:00
parent 1fe3dff875
commit 70fc24f6f1

View File

@ -5,6 +5,6 @@ slug: /guides/providers/llama-cpp
## Overview
[Nitro](https://github.com/janhq/nitro) is an inference server on top of [llama.cpp](https://github.com/ggerganov/llama.cpp). OpenAI-compatible API, queue, & scaling.
[Nitro](https://github.com/janhq/nitro) is an inference server on top of [llama.cpp](https://github.com/ggerganov/llama.cpp). It provides an OpenAI-compatible API, queue, & scaling.
Nitro is the default AI engine downloaded with Jan. There is no additional setup needed.