jan/docs/docs/guides/providers/llama-cpp.md

title	slug
llama.cpp	/guides/providers/llama-cpp

Overview

Nitro is an inference server on top of llama.cpp. OpenAI-compatible API, queue, & scaling.

Nitro is the default AI engine downloaded with Jan. There is no additional setup needed.