jan/jan-inference/llm/README.md

9 lines
164 B
Markdown

# Inference - LLM
```bash
docker network create traefik_public
cp .env.example .env
# -> Update MODEL_URL in `.env` file
docker compose up -d --scale llm=2
``````