jan/jan-inference/llm/README.md
2023-08-25 01:31:11 +07:00

9 lines
164 B
Markdown

# Inference - LLM
```bash
docker network create traefik_public
cp .env.example .env
# -> Update MODEL_URL in `.env` file
docker compose up -d --scale llm=2
``````