jan/jan-inference/llm/README.md
2023-08-25 01:31:11 +07:00

164 B

Inference - LLM

docker network create traefik_public
cp .env.example .env
# -> Update MODEL_URL in `.env` file
docker compose up -d --scale llm=2