Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: Update sample env file for gguf model

Browse Source
This commit is contained in:
vuonghoainam 2023-09-12 17:12:42 +07:00
parent d75116abf0
commit ead0dbd33f
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
sample.env
View File

@ -4,5 +4,5 @@ KEYCLOAK_ADMIN_PASSWORD=admin
# Inference # Inference
## LLM ## LLM
LLM_MODEL_URL=https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q4_1.bin LLM_MODEL_URL=https://huggingface.co/TheBloke/CodeLlama-13B-GGUF/resolve/main/codellama-13b.Q3_K_L.gguf
LLM_MODEL_FILE=llama-2-7b-chat.ggmlv3.q4_1.bin LLM_MODEL_FILE=llama-2-7b-chat.ggmlv3.q4_1.bin