Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: Fix README with minor bug in step to download model

Browse Source
This commit is contained in:
vuonghoainam 2023-09-12 18:09:24 +07:00
parent 448c5eb135
commit f6d8929e9b
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@ -136,14 +136,13 @@ pip install 'llama-cpp-python[server]'
We recommend that Llama2-7B (4-bit quantized) as a basic model to get started. We recommend that Llama2-7B (4-bit quantized) as a basic model to get started.
You will need to download the models to the `models` folder. You will need to download the models to the `models` folder at root level.
```shell ```shell
mkdir -p models
# Downloads model (~4gb) # Downloads model (~4gb)
# Download time depends on your internet connection and HuggingFace's bandwidth # Download time depends on your internet connection and HuggingFace's bandwidth
# In this part, please head over to any source contains `.gguf` format model - https://huggingface.co/models?search=gguf # In this part, please head over to any source contains `.gguf` format model - https://huggingface.co/models?search=gguf
wget LLM_MODEL_URL=https://huggingface.co/TheBloke/CodeLlama-13B-GGUF/resolve/main/codellama-13b.Q3_K_L.gguf -P models wget https://huggingface.co/TheBloke/CodeLlama-13B-GGUF/resolve/main/codellama-13b.Q3_K_L.gguf -P models
``` ```
- Run the model in host machine - Run the model in host machine