Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: Update 02-import-manually.mdx (#1197)

Browse Source 
docs: Update 02-import-manually.mdx
This commit is contained in:
Hieu 2023-12-26 22:25:31 +09:00 committed by GitHub
commit acbd35666c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
docs/docs/guides/04-using-models/02-import-manually.mdx
View File

@ -109,6 +109,8 @@ Copy the following configurations into the `model.json`.
2. Make sure the `source_url` property is the direct binary download link ending in `.gguf`. In HuggingFace, you can find the directl links in `Files and versions` tab. 2. Make sure the `source_url` property is the direct binary download link ending in `.gguf`. In HuggingFace, you can find the directl links in `Files and versions` tab.
3. Ensure you are using the correct `prompt_template`. This is usually provided in the HuggingFace model's description page. 3. Ensure you are using the correct `prompt_template`. This is usually provided in the HuggingFace model's description page.
> Note: Currently, the filename must be `model.json` and the ID has to be equal to the foldername. In the `model.json`, you have to include the `state` property and set it to `ready` for Jan to recognize the model.
```js ```js
{ {
"source_url": "https://huggingface.co/janhq/trinity-v1-GGUF/resolve/main/trinity-v1.Q4_K_M.gguf", "source_url": "https://huggingface.co/janhq/trinity-v1-GGUF/resolve/main/trinity-v1.Q4_K_M.gguf",
@ -130,6 +132,7 @@ Copy the following configurations into the `model.json`.
"tags": ["7B", "Merged", "Featured"], "tags": ["7B", "Merged", "Featured"],
"size": 4370000000 "size": 4370000000
}, },
"state": "ready",
"engine": "nitro" "engine": "nitro"
} }
``` ```