Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(json): change from pandora to trinity for hardware friendly

Browse Source
This commit is contained in:
Hoang Ha 2023-12-15 11:38:31 +07:00 committed by GitHub
parent b759a8c101
commit ae82c65367
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 8 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
docs/docs/guides/quickstart.md
View File

@ -16,7 +16,7 @@ keywords:
Jan is compatible with all GGUF models. Jan is compatible with all GGUF models.
In this guide we will use our latest model, [Pandora](https://huggingface.co/janhq/pandora-v1-10.7b-GGUF), as an example. In this guide we will use our latest model, [Trinity](https://huggingface.co/janhq/trinity-v1-GGUF), as an example.
## 1. Create a model folder ## 1. Create a model folder
@ -51,12 +51,12 @@ The following is an example template for `model.json`
``` ```
{ {
"source_url": "https://huggingface.co/janhq/pandora-v1-10.7b-GGUF/blob/main/pandora-v1-10.7b.Q4_K_M.gguf", "source_url": "https://huggingface.co/janhq/trinity-v1-GGUF/resolve/main/trinity-v1.Q4_K_M.gguf",
"id": "pandora-v1-10-7b-gguf", "id": "trinity-v1-7b",
"object": "model", "object": "model",
"name": "PandoraQ4", "name": "Trinity 7B Q4",
"version": "1.0", "version": "1.0",
"description": "A helpful assistant", "description": "Trinity is an experimental model merge of GreenNodeLM & LeoScorpius using the Slerp method. Recommended for daily assistance purposes.",
"format": "gguf", "format": "gguf",
"settings": { "settings": {
"ctx_len": 2048, "ctx_len": 2048,
@ -67,10 +67,11 @@ The following is an example template for `model.json`
}, },
"metadata": { "metadata": {
"author": "Jan", "author": "Jan",
"tags": ["7B", "Finetuned"] "tags": ["7B", "Merged", "Featured"],
"size": 4370000000
}, },
"engine": "nitro" "engine": "nitro"
} }
``` ```
:::caution :::caution