docs: remove unecessary code/content
This commit is contained in:
parent
3d24af5504
commit
0e52499fbd
@ -61,28 +61,6 @@ This guide will show you how to integrate Azure OpenAI Service with Jan. The [Az
|
|||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
#### Regarding `model.json`
|
|
||||||
|
|
||||||
- In `settings`, two crucial values are:
|
|
||||||
- `ctx_len`: Defined based on the model's context size.
|
|
||||||
- `prompt_template`: Defined based on the model's trained template (e.g., ChatML, Alpaca).
|
|
||||||
- To set up the `prompt_template`:
|
|
||||||
1. Visit Hugging Face.
|
|
||||||
2. Locate the model (e.g., [Gemma 7b it](https://huggingface.co/google/gemma-7b-it)).
|
|
||||||
3. Review the text and identify the template.
|
|
||||||
- In `parameters`, consider the following options. The fields in `parameters` are typically general and can be the same across models. An example is provided below:
|
|
||||||
|
|
||||||
```json
|
|
||||||
"parameters":{
|
|
||||||
"temperature": 0.7,
|
|
||||||
"top_p": 0.95,
|
|
||||||
"stream": true,
|
|
||||||
"max_tokens": 4096,
|
|
||||||
"frequency_penalty": 0,
|
|
||||||
"presence_penalty": 0
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
### Step 3: Start the Model
|
### Step 3: Start the Model
|
||||||
|
|
||||||
Restart Jan and go to the Hub. Find your model and click on the Use button.
|
Restart Jan and go to the Hub. Find your model and click on the Use button.
|
||||||
Loading…
x
Reference in New Issue
Block a user