docs: remove unecessary code/content
This commit is contained in:
parent
3d24af5504
commit
0e52499fbd
@ -61,28 +61,6 @@ This guide will show you how to integrate Azure OpenAI Service with Jan. The [Az
|
||||
}
|
||||
```
|
||||
|
||||
#### Regarding `model.json`
|
||||
|
||||
- In `settings`, two crucial values are:
|
||||
- `ctx_len`: Defined based on the model's context size.
|
||||
- `prompt_template`: Defined based on the model's trained template (e.g., ChatML, Alpaca).
|
||||
- To set up the `prompt_template`:
|
||||
1. Visit Hugging Face.
|
||||
2. Locate the model (e.g., [Gemma 7b it](https://huggingface.co/google/gemma-7b-it)).
|
||||
3. Review the text and identify the template.
|
||||
- In `parameters`, consider the following options. The fields in `parameters` are typically general and can be the same across models. An example is provided below:
|
||||
|
||||
```json
|
||||
"parameters":{
|
||||
"temperature": 0.7,
|
||||
"top_p": 0.95,
|
||||
"stream": true,
|
||||
"max_tokens": 4096,
|
||||
"frequency_penalty": 0,
|
||||
"presence_penalty": 0
|
||||
}
|
||||
```
|
||||
|
||||
### Step 3: Start the Model
|
||||
|
||||
Restart Jan and go to the Hub. Find your model and click on the Use button.
|
||||
Loading…
x
Reference in New Issue
Block a user