docs: remove unecessary code/content

This commit is contained in:
Arista Indrajaya 2024-02-28 08:55:43 +07:00
parent 3d24af5504
commit 0e52499fbd

View File

@ -61,28 +61,6 @@ This guide will show you how to integrate Azure OpenAI Service with Jan. The [Az
}
```
#### Regarding `model.json`
- In `settings`, two crucial values are:
- `ctx_len`: Defined based on the model's context size.
- `prompt_template`: Defined based on the model's trained template (e.g., ChatML, Alpaca).
- To set up the `prompt_template`:
1. Visit Hugging Face.
2. Locate the model (e.g., [Gemma 7b it](https://huggingface.co/google/gemma-7b-it)).
3. Review the text and identify the template.
- In `parameters`, consider the following options. The fields in `parameters` are typically general and can be the same across models. An example is provided below:
```json
"parameters":{
"temperature": 0.7,
"top_p": 0.95,
"stream": true,
"max_tokens": 4096,
"frequency_penalty": 0,
"presence_penalty": 0
}
```
### Step 3: Start the Model
Restart Jan and go to the Hub. Find your model and click on the Use button.