docs: remove unecessary code/content

This commit is contained in:
Arista Indrajaya 2024-02-28 08:55:43 +07:00
parent 3d24af5504
commit 0e52499fbd

View File

@ -61,28 +61,6 @@ This guide will show you how to integrate Azure OpenAI Service with Jan. The [Az
} }
``` ```
#### Regarding `model.json`
- In `settings`, two crucial values are:
- `ctx_len`: Defined based on the model's context size.
- `prompt_template`: Defined based on the model's trained template (e.g., ChatML, Alpaca).
- To set up the `prompt_template`:
1. Visit Hugging Face.
2. Locate the model (e.g., [Gemma 7b it](https://huggingface.co/google/gemma-7b-it)).
3. Review the text and identify the template.
- In `parameters`, consider the following options. The fields in `parameters` are typically general and can be the same across models. An example is provided below:
```json
"parameters":{
"temperature": 0.7,
"top_p": 0.95,
"stream": true,
"max_tokens": 4096,
"frequency_penalty": 0,
"presence_penalty": 0
}
```
### Step 3: Start the Model ### Step 3: Start the Model
Restart Jan and go to the Hub. Find your model and click on the Use button. Restart Jan and go to the Hub. Find your model and click on the Use button.