diff --git a/docs/docs/quickstart/integration/azure.mdx b/docs/docs/quickstart/integration/azure.mdx index 670e84cc8..c5c0e570a 100644 --- a/docs/docs/quickstart/integration/azure.mdx +++ b/docs/docs/quickstart/integration/azure.mdx @@ -61,28 +61,6 @@ This guide will show you how to integrate Azure OpenAI Service with Jan. The [Az } ``` -#### Regarding `model.json` - -- In `settings`, two crucial values are: - - `ctx_len`: Defined based on the model's context size. - - `prompt_template`: Defined based on the model's trained template (e.g., ChatML, Alpaca). - - To set up the `prompt_template`: - 1. Visit Hugging Face. - 2. Locate the model (e.g., [Gemma 7b it](https://huggingface.co/google/gemma-7b-it)). - 3. Review the text and identify the template. -- In `parameters`, consider the following options. The fields in `parameters` are typically general and can be the same across models. An example is provided below: - -```json -"parameters":{ - "temperature": 0.7, - "top_p": 0.95, - "stream": true, - "max_tokens": 4096, - "frequency_penalty": 0, - "presence_penalty": 0 -} -``` - ### Step 3: Start the Model Restart Jan and go to the Hub. Find your model and click on the Use button. \ No newline at end of file