Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Added guide for cloud model installation

Browse Source
This commit is contained in:
Ashley 2025-02-09 15:53:57 +07:00
parent 8419973d5e
commit 5b76a69bab
4 changed files with 22 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

BIN
docs/src/pages/docs/_assets/model-management-06.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 150 KiB

After

Width:  |  Height:  |  Size: 163 KiB

BIN
docs/src/pages/docs/_assets/model-management-08.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 81 KiB

BIN
docs/src/pages/docs/_assets/model-management-09.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 166 KiB

26
docs/src/pages/docs/models/manage-models.mdx
View File

@ -18,7 +18,7 @@ keywords:
] ]
--- ---
import { Callout, Steps } from 'nextra/components' import { Callout, Steps } from 'nextra/components'
import { Settings, EllipsisVertical, Plus, FolderOpen, Pencil } from 'lucide-react' import { Settings, Trash2, EllipsisVertical, Plus, FolderOpen, Pencil } from 'lucide-react'
# Model Management # Model Management
@ -201,12 +201,12 @@ Modify model parameters under the settings array. Key fields to configure:
## Cloud model ## Cloud model
<Callout type="info"> <Callout type="info">
When using cloud models, be aware of any associated costs and rate limits from the providers. When using cloud models, be aware of any associated costs and rate limits from the providers. See detailed guide for each cloud model provider [here](/docs/remote-models/anthropic).
</Callout> </Callout>
Jan supports connecting to various AI cloud providers that are OpenAI API-compatible, including: OpenAI (GPT-4, o1,...), Anthropic (Claude), Groq, Mistral, and more. Jan supports connecting to various AI cloud providers that are OpenAI API-compatible, including: OpenAI (GPT-4, o1,...), Anthropic (Claude), Groq, Mistral, and more.
1. Navigate to **Settings** (<Settings width={16} height={16} style={{display:"inline"}}/>) 1. Navigate to **Settings** (<Settings width={16} height={16} style={{display:"inline"}}/>)
2. Under **Remote Engines** section in the left sidebar, choose your preferred engines (OpenAI, Anthropic, etc.) 2. Under **Remote Engine** section in the left sidebar, choose your preferred engines (OpenAI, Anthropic, etc.)
3. Enter your API key 3. Enter your API key
4. The activated cloud models will be available in your model selector in **Threads** 4. The activated cloud models will be available in your model selector in **Threads**
@ -214,7 +214,25 @@ Jan supports connecting to various AI cloud providers that are OpenAI API-compat
![Download Model](../_assets/model-management-06.png) ![Download Model](../_assets/model-management-06.png)
<br/> <br/>
Cloud models cannot be deleted, but you can hide them by disabling their respective provider engines in **Settings** > **Engines**. You can manage & hide respective provider engines in **Settings** > **Engines**:
<br/> <br/>
![Download Model](../_assets/model-management-07.png) ![Download Model](../_assets/model-management-07.png)
<br/>
### Add Models
1. In your respective provider's settings page, click **Add Model**
2. Enter the **model ID**
3. A success message will appear when the model is added
<br/>
![Add Model](../_assets/model-management-08.png)
<br/>
### Delete Models
1. In your respective provider's settings page, choose the model you want to delete
2. Click **Trash Bin** (<Trash2 width={16} height={16} style={{display:"inline"}}/>) icon
3. The model will be removed from your available models list
<br/>
![Delete Model](../_assets/model-management-09.png)
<br/> <br/>