diff --git a/docs/docs/guides/04-using-models/02-import-manually.mdx b/docs/docs/guides/04-using-models/02-import-manually.mdx index 4ea24e387..f5ecb5259 100644 --- a/docs/docs/guides/04-using-models/02-import-manually.mdx +++ b/docs/docs/guides/04-using-models/02-import-manually.mdx @@ -25,12 +25,79 @@ This is currently under development. import Tabs from "@theme/Tabs"; import TabItem from "@theme/TabItem"; -## Steps to Manually Import a Local Model - In this section, we will show you how to import a GGUF model from [HuggingFace](https://huggingface.co/), using our latest model, [Trinity](https://huggingface.co/janhq/trinity-v1-GGUF), as an example. > We are fast shipping a UI to make this easier, but it's a bit manual for now. Apologies. +## Manually Importing a Downloaded Model (nightly versions and v0.4.4+) + + +### 1. Create a Model Folder + +Navigate to the `~/jan/models` folder. You can find this folder by going to `App Settings` > `Advanced` > `Open App Directory`. + + + + + ```sh + cd ~/jan/models + ``` + + + + + ```sh + C:/Users//jan/models + ``` + + + + + ```sh + cd ~/jan/models + ``` + + + + +In the `models` folder, create a folder with the name of the model. + + + + + ```sh + mkdir trinity-v1-7b + ``` + + + + + ```sh + mkdir trinity-v1-7b + ``` + + + + + ```sh + mkdir trinity-v1-7b + ``` + + + + +#### 2. Drag & Drop the Model + +Drag and drop your model binary into this folder, ensuring the `modelname.gguf` is the same name as the folder name, e.g. `models/modelname` + +#### 3. Voila + +If your model doesn't show up in the Model Selector in conversations, please restart the app. + +If that doesn't work, please feel free to join our [Discord community](https://discord.gg/Dt7MxDyNNZ) for support, updates, and discussions. + +## Manually Importing a Downloaded Model (older versions) + ### 1. Create a Model Folder Navigate to the `~/jan/models` folder. You can find this folder by going to `App Settings` > `Advanced` > `Open App Directory`.