docs: update Faq and guides integration content

This commit is contained in:
Arista Indrajaya 2024-03-08 14:13:07 +07:00
parent 17181927a4
commit 74a72a1d6f
2 changed files with 12 additions and 9 deletions

View File

@ -75,14 +75,11 @@ keywords:
## Development and Features ## Development and Features
- **Can I use local files from my computer with Jan?**
- The feature to use local files is currently in development. For more information, please our offical [Discord](https://discord.com/invite/FTk2MvZwJH) for the latest update.
- **Does Jan support Safetensors?** - **Does Jan support Safetensors?**
- At the moment, Jan only supports GGUF. However, there are plans to support `.safetensor` files in the future. - At the moment, Jan only supports GGUF. However, there are plans to support `.safetensor` files in the future.
- **I hope to customize the installation path of each model. Is that possible?** - **I hope to customize the installation path of each model. Is that possible?**
- Yes you can customize the installation path. Please see [here](https://github.com/janhq/jan/issues/1010) for more information. - Yes you can customize the installation path. Please see [here](https://jan.ai/guides/advanced-settings/#access-the-jan-data-folder) for more information.
## Troubleshooting ## Troubleshooting
@ -94,3 +91,9 @@ keywords:
- **What should I do if "Failed to fetch" occurs using MacBook Pro with Intel HD Graphics 4000 1536 MB?** - **What should I do if "Failed to fetch" occurs using MacBook Pro with Intel HD Graphics 4000 1536 MB?**
- Ensure that the model size is less than 90% of your available VRAM and that the VRAM is accessible to the app. Managing the resources effectively can help mitigate this issue. - Ensure that the model size is less than 90% of your available VRAM and that the VRAM is accessible to the app. Managing the resources effectively can help mitigate this issue.
:::info[Assistance and Support]
If you have questions, please join our [Discord community](https://discord.gg/Dt7MxDyNNZ) for support, updates, and discussions.
:::

View File

@ -22,7 +22,7 @@ keywords:
This guide provides step-by-step instructions on integrating the Groq API with Jan, enabling users to leverage Groq's capabilities within Jan's conversational interface. This guide provides step-by-step instructions on integrating the Groq API with Jan, enabling users to leverage Groq's capabilities within Jan's conversational interface.
Before proceeding, ensure you have the following: Before proceeding, ensure you have the following:
- Access to the Jan platform - Access to the Jan Application
- Groq API credentials - Groq API credentials
## Integration Steps ## Integration Steps
@ -38,7 +38,7 @@ Obtain Groq API keys from your [Groq Console](https://console.groq.com/keys).
```json title="~/jan/engines/openai.json" ```json title="~/jan/engines/openai.json"
{ {
"full_url": "https://api.groq.com/openai/v1", "full_url": "https://api.groq.com/openai/v1/chat/completions",
"api_key": "<your-groq-api-key>" "api_key": "<your-groq-api-key>"
} }
``` ```
@ -52,7 +52,7 @@ To set up the configuration for Groq in Jan, follow these steps:
3. Inside the groq folder, create a model.json file with the specified settings: 3. Inside the groq folder, create a model.json file with the specified settings:
```json title="~/jan/models/groq/model.json ```json title="~/jan/models/groq/model.json
{ {
"id": "groq", "id": "mixtral-8x7b-32768",
"object": "model", "object": "model",
"name": "Groq Integration", "name": "Groq Integration",
"version": "1.0", "version": "1.0",
@ -62,10 +62,10 @@ To set up the configuration for Groq in Jan, follow these steps:
"settings": {}, "settings": {},
"parameters": {}, "parameters": {},
"metadata": { "metadata": {
"author": "Your Name", "author": "Mistral ",
"tags": ["Groq Integration"] "tags": ["Groq Integration"]
}, },
"engine": "groq" "engine": "openai"
} }
``` ```