From 91ebb6e31a29a4b0ad85147202258738baec9b8b Mon Sep 17 00:00:00 2001 From: 0xSage Date: Sat, 6 Jan 2024 11:20:22 +0800 Subject: [PATCH 1/2] docs: gpu not detected --- .../07-troubleshooting/02-failed-to-fetch.mdx | 22 +++++++------ .../07-troubleshooting/03-gpu-not-used.mdx | 33 +++++++++++++++++++ 2 files changed, 45 insertions(+), 10 deletions(-) create mode 100644 docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx diff --git a/docs/docs/guides/07-troubleshooting/02-failed-to-fetch.mdx b/docs/docs/guides/07-troubleshooting/02-failed-to-fetch.mdx index 7b9cb9e36..37146209d 100644 --- a/docs/docs/guides/07-troubleshooting/02-failed-to-fetch.mdx +++ b/docs/docs/guides/07-troubleshooting/02-failed-to-fetch.mdx @@ -1,9 +1,8 @@ --- -title: Failed To Fetch +title: Failed to Fetch slug: /troubleshooting/failed-to-fetch description: Troubleshooting "Failed to Fetch" -keywords: - [ +keywords: [ Jan AI, Jan, ChatGPT alternative, @@ -17,19 +16,22 @@ keywords: ] --- -You may receive a "Error Occured: Failed to Fetch" response when you first start chatting with a selected model. +You may receive a "Error Occured: Failed to Fetch" response when you first start chatting with a selected model. This may occur due to several reasons. Please follow these steps to resolve it: 1. Ensure you are on the latest version of Mac, Windows or Ubuntu OS version - - Upgrading to the latest version has resolved this issue for most people -2. Select a model that is smaller than 80% of your hardware V/RAM. - - For example, if you have a 8GB machine, you should select models smaller than 6GB. + - Upgrading to the latest version has resolved this issue for most people + +2. Select a model that is smaller than 80% of your hardware V/RAM. + + - For example, if you have a 8GB machine, you should select models smaller than 6GB. 3. Install the latest [Nightly release](https://jan.ai/install/nightly/) - - If you are re-installing Jan, it can help to [clear the application cache](https://jan.ai/troubleshooting/stuck-on-broken-build/) -4. Ensure your V/RAM is accessible by the application (some people have virtual RAM) + - If you are re-installing Jan, it can help to [clear the application cache](https://jan.ai/troubleshooting/stuck-on-broken-build/) -5. If you are on Nvidia GPUs, please download [Cuda](https://developer.nvidia.com/cuda-downloads) +4. Ensure your V/RAM is accessible by the application (some people have virtual RAM) + +5. If you are on Nvidia GPUs, please download [Cuda](https://developer.nvidia.com/cuda-downloads) diff --git a/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx b/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx new file mode 100644 index 000000000..3f7fa8427 --- /dev/null +++ b/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx @@ -0,0 +1,33 @@ +--- +title: Jan is Not Using GPU +keywords: [ + Jan AI, + Jan, + ChatGPT alternative, + local AI, + private AI, + convZ + ersational AI, + no-subscription fee, + large language model, + troubleshooting, + ] +--- + +By default, Jan uses GPU acceleration. + +If you are experiencing this issue, you may need to download the latest Nvidia CUDA toolkit. + +> We weren't propagating CUDA issues in the old build. + +Steps: + +1. Download Cuda toolkit (versions 11.4+) from [Nvidia](https://developer.nvidia.com/cuda-downloads?target_os=Windows) + +1. Go to Settings > Advanced > Turn on GPU acceleration + +1. You may need to restart Jan + +1. Check in `System Monitor` that there is more (V)RAM now + +1. If the issue is not fixed, please install the [Nightly version](/install/nightly) instead. From bf7b61c81934ac0c2d372fc2147f7f5c4556c3b5 Mon Sep 17 00:00:00 2001 From: 0xSage Date: Sat, 6 Jan 2024 11:23:01 +0800 Subject: [PATCH 2/2] docs: addn tips --- docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx b/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx index 3f7fa8427..2fd4829e3 100644 --- a/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx +++ b/docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx @@ -30,4 +30,8 @@ Steps: 1. Check in `System Monitor` that there is more (V)RAM now -1. If the issue is not fixed, please install the [Nightly version](/install/nightly) instead. +1. If the issue persists, please install the [Nightly version](/install/nightly) instead. + +1. If the issue persists, ensure your (V)RAM is accessible by the application. Some folks have virtual RAM and needs additional configuration. + +1. Get help in [Jan Discord](https://discord.gg/mY69SZaMaC).