removed files that were not needed anymore
This commit is contained in:
parent
d95f104e03
commit
f58e425b35
@ -1,142 +0,0 @@
|
||||
---
|
||||
title: Start Chatting
|
||||
description: Download models and manage your conversations with AI models locally.
|
||||
keywords:
|
||||
[
|
||||
Jan,
|
||||
local AI,
|
||||
LLM,
|
||||
chat,
|
||||
threads,
|
||||
models,
|
||||
download,
|
||||
installation,
|
||||
conversations,
|
||||
]
|
||||
---
|
||||
|
||||
import { Aside } from '@astrojs/starlight/components';
|
||||
|
||||
<ol>
|
||||
|
||||
### Step 1: Install Jan
|
||||
|
||||
1. [Download Jan](/download)
|
||||
2. Install the app ([Mac](/docs/desktop/mac), [Windows](/docs/desktop/windows), [Linux](/docs/desktop/linux))
|
||||
3. Launch Jan
|
||||
|
||||
### Step 2: Download a Model
|
||||
|
||||
Jan requires a model to chat. Download one from the Hub:
|
||||
|
||||
1. Go to the **Hub Tab**
|
||||
2. Browse available models (must be GGUF format)
|
||||
3. Select one matching your hardware specs
|
||||
4. Click **Download**
|
||||
|
||||

|
||||
|
||||
<Aside type="caution">
|
||||
Models consume memory and processing power. Choose based on your hardware specs.
|
||||
</Aside>
|
||||
|
||||
**HuggingFace models:** Some require an access token. Add yours in **Settings > Model Providers > Llama.cpp > Hugging Face Access Token**.
|
||||
|
||||

|
||||
|
||||
### Step 3: Enable GPU Acceleration (Optional)
|
||||
|
||||
For Windows/Linux with compatible graphics cards:
|
||||
|
||||
1. Go to **Settings** > **Hardware**
|
||||
2. Toggle **GPUs** to ON
|
||||
|
||||

|
||||
|
||||
<Aside type="note">
|
||||
Install required drivers before enabling GPU acceleration. See setup guides for [Windows](/docs/desktop/windows#gpu-acceleration) & [Linux](/docs/desktop/linux#gpu-acceleration).
|
||||
</Aside>
|
||||
|
||||
### Step 4: Start Chatting
|
||||
|
||||
1. Click the **New Chat** icon
|
||||
2. Select your model in the input field dropdown
|
||||
3. Type your message and start chatting
|
||||
|
||||

|
||||
|
||||
</ol>
|
||||
|
||||
## Managing Conversations
|
||||
|
||||
Jan organizes conversations into threads for easy tracking and revisiting.
|
||||
|
||||
### View Chat History
|
||||
|
||||
- **Left sidebar** shows all conversations
|
||||
- Click any chat to open the full conversation
|
||||
- **Favorites**: Pin important threads for quick access
|
||||
- **Recents**: Access recently used threads
|
||||
|
||||

|
||||
|
||||
### Edit Chat Titles
|
||||
|
||||
1. Hover over a conversation in the sidebar
|
||||
2. Click the **three dots** icon
|
||||
3. Click **Rename**
|
||||
4. Enter new title and save
|
||||
|
||||

|
||||
|
||||
### Delete Threads
|
||||
|
||||
<Aside type="caution">
|
||||
Thread deletion is permanent. No undo available.
|
||||
</Aside>
|
||||
|
||||
**Single thread:**
|
||||
1. Hover over thread in sidebar
|
||||
2. Click the **three dots** icon
|
||||
3. Click **Delete**
|
||||
|
||||
**All threads:**
|
||||
1. Hover over `Recents` category
|
||||
2. Click the **three dots** icon
|
||||
3. Select **Delete All**
|
||||
|
||||
## Advanced Features
|
||||
|
||||
### Custom Assistant Instructions
|
||||
|
||||
Customize how models respond:
|
||||
|
||||
1. Use the assistant dropdown in the input field
|
||||
2. Or go to the **Assistant tab** to create custom instructions
|
||||
3. Instructions work across all models
|
||||
|
||||

|
||||
|
||||

|
||||
|
||||
### Model Parameters
|
||||
|
||||
Fine-tune model behavior:
|
||||
- Click the **Gear icon** next to your model
|
||||
- Adjust parameters in **Assistant Settings**
|
||||
- Switch models via the **model selector**
|
||||
|
||||

|
||||
|
||||
### Connect Cloud Models (Optional)
|
||||
|
||||
Connect to OpenAI, Anthropic, Groq, Mistral, and others:
|
||||
|
||||
1. Open any thread
|
||||
2. Select a cloud model from the dropdown
|
||||
3. Click the **Gear icon** beside the provider
|
||||
4. Add your API key (ensure sufficient credits)
|
||||
|
||||

|
||||
|
||||
For detailed setup, see [Remote APIs](/docs/remote-models/openai).
|
||||
Loading…
x
Reference in New Issue
Block a user