Added image & updated some parts
This commit is contained in:
parent
b1a99c826d
commit
2b1a49db1a
BIN
docs/src/pages/docs/_assets/api-server.png
Normal file
BIN
docs/src/pages/docs/_assets/api-server.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 237 KiB |
@ -23,11 +23,16 @@ import { Settings, EllipsisVertical } from 'lucide-react'
|
|||||||
|
|
||||||
Jan includes a built-in API server that is compatible with OpenAI's API specification, allowing you to interact with AI models through a local HTTP interface. This means you can use Jan as a drop-in replacement for OpenAI's API, but running entirely on your computer.
|
Jan includes a built-in API server that is compatible with OpenAI's API specification, allowing you to interact with AI models through a local HTTP interface. This means you can use Jan as a drop-in replacement for OpenAI's API, but running entirely on your computer.
|
||||||
|
|
||||||
|
|
||||||
<Callout>
|
<Callout>
|
||||||
Full API documentation is available at [Cortex's API Reference](https://cortex.so/api-reference#tag/chat).
|
Full API documentation is available at [Cortex's API Reference](https://cortex.so/api-reference#tag/chat).
|
||||||
</Callout>
|
</Callout>
|
||||||
|
|
||||||
|
<br/>
|
||||||
|

|
||||||
|
<br/>
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
## Start Server
|
## Start Server
|
||||||
|
|
||||||
<Steps>
|
<Steps>
|
||||||
@ -90,22 +95,29 @@ Enable to show:
|
|||||||
|
|
||||||
## Troubleshooting Guide
|
## Troubleshooting Guide
|
||||||
|
|
||||||
1. Server Won't Start
|
<Callout>
|
||||||
- Check if the port is already in use
|
Enable **Verbose Server Logs** for detailed error messages.
|
||||||
- Verify you have admin/sudo rights if needed
|
</Callout>
|
||||||
- Look for error messages in the logs
|
|
||||||
|
|
||||||
2. Connection Refused
|
**1. Common Issues**
|
||||||
- Confirm the server is running
|
- Confirm the server is running
|
||||||
- Check if the host/port combination is correct
|
- Check if model is successfully loaded in Jan
|
||||||
- Verify firewall settings
|
|
||||||
|
|
||||||
3. CORS Errors
|
- Check if the port is already in use by another application
|
||||||
- Enable CORS if making browser requests
|
- Verify you have admin/sudo rights if needed
|
||||||
|
- Make sure your API endpoint matches your server settings. Example: Using `http://localhost:1337` when you set a different port.
|
||||||
|
- Make sure the model name in your API request matches exactly what's shown in Jan. Example: If you selected "Llama 3.2 1B Instruct Q8" in Jan, use `llama3.2-1b-instruct` in your API request.
|
||||||
|
- Verify your JSON request format is correct
|
||||||
|
- Verify firewall settings
|
||||||
|
- Look for detailed error messages in the logs
|
||||||
|
|
||||||
|
**2. CORS Errors in Web Apps**
|
||||||
|
- Enable CORS in server settings if using from a webpage
|
||||||
- Verify the origin of the request
|
- Verify the origin of the request
|
||||||
|
- Verify your web app's request URL matches the server address exactly
|
||||||
- Check browser console for specific error messages
|
- Check browser console for specific error messages
|
||||||
|
|
||||||
4. Performance Issues
|
**3. Performance Issues**
|
||||||
- Monitor system resources (CPU, RAM, and GPU usage)
|
- Monitor system resources (CPU, RAM, and GPU usage)
|
||||||
- Try to reduce the context length or `ngl` (number of GPU layers)
|
- Try to reduce the context length or `ngl` (number of GPU layers)
|
||||||
- Check for other resource-intensive applications
|
- Check for other resource-intensive applications
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user