docs: add integrations
This commit is contained in:
parent
0ffcd66513
commit
9b41bd0a2c
@ -1,18 +1,38 @@
|
|||||||
---
|
---
|
||||||
title: About Jan
|
title: About Jan
|
||||||
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.
|
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.
|
||||||
keywords: [Jan AI, Jan, ChatGPT alternative, local AI, private AI, conversational AI, no-subscription fee, large language model ]
|
keywords:
|
||||||
|
[
|
||||||
|
Jan AI,
|
||||||
|
Jan,
|
||||||
|
ChatGPT alternative,
|
||||||
|
local AI,
|
||||||
|
private AI,
|
||||||
|
conversational AI,
|
||||||
|
no-subscription fee,
|
||||||
|
large language model,
|
||||||
|
]
|
||||||
---
|
---
|
||||||
|
|
||||||
Jan believes in the need for an open source AI ecosystem, and are building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones.
|
Jan believes in the need for an **open source AI ecosystem**. We are focused on building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones.
|
||||||
|
|
||||||
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
Jan's long-term technical endeavor is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
||||||
|
|
||||||
|
## Quicklinks
|
||||||
|
|
||||||
|
- Core product vision for [Jan Framework](http://localhost:3001/docs/)
|
||||||
|
- R&D and model training efforts [Discord](https://discord.gg/9NfUSyzp3y) (via our small data-center which is `free & open to all researchers who lack GPUs`!)
|
||||||
|
- Current implementations of Jan Framework: [Jan Desktop](https://jan.ai/), [Nitro](https://nitro.jan.ai/)
|
||||||
|
|
||||||
## Why does Jan Exist?
|
## Why does Jan Exist?
|
||||||
|
|
||||||
### Mission
|
### Mission
|
||||||
|
|
||||||
Our mission is to allow humans and businesses to own their AI, with the right to tinker, repair and innovate.
|
Our current mission is to allow humans and businesses to **own their AI, with the right to tinker, repair and innovate**.
|
||||||
|
|
||||||
|
:::tip
|
||||||
|
Our life-long mission is to **eliminate work - so human can focus on creation, invention, and moral governance over robots**.
|
||||||
|
:::
|
||||||
|
|
||||||
### Ideal Customer
|
### Ideal Customer
|
||||||
|
|
||||||
@ -22,16 +42,19 @@ Our ideal customer is an AI enthusiast or business who has experienced some limi
|
|||||||
|
|
||||||
Our ideal customer would use Jan to solve one of these problems.
|
Our ideal customer would use Jan to solve one of these problems.
|
||||||
|
|
||||||
*Control*
|
_Control_
|
||||||
|
|
||||||
- Control (e.g. preventing vendor lock-in)
|
- Control (e.g. preventing vendor lock-in)
|
||||||
- Stability (e.g. runs predictably every time)
|
- Stability (e.g. runs predictably every time)
|
||||||
- Local-use (e.g. for speed, or for airgapped environments)
|
- Local-use (e.g. for speed, or for airgapped environments)
|
||||||
|
|
||||||
*Privacy*
|
_Privacy_
|
||||||
|
|
||||||
- Data protection (e.g. personal data or company data)
|
- Data protection (e.g. personal data or company data)
|
||||||
- Privacy (e.g. nsfw)
|
- Privacy (e.g. nsfw)
|
||||||
|
|
||||||
*Customizability*
|
_Customizability_
|
||||||
|
|
||||||
- Tinkerability (e.g. ability to change model, experiment)
|
- Tinkerability (e.g. ability to change model, experiment)
|
||||||
- Niche Models (e.g. fine-tuned, domain-specific models that outperform OpenAI)
|
- Niche Models (e.g. fine-tuned, domain-specific models that outperform OpenAI)
|
||||||
|
|
||||||
@ -56,7 +79,8 @@ Jan is a seamless user experience that runs on your personal computer, that glue
|
|||||||
|
|
||||||
Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it.
|
Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it.
|
||||||
|
|
||||||
- [Jan: a Personal AI](https://github.com/janhq/jan) (AGPLv3)
|
- [Jan Framework](https://github.com/janhq/jan) (AGPLv3)
|
||||||
|
- [Jan Desktop Client & Local server](https://jan.ai) (AGPLv3, built on Jan Framework)
|
||||||
- [Nitro: run Local AI](https://github.com/janhq/nitro) (AGPLv3)
|
- [Nitro: run Local AI](https://github.com/janhq/nitro) (AGPLv3)
|
||||||
|
|
||||||
### Build in Public
|
### Build in Public
|
||||||
|
|||||||
@ -79,7 +79,7 @@ We believe all software applications can be natively supercharged with AI primit
|
|||||||
Including:
|
Including:
|
||||||
|
|
||||||
- OpenAI Compatible AI [types](https://github.com/janhq/jan/tree/main/core/src/types) and [core extensions](https://github.com/janhq/jan/tree/main/core/src/extensions) to support common functionality like making an inference call.
|
- OpenAI Compatible AI [types](https://github.com/janhq/jan/tree/main/core/src/types) and [core extensions](https://github.com/janhq/jan/tree/main/core/src/extensions) to support common functionality like making an inference call.
|
||||||
- A lightweight, embedded C++ [inference engine/wrapper](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) that's immediately callable from code. _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._
|
- Multiple inference engines through [extensions, integrations & wrappers](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._
|
||||||
|
|
||||||
- [Code Entrypoint](https://github.com/janhq/jan/tree/main/core/src/api)
|
- [Code Entrypoint](https://github.com/janhq/jan/tree/main/core/src/api)
|
||||||
|
|
||||||
9
docs/docs/docs/02-integrations/README.md
Normal file
9
docs/docs/docs/02-integrations/README.md
Normal file
@ -0,0 +1,9 @@
|
|||||||
|
---
|
||||||
|
title: Integrations
|
||||||
|
---
|
||||||
|
|
||||||
|
Existing and upcoming 3rd party integrations on top of Jan Framework.
|
||||||
|
|
||||||
|
From both the core development team, and core contributors.
|
||||||
|
|
||||||
|
Suggestions? File an [issue here](https://github.com/janhq/jan/issues)
|
||||||
7
docs/docs/docs/02-integrations/langchain.md
Normal file
7
docs/docs/docs/02-integrations/langchain.md
Normal file
@ -0,0 +1,7 @@
|
|||||||
|
---
|
||||||
|
title: Langchain
|
||||||
|
---
|
||||||
|
|
||||||
|
:::caution
|
||||||
|
WIP
|
||||||
|
:::
|
||||||
9
docs/docs/docs/02-integrations/llamacpp.md
Normal file
9
docs/docs/docs/02-integrations/llamacpp.md
Normal file
@ -0,0 +1,9 @@
|
|||||||
|
---
|
||||||
|
title: LlamaCPP
|
||||||
|
---
|
||||||
|
|
||||||
|
## Quicklinks
|
||||||
|
|
||||||
|
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension)
|
||||||
|
- ggerganov/llama.pp [Source URL](https://github.com/ggerganov/llama.cpp)
|
||||||
|
- [Productized Wrapper](https://nitro.jan.ai/): a bit lower effort to use out of the box
|
||||||
7
docs/docs/docs/02-integrations/ollama.md
Normal file
7
docs/docs/docs/02-integrations/ollama.md
Normal file
@ -0,0 +1,7 @@
|
|||||||
|
---
|
||||||
|
title: Ollama
|
||||||
|
---
|
||||||
|
|
||||||
|
:::caution
|
||||||
|
Requested, committed, but not started
|
||||||
|
:::
|
||||||
8
docs/docs/docs/02-integrations/openai.md
Normal file
8
docs/docs/docs/02-integrations/openai.md
Normal file
@ -0,0 +1,8 @@
|
|||||||
|
---
|
||||||
|
title: OpenAI
|
||||||
|
---
|
||||||
|
|
||||||
|
## Quicklinks
|
||||||
|
|
||||||
|
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-openai-extension)
|
||||||
|
- OpenAI API [Reference Docs](https://platform.openai.com/docs/api-reference)
|
||||||
7
docs/docs/docs/02-integrations/openrouter.md
Normal file
7
docs/docs/docs/02-integrations/openrouter.md
Normal file
@ -0,0 +1,7 @@
|
|||||||
|
---
|
||||||
|
title: OpenRouter
|
||||||
|
---
|
||||||
|
|
||||||
|
:::caution
|
||||||
|
Requested, committed, but not started
|
||||||
|
:::
|
||||||
8
docs/docs/docs/02-integrations/tensorrt.md
Normal file
8
docs/docs/docs/02-integrations/tensorrt.md
Normal file
@ -0,0 +1,8 @@
|
|||||||
|
---
|
||||||
|
title: TensorRT-LLM
|
||||||
|
---
|
||||||
|
|
||||||
|
## Quicklinks
|
||||||
|
|
||||||
|
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-triton-trtllm-extension)
|
||||||
|
- TensorRT [Source URL](https://github.com/NVIDIA/TensorRT-LLM)
|
||||||
@ -1,3 +0,0 @@
|
|||||||
---
|
|
||||||
title: Integrations
|
|
||||||
---
|
|
||||||
Loading…
x
Reference in New Issue
Block a user