docs: add integrations
This commit is contained in:
parent
0ffcd66513
commit
9b41bd0a2c
@ -1,37 +1,60 @@
|
||||
---
|
||||
title: About Jan
|
||||
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.
|
||||
keywords: [Jan AI, Jan, ChatGPT alternative, local AI, private AI, conversational AI, no-subscription fee, large language model ]
|
||||
keywords:
|
||||
[
|
||||
Jan AI,
|
||||
Jan,
|
||||
ChatGPT alternative,
|
||||
local AI,
|
||||
private AI,
|
||||
conversational AI,
|
||||
no-subscription fee,
|
||||
large language model,
|
||||
]
|
||||
---
|
||||
|
||||
Jan believes in the need for an open source AI ecosystem, and are building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones.
|
||||
Jan believes in the need for an **open source AI ecosystem**. We are focused on building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones.
|
||||
|
||||
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
||||
Jan's long-term technical endeavor is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
||||
|
||||
## Quicklinks
|
||||
|
||||
- Core product vision for [Jan Framework](http://localhost:3001/docs/)
|
||||
- R&D and model training efforts [Discord](https://discord.gg/9NfUSyzp3y) (via our small data-center which is `free & open to all researchers who lack GPUs`!)
|
||||
- Current implementations of Jan Framework: [Jan Desktop](https://jan.ai/), [Nitro](https://nitro.jan.ai/)
|
||||
|
||||
## Why does Jan Exist?
|
||||
|
||||
### Mission
|
||||
|
||||
Our mission is to allow humans and businesses to own their AI, with the right to tinker, repair and innovate.
|
||||
Our current mission is to allow humans and businesses to **own their AI, with the right to tinker, repair and innovate**.
|
||||
|
||||
:::tip
|
||||
Our life-long mission is to **eliminate work - so human can focus on creation, invention, and moral governance over robots**.
|
||||
:::
|
||||
|
||||
### Ideal Customer
|
||||
|
||||
Our ideal customer is an AI enthusiast or business who has experienced some limitations with OpenAI, and is keen to find open source alternatives.
|
||||
Our ideal customer is an AI enthusiast or business who has experienced some limitations with OpenAI, and is keen to find open source alternatives.
|
||||
|
||||
### Problems
|
||||
|
||||
Our ideal customer would use Jan to solve one of these problems.
|
||||
Our ideal customer would use Jan to solve one of these problems.
|
||||
|
||||
_Control_
|
||||
|
||||
*Control*
|
||||
- Control (e.g. preventing vendor lock-in)
|
||||
- Stability (e.g. runs predictably every time)
|
||||
- Local-use (e.g. for speed, or for airgapped environments)
|
||||
|
||||
*Privacy*
|
||||
- Data protection (e.g. personal data or company data)
|
||||
- Privacy (e.g. nsfw)
|
||||
|
||||
*Customizability*
|
||||
_Privacy_
|
||||
|
||||
- Data protection (e.g. personal data or company data)
|
||||
- Privacy (e.g. nsfw)
|
||||
|
||||
_Customizability_
|
||||
|
||||
- Tinkerability (e.g. ability to change model, experiment)
|
||||
- Niche Models (e.g. fine-tuned, domain-specific models that outperform OpenAI)
|
||||
|
||||
@ -39,42 +62,43 @@ Sources: [^1] [^2] [^3] [^4]
|
||||
|
||||
[^1]: [What are you guys doing that can't be done with ChatGPT?](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7ksti6/?utm_source=share&utm_medium=web2x&context=3)
|
||||
[^2]: [What's your main interest in running a local LLM instead of an existing API?](https://www.reddit.com/r/LocalLLaMA/comments/1718a9o/whats_your_main_interest_in_running_a_local_llm/)
|
||||
[^3]: [Ask HN: What's the best self-hosted/local alternative to GPT-4?](https://news.ycombinator.com/item?id=36138224)
|
||||
[^3]: [Ask HN: What's the best self-hosted/local alternative to GPT-4?](https://news.ycombinator.com/item?id=36138224)
|
||||
[^4]: [LoRAs](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7mdz1i/?utm_source=share&utm_medium=web2x&context=3)
|
||||
|
||||
### Solution
|
||||
|
||||
Jan is a seamless user experience that runs on your personal computer, that glues the different pieces of the open source AI ecosystem to provide an alternative to OpenAI's closed platform.
|
||||
Jan is a seamless user experience that runs on your personal computer, that glues the different pieces of the open source AI ecosystem to provide an alternative to OpenAI's closed platform.
|
||||
|
||||
- We build a comprehensive, seamless platform that takes care of the technical chores across the stack required to run open source AI
|
||||
- We run on top of a local folder of non-proprietary files, that anyone can tinker with (yes, even other apps!)
|
||||
- We run on top of a local folder of non-proprietary files, that anyone can tinker with (yes, even other apps!)
|
||||
- We provide open formats for packaging and distributing AI to run reproducibly across devices
|
||||
|
||||
## How Jan Works
|
||||
|
||||
### Open Source
|
||||
|
||||
Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it.
|
||||
Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it.
|
||||
|
||||
- [Jan: a Personal AI](https://github.com/janhq/jan) (AGPLv3)
|
||||
- [Jan Framework](https://github.com/janhq/jan) (AGPLv3)
|
||||
- [Jan Desktop Client & Local server](https://jan.ai) (AGPLv3, built on Jan Framework)
|
||||
- [Nitro: run Local AI](https://github.com/janhq/nitro) (AGPLv3)
|
||||
|
||||
### Build in Public
|
||||
|
||||
We use Github to build in public, and welcome anyone to join in.
|
||||
We use Github to build in public, and welcome anyone to join in.
|
||||
|
||||
- [Jan's Kanban](https://github.com/orgs/janhq/projects/5)
|
||||
- [Jan's Roadmap](https://github.com/orgs/janhq/projects/5/views/29)
|
||||
|
||||
### Bootstrapped
|
||||
|
||||
Jan is currently a bootstrapped startup. We balance technical invention with the search for a sustainable business model.
|
||||
Jan is currently a bootstrapped startup. We balance technical invention with the search for a sustainable business model.
|
||||
|
||||
We appreciate any business that can balance growth with cashflow/profitability.
|
||||
We appreciate any business that can balance growth with cashflow/profitability.
|
||||
|
||||
### Remote Team
|
||||
|
||||
Jan has a fully-remote team. We are mainly based in the Asia timezone. We use [Discord](https://discord.gg/af6SaTdzpx) and [Github](https://github.com/janhq) to work.
|
||||
Jan has a fully-remote team. We are mainly based in the Asia timezone. We use [Discord](https://discord.gg/af6SaTdzpx) and [Github](https://github.com/janhq) to work.
|
||||
|
||||
## Contact
|
||||
|
||||
@ -88,6 +112,6 @@ Drop us a message in our [Discord](https://discord.gg/af6SaTdzpx) and we'll get
|
||||
|
||||
### Careers
|
||||
|
||||
Jan has a culture of ownership, independent thought, and lightning fast execution. If you'd like to join us, we have open positions on our [careers page](https://janai.bamboohr.com/careers).
|
||||
Jan has a culture of ownership, independent thought, and lightning fast execution. If you'd like to join us, we have open positions on our [careers page](https://janai.bamboohr.com/careers).
|
||||
|
||||
## Footnotes
|
||||
|
||||
@ -79,7 +79,7 @@ We believe all software applications can be natively supercharged with AI primit
|
||||
Including:
|
||||
|
||||
- OpenAI Compatible AI [types](https://github.com/janhq/jan/tree/main/core/src/types) and [core extensions](https://github.com/janhq/jan/tree/main/core/src/extensions) to support common functionality like making an inference call.
|
||||
- A lightweight, embedded C++ [inference engine/wrapper](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) that's immediately callable from code. _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._
|
||||
- Multiple inference engines through [extensions, integrations & wrappers](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._
|
||||
|
||||
- [Code Entrypoint](https://github.com/janhq/jan/tree/main/core/src/api)
|
||||
|
||||
9
docs/docs/docs/02-integrations/README.md
Normal file
9
docs/docs/docs/02-integrations/README.md
Normal file
@ -0,0 +1,9 @@
|
||||
---
|
||||
title: Integrations
|
||||
---
|
||||
|
||||
Existing and upcoming 3rd party integrations on top of Jan Framework.
|
||||
|
||||
From both the core development team, and core contributors.
|
||||
|
||||
Suggestions? File an [issue here](https://github.com/janhq/jan/issues)
|
||||
7
docs/docs/docs/02-integrations/langchain.md
Normal file
7
docs/docs/docs/02-integrations/langchain.md
Normal file
@ -0,0 +1,7 @@
|
||||
---
|
||||
title: Langchain
|
||||
---
|
||||
|
||||
:::caution
|
||||
WIP
|
||||
:::
|
||||
9
docs/docs/docs/02-integrations/llamacpp.md
Normal file
9
docs/docs/docs/02-integrations/llamacpp.md
Normal file
@ -0,0 +1,9 @@
|
||||
---
|
||||
title: LlamaCPP
|
||||
---
|
||||
|
||||
## Quicklinks
|
||||
|
||||
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension)
|
||||
- ggerganov/llama.pp [Source URL](https://github.com/ggerganov/llama.cpp)
|
||||
- [Productized Wrapper](https://nitro.jan.ai/): a bit lower effort to use out of the box
|
||||
7
docs/docs/docs/02-integrations/ollama.md
Normal file
7
docs/docs/docs/02-integrations/ollama.md
Normal file
@ -0,0 +1,7 @@
|
||||
---
|
||||
title: Ollama
|
||||
---
|
||||
|
||||
:::caution
|
||||
Requested, committed, but not started
|
||||
:::
|
||||
8
docs/docs/docs/02-integrations/openai.md
Normal file
8
docs/docs/docs/02-integrations/openai.md
Normal file
@ -0,0 +1,8 @@
|
||||
---
|
||||
title: OpenAI
|
||||
---
|
||||
|
||||
## Quicklinks
|
||||
|
||||
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-openai-extension)
|
||||
- OpenAI API [Reference Docs](https://platform.openai.com/docs/api-reference)
|
||||
7
docs/docs/docs/02-integrations/openrouter.md
Normal file
7
docs/docs/docs/02-integrations/openrouter.md
Normal file
@ -0,0 +1,7 @@
|
||||
---
|
||||
title: OpenRouter
|
||||
---
|
||||
|
||||
:::caution
|
||||
Requested, committed, but not started
|
||||
:::
|
||||
8
docs/docs/docs/02-integrations/tensorrt.md
Normal file
8
docs/docs/docs/02-integrations/tensorrt.md
Normal file
@ -0,0 +1,8 @@
|
||||
---
|
||||
title: TensorRT-LLM
|
||||
---
|
||||
|
||||
## Quicklinks
|
||||
|
||||
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-triton-trtllm-extension)
|
||||
- TensorRT [Source URL](https://github.com/NVIDIA/TensorRT-LLM)
|
||||
@ -1,3 +0,0 @@
|
||||
---
|
||||
title: Integrations
|
||||
---
|
||||
Loading…
x
Reference in New Issue
Block a user