docs: add integrations

This commit is contained in:
0xSage 2024-01-08 15:04:24 +08:00
parent 0ffcd66513
commit 9b41bd0a2c
31 changed files with 102 additions and 26 deletions

View File

@ -1,37 +1,60 @@
--- ---
title: About Jan title: About Jan
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server. description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.
keywords: [Jan AI, Jan, ChatGPT alternative, local AI, private AI, conversational AI, no-subscription fee, large language model ] keywords:
[
Jan AI,
Jan,
ChatGPT alternative,
local AI,
private AI,
conversational AI,
no-subscription fee,
large language model,
]
--- ---
Jan believes in the need for an open source AI ecosystem, and are building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones. Jan believes in the need for an **open source AI ecosystem**. We are focused on building the infra and tooling to allow open source AIs to compete on a level playing field with proprietary ones.
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life. Jan's long-term technical endeavor is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
## Quicklinks
- Core product vision for [Jan Framework](http://localhost:3001/docs/)
- R&D and model training efforts [Discord](https://discord.gg/9NfUSyzp3y) (via our small data-center which is `free & open to all researchers who lack GPUs`!)
- Current implementations of Jan Framework: [Jan Desktop](https://jan.ai/), [Nitro](https://nitro.jan.ai/)
## Why does Jan Exist? ## Why does Jan Exist?
### Mission ### Mission
Our mission is to allow humans and businesses to own their AI, with the right to tinker, repair and innovate. Our current mission is to allow humans and businesses to **own their AI, with the right to tinker, repair and innovate**.
:::tip
Our life-long mission is to **eliminate work - so human can focus on creation, invention, and moral governance over robots**.
:::
### Ideal Customer ### Ideal Customer
Our ideal customer is an AI enthusiast or business who has experienced some limitations with OpenAI, and is keen to find open source alternatives. Our ideal customer is an AI enthusiast or business who has experienced some limitations with OpenAI, and is keen to find open source alternatives.
### Problems ### Problems
Our ideal customer would use Jan to solve one of these problems. Our ideal customer would use Jan to solve one of these problems.
_Control_
*Control*
- Control (e.g. preventing vendor lock-in) - Control (e.g. preventing vendor lock-in)
- Stability (e.g. runs predictably every time) - Stability (e.g. runs predictably every time)
- Local-use (e.g. for speed, or for airgapped environments) - Local-use (e.g. for speed, or for airgapped environments)
*Privacy*
- Data protection (e.g. personal data or company data)
- Privacy (e.g. nsfw)
*Customizability* _Privacy_
- Data protection (e.g. personal data or company data)
- Privacy (e.g. nsfw)
_Customizability_
- Tinkerability (e.g. ability to change model, experiment) - Tinkerability (e.g. ability to change model, experiment)
- Niche Models (e.g. fine-tuned, domain-specific models that outperform OpenAI) - Niche Models (e.g. fine-tuned, domain-specific models that outperform OpenAI)
@ -39,42 +62,43 @@ Sources: [^1] [^2] [^3] [^4]
[^1]: [What are you guys doing that can't be done with ChatGPT?](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7ksti6/?utm_source=share&utm_medium=web2x&context=3) [^1]: [What are you guys doing that can't be done with ChatGPT?](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7ksti6/?utm_source=share&utm_medium=web2x&context=3)
[^2]: [What's your main interest in running a local LLM instead of an existing API?](https://www.reddit.com/r/LocalLLaMA/comments/1718a9o/whats_your_main_interest_in_running_a_local_llm/) [^2]: [What's your main interest in running a local LLM instead of an existing API?](https://www.reddit.com/r/LocalLLaMA/comments/1718a9o/whats_your_main_interest_in_running_a_local_llm/)
[^3]: [Ask HN: What's the best self-hosted/local alternative to GPT-4?](https://news.ycombinator.com/item?id=36138224) [^3]: [Ask HN: What's the best self-hosted/local alternative to GPT-4?](https://news.ycombinator.com/item?id=36138224)
[^4]: [LoRAs](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7mdz1i/?utm_source=share&utm_medium=web2x&context=3) [^4]: [LoRAs](https://www.reddit.com/r/LocalLLaMA/comments/17mghqr/comment/k7mdz1i/?utm_source=share&utm_medium=web2x&context=3)
### Solution ### Solution
Jan is a seamless user experience that runs on your personal computer, that glues the different pieces of the open source AI ecosystem to provide an alternative to OpenAI's closed platform. Jan is a seamless user experience that runs on your personal computer, that glues the different pieces of the open source AI ecosystem to provide an alternative to OpenAI's closed platform.
- We build a comprehensive, seamless platform that takes care of the technical chores across the stack required to run open source AI - We build a comprehensive, seamless platform that takes care of the technical chores across the stack required to run open source AI
- We run on top of a local folder of non-proprietary files, that anyone can tinker with (yes, even other apps!) - We run on top of a local folder of non-proprietary files, that anyone can tinker with (yes, even other apps!)
- We provide open formats for packaging and distributing AI to run reproducibly across devices - We provide open formats for packaging and distributing AI to run reproducibly across devices
## How Jan Works ## How Jan Works
### Open Source ### Open Source
Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it. Jan is a startup with an open source business model. We believe in the need for an open source AI ecosystem, and are committed to building it.
- [Jan: a Personal AI](https://github.com/janhq/jan) (AGPLv3) - [Jan Framework](https://github.com/janhq/jan) (AGPLv3)
- [Jan Desktop Client & Local server](https://jan.ai) (AGPLv3, built on Jan Framework)
- [Nitro: run Local AI](https://github.com/janhq/nitro) (AGPLv3) - [Nitro: run Local AI](https://github.com/janhq/nitro) (AGPLv3)
### Build in Public ### Build in Public
We use Github to build in public, and welcome anyone to join in. We use Github to build in public, and welcome anyone to join in.
- [Jan's Kanban](https://github.com/orgs/janhq/projects/5) - [Jan's Kanban](https://github.com/orgs/janhq/projects/5)
- [Jan's Roadmap](https://github.com/orgs/janhq/projects/5/views/29) - [Jan's Roadmap](https://github.com/orgs/janhq/projects/5/views/29)
### Bootstrapped ### Bootstrapped
Jan is currently a bootstrapped startup. We balance technical invention with the search for a sustainable business model. Jan is currently a bootstrapped startup. We balance technical invention with the search for a sustainable business model.
We appreciate any business that can balance growth with cashflow/profitability. We appreciate any business that can balance growth with cashflow/profitability.
### Remote Team ### Remote Team
Jan has a fully-remote team. We are mainly based in the Asia timezone. We use [Discord](https://discord.gg/af6SaTdzpx) and [Github](https://github.com/janhq) to work. Jan has a fully-remote team. We are mainly based in the Asia timezone. We use [Discord](https://discord.gg/af6SaTdzpx) and [Github](https://github.com/janhq) to work.
## Contact ## Contact
@ -88,6 +112,6 @@ Drop us a message in our [Discord](https://discord.gg/af6SaTdzpx) and we'll get
### Careers ### Careers
Jan has a culture of ownership, independent thought, and lightning fast execution. If you'd like to join us, we have open positions on our [careers page](https://janai.bamboohr.com/careers). Jan has a culture of ownership, independent thought, and lightning fast execution. If you'd like to join us, we have open positions on our [careers page](https://janai.bamboohr.com/careers).
## Footnotes ## Footnotes

View File

@ -79,7 +79,7 @@ We believe all software applications can be natively supercharged with AI primit
Including: Including:
- OpenAI Compatible AI [types](https://github.com/janhq/jan/tree/main/core/src/types) and [core extensions](https://github.com/janhq/jan/tree/main/core/src/extensions) to support common functionality like making an inference call. - OpenAI Compatible AI [types](https://github.com/janhq/jan/tree/main/core/src/types) and [core extensions](https://github.com/janhq/jan/tree/main/core/src/extensions) to support common functionality like making an inference call.
- A lightweight, embedded C++ [inference engine/wrapper](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) that's immediately callable from code. _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._ - Multiple inference engines through [extensions, integrations & wrappers](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension) _On this, we'd like to appreciate the folks at [llamacpp](https://github.com/ggerganov/llama.cpp) and [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) for. To which we'll continue to make commits & fixes back upstream._
- [Code Entrypoint](https://github.com/janhq/jan/tree/main/core/src/api) - [Code Entrypoint](https://github.com/janhq/jan/tree/main/core/src/api)

View File

@ -0,0 +1,9 @@
---
title: Integrations
---
Existing and upcoming 3rd party integrations on top of Jan Framework.
From both the core development team, and core contributors.
Suggestions? File an [issue here](https://github.com/janhq/jan/issues)

View File

@ -0,0 +1,7 @@
---
title: Langchain
---
:::caution
WIP
:::

View File

@ -0,0 +1,9 @@
---
title: LlamaCPP
---
## Quicklinks
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-nitro-extension)
- ggerganov/llama.pp [Source URL](https://github.com/ggerganov/llama.cpp)
- [Productized Wrapper](https://nitro.jan.ai/): a bit lower effort to use out of the box

View File

@ -0,0 +1,7 @@
---
title: Ollama
---
:::caution
Requested, committed, but not started
:::

View File

@ -0,0 +1,8 @@
---
title: OpenAI
---
## Quicklinks
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-openai-extension)
- OpenAI API [Reference Docs](https://platform.openai.com/docs/api-reference)

View File

@ -0,0 +1,7 @@
---
title: OpenRouter
---
:::caution
Requested, committed, but not started
:::

View File

@ -0,0 +1,8 @@
---
title: TensorRT-LLM
---
## Quicklinks
- Jan Framework [Extension Code](https://github.com/janhq/jan/tree/main/extensions/inference-triton-trtllm-extension)
- TensorRT [Source URL](https://github.com/NVIDIA/TensorRT-LLM)

View File

@ -1,3 +0,0 @@
---
title: Integrations
---