62 Commits

Author SHA1 Message Date
NamH
83f9e965d8
fix: user cannot click on copy icon of model id (#2744)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-17 15:57:19 +07:00
Faisal Amir
49401bd8eb
fix: broken several ui when model name too long (#2728) 2024-04-15 21:52:36 +07:00
Louis
9369ac3e8b
Merge branch 'dev' into main 2024-04-15 14:57:31 +07:00
Andreas Deininger
81e8889568
Fix typos (#2714) 2024-04-15 13:27:28 +07:00
Hoang Ha
b908ae2933
Chore: Change CommandR to unavailable (#2722)
* fix: move to comming soon

* fix: Q4 for consistancy

* version pump extension

* pump version model

* fix: highlight unsupported tag

---------

Co-authored-by: Louis <louis@jan.ai>
2024-04-15 12:57:52 +07:00
Louis
d5c4f745f1
fix: model selector lack of warning message when no models downloaded (#2651) 2024-04-08 22:38:38 +07:00
NamH
fa35aa6e14
feat: dynamically register extension settings (#2494)
* feat: add extesion settings

Signed-off-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2024-03-29 15:44:46 +07:00
Louis
d290ae1977
fix: text overflow 2024-03-25 23:58:36 +07:00
Louis
acbec78dbf
fix: refactor inference engines to extends AIEngine (#2347)
* fix: refactor nitro to extends localoaiengine

* fix: refactor openai extension

* chore: refactor groq extension

* chore: refactor triton tensorrt extension

* chore: add tests

* chore: refactor engines
2024-03-22 09:35:14 +07:00
Meta Spartan
0348aa3321
feat: Groq Inference Extension (#2263)
* feat: Groq Inference Extension

* Add Groq supported models

* Fix folder typo

* Add Groq options to interface and new API Key saving, tested working

* Fix linting
2024-03-18 06:40:20 +07:00
NamH
03a0978f53
fix: some costmetic issues: badges corner, recommended for tensorrt models(#2346)
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
2024-03-14 15:58:42 +07:00
Louis
d85d02693b
feat: Nitro-Tensorrt-LLM Extension (#2280)
* feat: tensorrt-llm-extension

* fix: loading

* feat: add download tensorrt llm runner

Signed-off-by: James <james@jan.ai>

* feat: update to rollupjs instead of webpack for monitoring extension

Signed-off-by: James <james@jan.ai>

* feat: move update nvidia info to monitor extension

Signed-off-by: James <james@jan.ai>

* allow download tensorrt

Signed-off-by: James <james@jan.ai>

* update

Signed-off-by: James <james@jan.ai>

* allow download tensor rt based on gpu setting

Signed-off-by: James <james@jan.ai>

* update downloaded models

Signed-off-by: James <james@jan.ai>

* feat: add extension compatibility

* dynamic tensor rt engines

Signed-off-by: James <james@jan.ai>

* update models

Signed-off-by: James <james@jan.ai>

* chore: remove ts-ignore

* feat: getting installation state from extension

Signed-off-by: James <james@jan.ai>

* chore: adding type for decompress

Signed-off-by: James <james@jan.ai>

* feat: update according Louis's comment

Signed-off-by: James <james@jan.ai>

* feat: add progress for installing extension

Signed-off-by: James <james@jan.ai>

* chore: remove args from extension installation

* fix: model download does not work properly

* fix: do not allow user to stop tensorrtllm inference

* fix: extension installed style

* fix: download tensorrt does not update state

Signed-off-by: James <james@jan.ai>

* chore: replace int4 by fl16

* feat: modal for installing extension

Signed-off-by: James <james@jan.ai>

* fix: start download immediately after press install

Signed-off-by: James <james@jan.ai>

* fix: error switching between engines

* feat: rename inference provider to ai engine and refactor to core

* fix: missing ulid

* fix: core bundler

* feat: add cancel extension installing

Signed-off-by: James <james@jan.ai>

* remove mocking for mac

Signed-off-by: James <james@jan.ai>

* fix: show models only when extension is ready

* add tensorrt badge for model

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: add compatible check (#2342)

* fix: add compatible check

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: font

* fix: copy

* fix: broken monitoring extension

* chore: bump engine

* fix: copy

* fix: model copy

* fix: copy

* fix: model json

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>

* fix: vulkan support

* fix: installation button padding

* fix: empty script

* fix: remove hard code string

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
2024-03-14 14:07:22 +07:00
Louis
5ca3069fa1
fix: image upload button and drag event are not enabled (#2248)
* fix: image upload button and drag event are not enabled

* fix: add tooltips for unsupported model
2024-03-06 09:09:38 +07:00
hiro
e6c10202e0
feat: Jan can see (#2069)
* feat: jan can see

feat: Add GPT-4 Vision model (Preview)

fix: Add visionModel as property in ModelInfo

fix: Fix condition to load local messages in useSetActiveThread hook

feat: Enable Image as input for chat

fix: Update model parameters in JSON files for remote GPT models

fix: Add thread as optional

fix: Add support for message as image

fix: Linter

fix: Update proxyModel to proxy_model and add textModel

chore: Change proxyModel to proxy_model

fix: Update settings with visionModel and textModel

fix: vision model passed through the retrieval tool

fix: linter

* fix: could not load image and request is not able to be sent

---------

Co-authored-by: Louis <louis@jan.ai>
2024-03-05 08:33:09 +07:00
Faisal Amir
635435fbb8
Revert feat: temporary remove dark mode (#2221)
* Revert "feat: temporary remove dark mode :(  (#2168)"

This reverts commit 222b4ad897c275dab0eaec3c8a8472bf3df7afc4.

* fix: revert darkmode and fix darkmode for import model

* fix: prettier format import model

---------

Co-authored-by: Louis <louis@jan.ai>
2024-03-04 14:46:10 +07:00
Faisal Amir
222b4ad897
feat: temporary remove dark mode :( (#2168)
* remove darkmode

* fix progress component background color
2024-02-27 20:39:57 +07:00
NamH
773963a456
feat: add import model (#2104)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-02-26 16:15:10 +07:00
Faisal Amir
6b88d4df4d
fix: remove caret down icon when tab selected into remote model (#2102) 2024-02-20 13:09:08 +07:00
Louis
3ab23d571f
fix: local server blank parameters if there is no thread selected (#2028)
* fix: local server blank parameters if there is no thread selected

* fix: show errors only when the selected model is started while starting the server

* fix: show loading progress of selected model only
2024-02-15 15:48:45 +07:00
Faisal Amir
5ec4b8e532
feat: revamp ui dropdown list model option (#1977)
* feat: add modal troubleshooting guideline

* resolve inconsistent message hidden

* feat: revamp ui dropdown list model option

* display model id and copy button

* add function copy id model from dropdownlist

* add info concurrently send requests to one active local model
2024-02-10 00:51:16 +07:00
Louis
5ddc6ea4c8
fix: the selected model auto revert back to previous used model with setting mismatch (#1883)
* fix: the selected model auto revert back to previous used model with setting mismatch

* fix: view in finder and view file action
2024-02-01 12:31:26 +07:00
Louis
532a589354
fix: model selection does not show in api settings page (#1802) 2024-01-26 18:57:52 +07:00
NamH
9fa28d2275
fix: user can't use a model in model hub (#1801)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-01-26 14:41:42 +07:00
Faisal Amir
69ff85f66a feat: improvement ux for local api server 2024-01-22 19:05:40 +07:00
Faisal Amir
a3f2a16cb4 fix: switching loader from remote to local model from thread right panel 2024-01-22 14:36:45 +07:00
Faisal Amir
612445b4fa fix: loader bar selected model right panel 2024-01-22 14:36:45 +07:00
Faisal Amir
25d09e7fe9 fix: disabled apikey while server running 2024-01-22 12:54:51 +07:00
Faisal Amir
deff1f54c8 remove unused code 2024-01-17 13:14:30 +07:00
Faisal Amir
f7fe1a1530 fix disabled right panel while server running 2024-01-17 13:14:30 +07:00
Faisal Amir
6b6a7a5cab fix resolve conflict 2024-01-17 13:14:30 +07:00
Faisal Amir
95225c3637 fix stop model first then start model when change on right panel setting 2024-01-17 13:14:30 +07:00
Faisal Amir
9fa684e480 reduce fake loader model start 2024-01-17 13:14:30 +07:00
Faisal Amir
14400452b8 allow start model when user select same value with selected model 2024-01-17 13:14:30 +07:00
Faisal Amir
292496ed20 fix localstorage user first time visit api dashboard 2024-01-17 13:14:30 +07:00
Faisal Amir
58161598c3 Add loader stating model on select dropdown 2024-01-17 13:14:30 +07:00
Faisal Amir
14fc686d50 Show alert when user first time visit api server 2024-01-17 13:14:30 +07:00
Faisal Amir
53cb96c205 WIP setting config api server 2024-01-17 13:14:30 +07:00
Faisal Amir
623dd62404 Showing empty state when logs are empty 2024-01-17 13:14:30 +07:00
Louis
246b12e54f
fix: wrong selected model ref (#1638) 2024-01-17 11:38:22 +07:00
NamH
db987e88f9
fix(Model): switch model caused app crash (#1596)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2024-01-17 09:33:40 +07:00
Louis
81ad936990
fix: switch model caused app crash (#1597) 2024-01-15 15:45:58 +07:00
Louis
0ffb756563
fix: #1559 Inference Parameters displayed on new thread with Openai GPT model (#1588) 2024-01-15 12:30:06 +07:00
Faisal Amir
a855027a5d feat: add compatibility tag to model selection in right panel 2024-01-12 15:56:59 +07:00
Louis
7dec382864
fix: could not change model params settings (#1547) 2024-01-12 13:35:30 +07:00
hiento09
1d902567f7
Switch from Gigabyte to Gibibyte (#1286)
Co-authored-by: Hien To <tominhhien97@gmail.com>
2024-01-02 14:54:41 +07:00
NamH
c580b4c848
feat: add engine settings (#1199)
* feat: add engine settings

Signed-off-by: James <james@jan.ai>
---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2023-12-28 09:11:37 +07:00
Faisal Amir
959bae3419 fix: remove delay tooltip and click event 2023-12-27 22:32:56 +07:00
Louis
a7f186cc5e
feat: users should be able to switch models mid-thread (#1226)
## Problem
Right now users have to start a new thread to use another model which causes a lot of confusion to our users.

fixes #1201
2023-12-27 15:35:27 +07:00
0xSage
cf4de3f30f chore: copy fixes 2023-12-22 12:11:09 +08:00
Faisal Amir
88fc0715b2
fix: added tooltip for user cannot change model after starting thread (#1115)
* fix: added tooltip for user cannot change model after starting thread

* fix: typo content tooltip
2023-12-20 15:24:09 +07:00