80 Commits

Author SHA1 Message Date
Louis
d85d02693b
feat: Nitro-Tensorrt-LLM Extension (#2280)
* feat: tensorrt-llm-extension

* fix: loading

* feat: add download tensorrt llm runner

Signed-off-by: James <james@jan.ai>

* feat: update to rollupjs instead of webpack for monitoring extension

Signed-off-by: James <james@jan.ai>

* feat: move update nvidia info to monitor extension

Signed-off-by: James <james@jan.ai>

* allow download tensorrt

Signed-off-by: James <james@jan.ai>

* update

Signed-off-by: James <james@jan.ai>

* allow download tensor rt based on gpu setting

Signed-off-by: James <james@jan.ai>

* update downloaded models

Signed-off-by: James <james@jan.ai>

* feat: add extension compatibility

* dynamic tensor rt engines

Signed-off-by: James <james@jan.ai>

* update models

Signed-off-by: James <james@jan.ai>

* chore: remove ts-ignore

* feat: getting installation state from extension

Signed-off-by: James <james@jan.ai>

* chore: adding type for decompress

Signed-off-by: James <james@jan.ai>

* feat: update according Louis's comment

Signed-off-by: James <james@jan.ai>

* feat: add progress for installing extension

Signed-off-by: James <james@jan.ai>

* chore: remove args from extension installation

* fix: model download does not work properly

* fix: do not allow user to stop tensorrtllm inference

* fix: extension installed style

* fix: download tensorrt does not update state

Signed-off-by: James <james@jan.ai>

* chore: replace int4 by fl16

* feat: modal for installing extension

Signed-off-by: James <james@jan.ai>

* fix: start download immediately after press install

Signed-off-by: James <james@jan.ai>

* fix: error switching between engines

* feat: rename inference provider to ai engine and refactor to core

* fix: missing ulid

* fix: core bundler

* feat: add cancel extension installing

Signed-off-by: James <james@jan.ai>

* remove mocking for mac

Signed-off-by: James <james@jan.ai>

* fix: show models only when extension is ready

* add tensorrt badge for model

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: add compatible check (#2342)

* fix: add compatible check

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: font

* fix: copy

* fix: broken monitoring extension

* chore: bump engine

* fix: copy

* fix: model copy

* fix: copy

* fix: model json

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>

* fix: vulkan support

* fix: installation button padding

* fix: empty script

* fix: remove hard code string

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
2024-03-14 14:07:22 +07:00
Louis
49ad855843
feat: prompt user to download an update manually (#2261) 2024-03-07 09:36:42 +07:00
Faisal Amir
635435fbb8
Revert feat: temporary remove dark mode (#2221)
* Revert "feat: temporary remove dark mode :(  (#2168)"

This reverts commit 222b4ad897c275dab0eaec3c8a8472bf3df7afc4.

* fix: revert darkmode and fix darkmode for import model

* fix: prettier format import model

---------

Co-authored-by: Louis <louis@jan.ai>
2024-03-04 14:46:10 +07:00
Faisal Amir
883d631452
fix space between progress bar and title list of gpu (#2177) 2024-02-27 21:25:31 +07:00
Faisal Amir
222b4ad897
feat: temporary remove dark mode :( (#2168)
* remove darkmode

* fix progress component background color
2024-02-27 20:39:57 +07:00
Faisal Amir
45efcad233
fix: style list of gpu on system monitor (#2172) 2024-02-27 16:55:01 +07:00
Faisal Amir
b1e748b958
fix: system monitor expand overlap tooltip ribbon (#2158) 2024-02-27 13:24:32 +07:00
NamH
773963a456
feat: add import model (#2104)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-02-26 16:15:10 +07:00
Faisal Amir
563f37f884
fix: system monitor ui (#2135) 2024-02-23 17:12:26 +07:00
Faisal Amir
56be7742e7
feat: revamp system monitor (#2097)
* feat: revamp system monitor

* feat: revamp system monitor ui

* remove system monitor page

* fix e2e test navigation

* added click outside system monitor

* update height content system monitor
2024-02-22 13:51:23 +07:00
Faisal Amir
94bee0b1b6
fix: flow edit message (#2113)
* fix flow edit message

* flx flow eidt message

* remove unused import
2024-02-21 21:55:37 +07:00
Louis
cffc382caf
fix: tools section should be expanded by default (#2110) 2024-02-21 08:45:37 +07:00
Louis
63cffca51e
chore: refactor watch system resource hook (#2048) 2024-02-16 13:22:21 +07:00
NamH
42da19a463
fix: download mutilple binaries (#2043)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-02-16 11:32:14 +07:00
Van Pham
82b361a5be
feat: Initialize POM structure with fixtures on Playwright (#2015)
* feat: video recorder on failures

* feat: fixture for sample page class

* feat: video recorder on failures

* feat: fixture for sample page class

* feat: video recorder on failures

* feat: fixture for sample page class

* feat: Apply Screenshot on failures

* feat: set timeout by default

* chore: clean up import

* feat: video recorder on failures

* feat: fixture for sample page class

* feat: add wait for app update

* chore: correct timeout

* chore: correct timeout

* chore: test timeout

* chore: test timeout

* chore: test timeout

* chore: browser context config

* chore: temporally disable the video recorder to bypass issue
2024-02-15 20:18:02 +07:00
Louis
3412a23654
chore: prettier fix (#2019) 2024-02-15 08:38:05 +07:00
Faisal Amir
6f520b4534
feat: imporve UI/UX gpu acceleration feature (#1990) 2024-02-13 15:36:42 +07:00
Louis
5890ade451
chore: server download progress + S3 (#1925)
* fix: reduce the number of api call

Signed-off-by: James <james@jan.ai>

* fix: download progress

Signed-off-by: James <james@jan.ai>

* chore: save blob

* fix: server boot up

* fix: download state not updating

Signed-off-by: James <james@jan.ai>

* fix: copy assets

* Add Dockerfile CPU for Jan Server and Jan Web

* Add Dockerfile GPU for Jan Server and Jan Web

* feat: S3 adapter

* Update check find count from ./pre-install and correct copy:asserts command

* server add bundleDependencies @janhq/core

* server add bundleDependencies @janhq/core

* fix: update success/failed download state (#1945)

* fix: update success/failed download state

Signed-off-by: James <james@jan.ai>

* fix: download model progress and state handling for both Desktop and Web

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>

* chore: refactor

* fix: load models empty first time open

* Add Docker compose

* fix: assistants onUpdate

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
2024-02-07 17:54:35 +07:00
hiento09
4471b2c941
feat: User Selectable GPUs and GPU-based Model Recommendations (#1730) 2024-02-06 17:31:46 +07:00
NamH
01fec49798
fix: reduce the number of api call (#1896)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-02-05 13:13:39 +07:00
Faisal Amir
5e13fd2f53 fix: loader error change folder 2024-01-30 16:36:58 +07:00
Faisal Amir
a4772202af fix: add loader when user change folder 2024-01-29 17:00:23 +07:00
Louis
61d5c6abe8
fix: model selection does not show in API settings page (#1828) 2024-01-29 10:34:09 +07:00
NamH
23dfb1c12f
fix: cannot change jan data folder (#1805)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-01-26 20:07:18 +07:00
NamH
acc774dc80
fix(Wording): #1758 correct text for windows (#1768)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-01-25 16:02:01 +07:00
Faisal Amir
6ba48bc1e3
feat: update UI allow user change folder (#1738)
* feat: wip ui jan folder setting

* change input disabled

* finished change directory jan folder

* fix overlap value input current path folder

* make app reload to latest page

* fix: add experimental feature toggle til the next release

---------

Co-authored-by: Louis <louis@jan.ai>
2024-01-24 22:13:58 +07:00
Faisal Amir
1b794b5337
fix: input port have range validation (#1741)
* fix port cannot be empty and have range validation

* fix: do not allow user to start server with blank port config (after navigating back)

* fix: thread disable button color

---------

Co-authored-by: Louis <louis@jan.ai>
2024-01-24 21:33:45 +07:00
Faisal Amir
69ff85f66a feat: improvement ux for local api server 2024-01-22 19:05:40 +07:00
Faisal Amir
fc025f63ab fix: avoid random text select when collapse panel 2024-01-17 15:39:53 +07:00
Faisal Amir
382cf48898 hide inference params and remove subtitle show in finder 2024-01-17 13:14:30 +07:00
Faisal Amir
623dd62404 Showing empty state when logs are empty 2024-01-17 13:14:30 +07:00
Faisal Amir
056cc8e722 Add tooltip on every action start and stop button while server is running 2024-01-17 13:14:30 +07:00
Faisal Amir
f5eaa41d09 hiding menu icon collapse panel left in local server page 2024-01-17 13:14:30 +07:00
Faisal Amir
167db02f04 refactor function click on finder / json to usePath 2024-01-17 13:14:30 +07:00
Faisal Amir
cf83292c26 disabled thread menu on ribbon when local server running 2024-01-17 13:14:30 +07:00
Faisal Amir
66fd0829db feat: added API server dashboard 2024-01-17 13:14:30 +07:00
Simon Lucido
3670e744b5 fix: #1545 long thread title
Signed-off-by: Simon Lucido <simon34280@gmail.com>
2024-01-16 11:56:14 +07:00
NamH
4a2f5bce8d
fix(Thread): #1212 thread.json not created when user change thread settings (#1570)
Signed-off-by: nam <namnh0122@gmail.com>
2024-01-14 17:46:25 +07:00
Faisal Amir
39cdd638d4 Add icon collapsible left panel and update keyboard shortcut page 2024-01-08 13:48:11 +07:00
Faisal Amir
73566e3907 fix copy on shortcut view 2024-01-08 10:20:55 +07:00
Faisal Amir
548203c8aa Resolve conflict 2024-01-08 10:20:55 +07:00
Faisal Amir
a3dd868722 make cmd shortcut list always show on bottom bar 2024-01-08 10:20:55 +07:00
Faisal Amir
e38e9c7e45 feat: allow user click badge cmd shortcut my model and update copy 2024-01-08 10:20:55 +07:00
NamH
82ffcd06f1
feat(UI): #1404 make left side bar collapsible by hot key (#1420)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-01-08 09:26:03 +07:00
NamH
9ca6487183
chore: clean up use os hook (#1418)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-01-07 13:16:56 +07:00
Faisal Amir
aecef0df5a chore: move social media from left panel into footer 2024-01-04 14:43:36 +07:00
Faisal Amir
c81f301b6c revert social media link 2024-01-04 14:39:33 +07:00
Louis
f97fdaed30 chore: stop model accordingly on settings changes 2024-01-04 14:39:33 +07:00
Faisal Amir
a653c58384 Revert back save button thread setting 2024-01-04 14:39:33 +07:00
Faisal Amir
2a90cac56d feat: make auto focus button leave when dialog unsave setting shown 2024-01-04 14:39:33 +07:00