Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,164 Commits 50 Branches 197 Tags
Commit Graph

353 Commits

Author SHA1 Message Date
Van-QA
cdab762a6a feat: add new test for the Use model button from Hub 2024-04-11 17:39:49 +07:00
Van-QA
ed7ba2cbf1 feat: init element for new thread 2024-04-11 17:39:49 +07:00
Louis
065ed03099
fix: wrong monitoring system information type (#2679) 2024-04-11 11:07:31 +07:00
Louis
b19234ed71
chore: Extension should have product name in manifest (#2675) 
* chore: Extension should have product name in manifest

* chore: typo
 2024-04-11 09:50:58 +07:00
Louis
d93d74c86b
feat: nitro additional dependencies (#2674) 2024-04-11 09:13:02 +07:00
NamH
69f73b86c4
fix: api server chat completion error for remote model (#2671) 
* fix: api server chat completion error for remote model

Signed-off-by: James <james@jan.ai>

* fix: duplicate setting in local api server

Signed-off-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-04-10 18:13:32 +07:00
Louis
3f23de6c28
feat: move log into monitoring extension (#2662) 2024-04-10 14:35:15 +07:00
zhhanging
5a9c63a776
handle enter key in cjk input method (#2657) 
Co-authored-by: zhhanging <hang@mindrank.ai>
 2024-04-09 21:50:15 +07:00
Louis
c31a6ef4d3
fix: missing api key error handling (#2645) 2024-04-09 11:33:12 +07:00
Louis
9479beb7d1
fix: unload model while loading cause unknown error (#2649) 
* fix: unload model while loading cause unknown error

* chore: mask placeholder
 2024-04-09 11:31:42 +07:00
Inchoker
1244f03f66
feat: mistral inference engine extension (#2569) 
* Add new feat: Inference Mistral extension

* change settings

* nitpicking fix

* fix model position and add mistral registerModel

* remove irrelevant changes

* change desc of mistral medium

Co-authored-by: Louis <louis@jan.ai>

* change desc of mistral small

Co-authored-by: Louis <louis@jan.ai>

* change desc of mistral large

Co-authored-by: Louis <louis@jan.ai>

* remove unpopular mistral model

* replace placeholder

* sort remaining models using size

---------

Co-authored-by: Jack Tri Le <Jack>
Co-authored-by: Louis <louis@jan.ai>
 2024-04-09 11:18:03 +07:00
NamH
c0c038f4f7
chore: filter gguf files when importing model on windows (#2653) 
Co-authored-by: Louis <louis@jan.ai>
 2024-04-09 10:36:01 +07:00
Louis
762d8879de
fix: redirect to extension setting (#2626) 2024-04-08 09:50:31 +07:00
Louis
f8cf93a906
chore: add GPU driver and toolkit status (#2628) 2024-04-08 09:50:16 +07:00
Inchoker
815a7aef96
Rearrange model position in Hub page (#2622) 
* Rearrange model position in Hub page

* fix linting

* Update web/screens/ExploreModels/ExploreModelList/index.tsx

Co-authored-by: Louis <louis@jan.ai>

---------

Co-authored-by: Jack Tri Le <Jack>
Co-authored-by: Louis <louis@jan.ai>
 2024-04-06 00:44:28 +07:00
Louis
9303e7aeb4
fix: object is destroyed block app exit (#2623) 2024-04-05 14:30:43 +07:00
GenkaOk
089e311bfd
Add API prefix settings (#2528) 
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
 2024-04-04 19:45:45 +07:00
Louis
1eaf13b13e
fix: cancel loading model with stop action (#2607) 2024-04-04 10:57:54 +07:00
Louis
931f1da28e
fix: duplicated error message (#2602) 2024-04-04 08:53:10 +07:00
Louis
6f0ee23776
fix: missing load model error message (#2581) 2024-04-02 22:16:43 +07:00
Louis
9797e5b05f
fix: broken auto link (#2580) 2024-04-02 18:45:35 +07:00
NamH
345c7d58e6
chore: some wordings in extension settings (#2573) 
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-04-02 15:31:20 +07:00
Louis
c6198ae423
fix: quick ask blocks app update (#2525) 2024-04-02 12:32:12 +07:00
Louis
f6d3b53ab5
Merge branch 'main' into dev 
# Conflicts:
#	web/screens/Chat/ErrorMessage/index.tsx
 2024-04-02 11:09:59 +07:00
GenkaOk
dd8be07120
Set name assistant (#2529) 2024-04-01 11:32:06 +07:00
Louis
228a363914
fix: image model does not work when retrieval tool is enabled (#2538) 2024-03-29 16:07:49 +07:00
NamH
fa35aa6e14
feat: dynamically register extension settings (#2494) 
* feat: add extesion settings

Signed-off-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
 2024-03-29 15:44:46 +07:00
NamH
132487acec
fix: show default error message from inference engine (#2533) 
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-29 11:53:34 +07:00
NamH
3ecdb81881
fix: file explore on windows show empty when importing model (#2484) 
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-29 01:24:53 +07:00
Louis
6e01e04c76
fix: should not show broken image (#2526) 2024-03-28 16:32:33 +07:00
Louis
784af8cf55
fix: model recommendation label is not based on VRAM (#2517) 2024-03-27 18:21:33 +07:00
Louis
d290ae1977
fix: text overflow 2024-03-25 23:58:36 +07:00
Louis
9551996e34
chore: load, unload model and inference synchronously 2024-03-25 12:25:30 +07:00
NamH
67e285fa96
chore: remove rmdirsync from core api since it is deprecated (#2459) 
* chore: remove rmdirsync from core api since it is deprecated

Signed-off-by: James <james@jan.ai>

* chore: remove mkdirsync

Signed-off-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-22 17:57:16 +07:00
NamH
419683d415
fix: move jan to not empty destination folder not functioning (#2464) 
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-22 16:03:39 +07:00
Louis
5edc24d8e0
fix: deleting threads manually breaks model settings and document upload (#2456) 
* fix: blank model settings and rag does not work

* fix: fallback support fro previous broken threads
 2024-03-22 13:56:46 +07:00
Louis
acbec78dbf
fix: refactor inference engines to extends AIEngine (#2347) 
* fix: refactor nitro to extends localoaiengine

* fix: refactor openai extension

* chore: refactor groq extension

* chore: refactor triton tensorrt extension

* chore: add tests

* chore: refactor engines
 2024-03-22 09:35:14 +07:00
Faisal Amir
f75d7e3ca7
fix: remove decodeURI for avoid URI malformed (#2416) 2024-03-20 10:08:18 +07:00
NamH
b8d86df688
Fix/unable factory reset windows nitro running (#2422) 
* fix: unable to factory reset when nitro is running on windows

---------

Signed-off-by: James <james@jan.ai>
 2024-03-19 18:05:03 +07:00
Louis
489e8aab24
Sync release 0.4.9 to dev (#2407) 
* fix: move tensorrt executable to engine (#2400)

* fix: move tensorrt executable to engine

Signed-off-by: James <james@jan.ai>

* some update

Signed-off-by: hiro <hiro@jan.ai>

* chore: bump tensorrt version

* fix: wrong destroy path

* fix: install extensions in parallel

* chore: update path for tensorrt engine (#2404)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>

* Release/v0.4.9 (#2421)

* fix: turn off experimental settings should also turn off quick ask (#2411)

* fix: app glitches 1s generating response before starting model (#2412)

* fix: disable experimental feature should also disable vulkan (#2414)

* fix: model load stuck on windows when can't get CPU core count (#2413)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

* feat: TensorRT-LLM engine update support (#2415)

* fix: engine update

* chore: add remove prepopulated models

Signed-off-by: James <james@jan.ai>

* update tinyjensen url

Signed-off-by: James <james@jan.ai>

* update llamacorn

Signed-off-by: James <james@jan.ai>

* update Mistral 7B Instruct v0.1 int4

Signed-off-by: James <james@jan.ai>

* update tensorrt

Signed-off-by: James <james@jan.ai>

* update

Signed-off-by: hiro <hiro@jan.ai>

* update

Signed-off-by: James <james@jan.ai>

* prettier

Signed-off-by: James <james@jan.ai>

* update mistral config

Signed-off-by: James <james@jan.ai>

* fix some lint

Signed-off-by: James <james@jan.ai>

---------

Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>

* Tensorrt LLM disable turing support (#2418)

Co-authored-by: Hien To <tominhhien97@gmail.com>

* chore: add prompt template tensorrtllm (#2375)

* chore: add prompt template tensorrtllm

* Add Prompt template for mistral and correct model metadata

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>

* fix: correct tensorrt mistral model.json (#2419)

---------

Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>

---------

Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
 2024-03-19 12:20:09 +07:00
Meta Spartan
0348aa3321
feat: Groq Inference Extension (#2263) 
* feat: Groq Inference Extension

* Add Groq supported models

* Fix folder typo

* Add Groq options to interface and new API Key saving, tested working

* Fix linting
 2024-03-18 06:40:20 +07:00
NamH
5f19983de1
fix: some regressions for tensorrt nightly build (#2380) 
* fix: some regressions for tensorrt nightly build

Signed-off-by: James <james@jan.ai>
---------

Signed-off-by: hiro <hiro@jan.ai>
Signed-off-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-15 17:45:56 +07:00
Louis
758afdbeb4
fix: incompatible GPU error message (#2357) 
* fix: incompatible GPU error message

* fix: change port
 2024-03-14 22:11:55 +07:00
Louis
aab8ee84af
fix: disable rag & stream settings from tensorrt model.json (#2351) 2024-03-14 19:04:31 +07:00
Faisal Amir
8120ad2a03
fix: badge or progress tensorRtExtensionItem (#2349) 2024-03-14 18:37:54 +07:00
NamH
d9c3852997
fix: ts error when declar var in case (#2348) 
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
 2024-03-14 17:16:14 +07:00
NamH
03a0978f53
fix: some costmetic issues: badges corner, recommended for tensorrt models(#2346) 
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
 2024-03-14 15:58:42 +07:00
Louis
d85d02693b
feat: Nitro-Tensorrt-LLM Extension (#2280) 
* feat: tensorrt-llm-extension

* fix: loading

* feat: add download tensorrt llm runner

Signed-off-by: James <james@jan.ai>

* feat: update to rollupjs instead of webpack for monitoring extension

Signed-off-by: James <james@jan.ai>

* feat: move update nvidia info to monitor extension

Signed-off-by: James <james@jan.ai>

* allow download tensorrt

Signed-off-by: James <james@jan.ai>

* update

Signed-off-by: James <james@jan.ai>

* allow download tensor rt based on gpu setting

Signed-off-by: James <james@jan.ai>

* update downloaded models

Signed-off-by: James <james@jan.ai>

* feat: add extension compatibility

* dynamic tensor rt engines

Signed-off-by: James <james@jan.ai>

* update models

Signed-off-by: James <james@jan.ai>

* chore: remove ts-ignore

* feat: getting installation state from extension

Signed-off-by: James <james@jan.ai>

* chore: adding type for decompress

Signed-off-by: James <james@jan.ai>

* feat: update according Louis's comment

Signed-off-by: James <james@jan.ai>

* feat: add progress for installing extension

Signed-off-by: James <james@jan.ai>

* chore: remove args from extension installation

* fix: model download does not work properly

* fix: do not allow user to stop tensorrtllm inference

* fix: extension installed style

* fix: download tensorrt does not update state

Signed-off-by: James <james@jan.ai>

* chore: replace int4 by fl16

* feat: modal for installing extension

Signed-off-by: James <james@jan.ai>

* fix: start download immediately after press install

Signed-off-by: James <james@jan.ai>

* fix: error switching between engines

* feat: rename inference provider to ai engine and refactor to core

* fix: missing ulid

* fix: core bundler

* feat: add cancel extension installing

Signed-off-by: James <james@jan.ai>

* remove mocking for mac

Signed-off-by: James <james@jan.ai>

* fix: show models only when extension is ready

* add tensorrt badge for model

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: add compatible check (#2342)

* fix: add compatible check

Signed-off-by: James <james@jan.ai>

* fix: copy

* fix: font

* fix: copy

* fix: broken monitoring extension

* chore: bump engine

* fix: copy

* fix: model copy

* fix: copy

* fix: model json

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>

* fix: vulkan support

* fix: installation button padding

* fix: empty script

* fix: remove hard code string

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
 2024-03-14 14:07:22 +07:00
Louis
bff20ab87b
fix: put quick ask feature toggle under experimental feature (#2338) 2024-03-13 10:18:20 +07:00
Louis
af5bcea773
fix: gate quick ask with feature toggle (#2331) 2024-03-12 20:10:59 +07:00