Louis
537ef20a54
chore: replace nitro by cortex-cpp ( #2912 )
2024-05-16 17:46:49 +07:00
Louis
1130979008
fix: cohere stream param does not work ( #2907 )
2024-05-15 17:27:37 +07:00
NamH
6af4a2d484
feat: add deeplink support ( #2883 )
...
* feat: add deeplink support
* fix windows not receive deeplink when not running
---------
Co-authored-by: James <james@jan.ai>
2024-05-13 09:37:05 +07:00
Louis
63a2f22414
Merge branch 'dev' into main
2024-04-25 14:14:54 +07:00
Inchoker
96abd533c4
feat: cohere remote API extension ( #2785 )
...
* fix core
* add cohere extension
* add cohere response customizable
* nitpicking
* use transformResponse
* Update extensions/inference-cohere-extension/src/index.ts
Co-authored-by: Louis <louis@jan.ai>
* use prettier
* Update extensions/inference-cohere-extension/src/index.ts
Co-authored-by: Louis <louis@jan.ai>
* pass requestBody as object
* transformPayload as a property
* This is not correct. CHATBOT is an equivalent role to assistant.
system message should be used with the preamble parameter and should not be included in the chat_history
---------
Co-authored-by: Jack Tri Le <Jack>
Co-authored-by: Louis <louis@jan.ai>
2024-04-24 18:16:57 +07:00
Louis
da161cd159
fix: override cpu_threads setting from model.json ( #2789 )
2024-04-23 15:09:48 +07:00
NamH
95632788e4
chore: default context length to 2048 ( #2746 )
2024-04-17 19:14:51 +07:00
NamH
31397de2d1
Refactor/deprecate hugging face ext ( #2620 )
...
* refactor: deprecate huggingface extension
Signed-off-by: James <james@jan.ai>
2024-04-16 17:23:45 +07:00
NamH
889d374fad
fix: log is not generated after clear log from setting ( #2732 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-15 22:53:04 +07:00
NamH
20657bb3da
fix: cannot cancel model which is progress at 0 percent ( #2727 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-15 21:52:22 +07:00
Louis
9369ac3e8b
Merge branch 'dev' into main
2024-04-15 14:57:31 +07:00
Andreas Deininger
81e8889568
Fix typos ( #2714 )
2024-04-15 13:27:28 +07:00
Faisal Amir
1619478250
enhancement: update input component dynamic text alignment ( #2712 )
2024-04-15 09:48:57 +07:00
Louis
fa9d8ab9a5
fix: switch between models get stuck at generating ( #2698 )
2024-04-12 12:34:22 +07:00
Louis
065ed03099
fix: wrong monitoring system information type ( #2679 )
2024-04-11 11:07:31 +07:00
NamH
ddb73d8131
fix: can't read the setting at first time ( #2677 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-11 10:56:47 +07:00
Louis
b19234ed71
chore: Extension should have product name in manifest ( #2675 )
...
* chore: Extension should have product name in manifest
* chore: typo
2024-04-11 09:50:58 +07:00
Louis
d93d74c86b
feat: nitro additional dependencies ( #2674 )
2024-04-11 09:13:02 +07:00
NamH
8917be5ef3
fix: add fallback as default endpoint for inference engine ( #2669 )
...
Co-authored-by: James <james@jan.ai>
2024-04-10 18:15:20 +07:00
NamH
69f73b86c4
fix: api server chat completion error for remote model ( #2671 )
...
* fix: api server chat completion error for remote model
Signed-off-by: James <james@jan.ai>
* fix: duplicate setting in local api server
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-10 18:13:32 +07:00
Inchoker
00049aac7d
fix error handling of core for mistral integration ( #2672 )
...
* fix error handling of core for mistral integration
* refactor logic using status code
* nitpicking fix
---------
Co-authored-by: Jack Tri Le <Jack>
2024-04-10 17:03:26 +07:00
Louis
3f23de6c28
feat: move log into monitoring extension ( #2662 )
2024-04-10 14:35:15 +07:00
hiento09
5fd6025175
Bump nitro version to 0.3.18 ( #2652 )
2024-04-09 12:31:10 +07:00
Louis
c31a6ef4d3
fix: missing api key error handling ( #2645 )
2024-04-09 11:33:12 +07:00
NamH
c0c038f4f7
chore: filter gguf files when importing model on windows ( #2653 )
...
Co-authored-by: Louis <louis@jan.ai>
2024-04-09 10:36:01 +07:00
Louis
9303e7aeb4
fix: object is destroyed block app exit ( #2623 )
2024-04-05 14:30:43 +07:00
NamH
e0d6049d66
chore: extension should register its own models ( #2601 )
...
* chore: extension should register its own models
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-05 14:18:58 +07:00
GenkaOk
089e311bfd
Add API prefix settings ( #2528 )
...
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
2024-04-04 19:45:45 +07:00
Louis
a484315699
fix: wrong response header for non streamed responses ( #2606 )
2024-04-04 06:37:06 +07:00
Louis
fe89901a65
fix: groq frequently stops during long responses ( #2584 )
2024-04-02 22:19:34 +07:00
Louis
3fded8fd20
fix: regenerate message should not include the assistant's previous response ( #2583 )
2024-04-02 22:17:35 +07:00
Louis
f6d3b53ab5
Merge branch 'main' into dev
...
# Conflicts:
# web/screens/Chat/ErrorMessage/index.tsx
2024-04-02 11:09:59 +07:00
NamH
fa35aa6e14
feat: dynamically register extension settings ( #2494 )
...
* feat: add extesion settings
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2024-03-29 15:44:46 +07:00
NamH
132487acec
fix: show default error message from inference engine ( #2533 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-03-29 11:53:34 +07:00
NamH
3ecdb81881
fix: file explore on windows show empty when importing model ( #2484 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-03-29 01:24:53 +07:00
Louis
3b3eb119f0
fix: duplicate api definition ( #2522 )
2024-03-28 11:45:08 +07:00
Louis
75eea1fdb2
Merge branch 'dev'
...
# Conflicts:
# core/src/browser/core.ts
# core/src/browser/extensions/monitoring.ts
# core/src/browser/fs.ts
# core/src/extensions/ai-engines/LocalOAIEngine.ts
# extensions/monitoring-extension/src/node/index.ts
# extensions/tensorrt-llm-extension/src/index.ts
# extensions/tensorrt-llm-extension/src/node/index.ts
# web/hooks/useSendChatMessage.ts
2024-03-28 10:46:05 +07:00
Louis
8e8dfd4b37
refactor: introduce inference tools ( #2493 )
2024-03-25 23:26:05 +07:00
Louis
14a67463dc
chore: refactor core folder structure - module based
2024-03-25 16:20:06 +07:00
Louis
9551996e34
chore: load, unload model and inference synchronously
2024-03-25 12:25:30 +07:00
NamH
67e285fa96
chore: remove rmdirsync from core api since it is deprecated ( #2459 )
...
* chore: remove rmdirsync from core api since it is deprecated
Signed-off-by: James <james@jan.ai>
* chore: remove mkdirsync
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-03-22 17:57:16 +07:00
NamH
8303f74f58
fix: only allow 4 stop words for openai ( #2457 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-03-22 13:46:12 +07:00
NamH
6dd26f6a4b
fix: post to /v1/threads not found ( #2455 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-03-22 12:41:51 +07:00
Louis
acbec78dbf
fix: refactor inference engines to extends AIEngine ( #2347 )
...
* fix: refactor nitro to extends localoaiengine
* fix: refactor openai extension
* chore: refactor groq extension
* chore: refactor triton tensorrt extension
* chore: add tests
* chore: refactor engines
2024-03-22 09:35:14 +07:00
Louis
ff7ec39915
fix: incompatible browser dependency ( #2439 )
...
* fix: incompatible browser dependency
* fix: update model extension to use rollup
* fix: test timeout
2024-03-21 16:54:42 +07:00
NamH
b8d86df688
Fix/unable factory reset windows nitro running ( #2422 )
...
* fix: unable to factory reset when nitro is running on windows
---------
Signed-off-by: James <james@jan.ai>
2024-03-19 18:05:03 +07:00
Louis
489e8aab24
Sync release 0.4.9 to dev ( #2407 )
...
* fix: move tensorrt executable to engine (#2400 )
* fix: move tensorrt executable to engine
Signed-off-by: James <james@jan.ai>
* some update
Signed-off-by: hiro <hiro@jan.ai>
* chore: bump tensorrt version
* fix: wrong destroy path
* fix: install extensions in parallel
* chore: update path for tensorrt engine (#2404 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* Release/v0.4.9 (#2421 )
* fix: turn off experimental settings should also turn off quick ask (#2411 )
* fix: app glitches 1s generating response before starting model (#2412 )
* fix: disable experimental feature should also disable vulkan (#2414 )
* fix: model load stuck on windows when can't get CPU core count (#2413 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: TensorRT-LLM engine update support (#2415 )
* fix: engine update
* chore: add remove prepopulated models
Signed-off-by: James <james@jan.ai>
* update tinyjensen url
Signed-off-by: James <james@jan.ai>
* update llamacorn
Signed-off-by: James <james@jan.ai>
* update Mistral 7B Instruct v0.1 int4
Signed-off-by: James <james@jan.ai>
* update tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: hiro <hiro@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* prettier
Signed-off-by: James <james@jan.ai>
* update mistral config
Signed-off-by: James <james@jan.ai>
* fix some lint
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
* Tensorrt LLM disable turing support (#2418 )
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: add prompt template tensorrtllm (#2375 )
* chore: add prompt template tensorrtllm
* Add Prompt template for mistral and correct model metadata
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
* fix: correct tensorrt mistral model.json (#2419 )
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
2024-03-19 12:20:09 +07:00
NamH
3a3bceb0c0
Release/v0.4.9 ( #2421 )
...
* fix: turn off experimental settings should also turn off quick ask (#2411 )
* fix: app glitches 1s generating response before starting model (#2412 )
* fix: disable experimental feature should also disable vulkan (#2414 )
* fix: model load stuck on windows when can't get CPU core count (#2413 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: TensorRT-LLM engine update support (#2415 )
* fix: engine update
* chore: add remove prepopulated models
Signed-off-by: James <james@jan.ai>
* update tinyjensen url
Signed-off-by: James <james@jan.ai>
* update llamacorn
Signed-off-by: James <james@jan.ai>
* update Mistral 7B Instruct v0.1 int4
Signed-off-by: James <james@jan.ai>
* update tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: hiro <hiro@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* prettier
Signed-off-by: James <james@jan.ai>
* update mistral config
Signed-off-by: James <james@jan.ai>
* fix some lint
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
* Tensorrt LLM disable turing support (#2418 )
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: add prompt template tensorrtllm (#2375 )
* chore: add prompt template tensorrtllm
* Add Prompt template for mistral and correct model metadata
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
* fix: correct tensorrt mistral model.json (#2419 )
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
2024-03-19 10:06:47 +07:00
NamH
c81a33f382
fix: move tensorrt executable to engine ( #2400 )
...
* fix: move tensorrt executable to engine
Signed-off-by: James <james@jan.ai>
* some update
Signed-off-by: hiro <hiro@jan.ai>
* chore: bump tensorrt version
* fix: wrong destroy path
* fix: install extensions in parallel
* chore: update path for tensorrt engine (#2404 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2024-03-18 07:38:35 +07:00
Meta Spartan
0348aa3321
feat: Groq Inference Extension ( #2263 )
...
* feat: Groq Inference Extension
* Add Groq supported models
* Fix folder typo
* Add Groq options to interface and new API Key saving, tested working
* Fix linting
2024-03-18 06:40:20 +07:00
