Ikko Eltociear Ashimine
e8ac8d8c01
chore: update download.ts ( #3088 )
...
infomation -> information
2024-07-12 14:37:14 +07:00
Louis
537ef20a54
chore: replace nitro by cortex-cpp ( #2912 )
2024-05-16 17:46:49 +07:00
NamH
20657bb3da
fix: cannot cancel model which is progress at 0 percent ( #2727 )
...
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-15 21:52:22 +07:00
Andreas Deininger
81e8889568
Fix typos ( #2714 )
2024-04-15 13:27:28 +07:00
NamH
69f73b86c4
fix: api server chat completion error for remote model ( #2671 )
...
* fix: api server chat completion error for remote model
Signed-off-by: James <james@jan.ai>
* fix: duplicate setting in local api server
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
2024-04-10 18:13:32 +07:00
Louis
3f23de6c28
feat: move log into monitoring extension ( #2662 )
2024-04-10 14:35:15 +07:00
NamH
fa35aa6e14
feat: dynamically register extension settings ( #2494 )
...
* feat: add extesion settings
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
2024-03-29 15:44:46 +07:00
Louis
489e8aab24
Sync release 0.4.9 to dev ( #2407 )
...
* fix: move tensorrt executable to engine (#2400 )
* fix: move tensorrt executable to engine
Signed-off-by: James <james@jan.ai>
* some update
Signed-off-by: hiro <hiro@jan.ai>
* chore: bump tensorrt version
* fix: wrong destroy path
* fix: install extensions in parallel
* chore: update path for tensorrt engine (#2404 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* Release/v0.4.9 (#2421 )
* fix: turn off experimental settings should also turn off quick ask (#2411 )
* fix: app glitches 1s generating response before starting model (#2412 )
* fix: disable experimental feature should also disable vulkan (#2414 )
* fix: model load stuck on windows when can't get CPU core count (#2413 )
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: TensorRT-LLM engine update support (#2415 )
* fix: engine update
* chore: add remove prepopulated models
Signed-off-by: James <james@jan.ai>
* update tinyjensen url
Signed-off-by: James <james@jan.ai>
* update llamacorn
Signed-off-by: James <james@jan.ai>
* update Mistral 7B Instruct v0.1 int4
Signed-off-by: James <james@jan.ai>
* update tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: hiro <hiro@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* prettier
Signed-off-by: James <james@jan.ai>
* update mistral config
Signed-off-by: James <james@jan.ai>
* fix some lint
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
* Tensorrt LLM disable turing support (#2418 )
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: add prompt template tensorrtllm (#2375 )
* chore: add prompt template tensorrtllm
* Add Prompt template for mistral and correct model metadata
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
* fix: correct tensorrt mistral model.json (#2419 )
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
---------
Signed-off-by: James <james@jan.ai>
Signed-off-by: hiro <hiro@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
2024-03-19 12:20:09 +07:00
Meta Spartan
0348aa3321
feat: Groq Inference Extension ( #2263 )
...
* feat: Groq Inference Extension
* Add Groq supported models
* Fix folder typo
* Add Groq options to interface and new API Key saving, tested working
* Fix linting
2024-03-18 06:40:20 +07:00
Louis
af5bcea773
fix: gate quick ask with feature toggle ( #2331 )
2024-03-12 20:10:59 +07:00
Louis
a3aceb8f60
fix: settings page state loop and dark theme ( #2065 )
...
* fix: settings page state loop and dark theme
* fix: crash on visiting settings page
2024-02-18 14:24:54 +07:00
Louis
6590ee7a6a
fix: local server start error should not change to started state ( #2052 )
2024-02-16 14:58:34 +07:00
Louis
3412a23654
chore: prettier fix ( #2019 )
2024-02-15 08:38:05 +07:00
Louis
5f95841fab
refactor: reduce IPC & API handlers - shared node logics ( #2011 )
2024-02-14 08:50:28 +07:00
