16 Commits

Author SHA1 Message Date
Louis
5250061c11
feat: Jan Server, API and decoupled clients (#948)
* chore: expose fs apis

* chore: correct electron import path

* update download api

Signed-off-by: James <james@jan.ai>

* update chat_completion

Signed-off-by: James <james@jan.ai>

* fix electron import

Signed-off-by: James <james@jan.ai>

* feat: adding API support at 1337 (#991)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

* feat: Add /chat/completion api and handler

* chore: add todo for modelList

* chore: read engine.json for openai chat_completion (#1030)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

* refactor: move routes to shared node module

* refactor: exported modules from core with types (#1172)

* refactor: exported modules from core with types

* fix: fix file reading args

* refactor: fileManager handles

* fix: app issues with server refactoring

* refactor: shared server module (#1210)

* chore: resolve main

* chore: update makefile

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: hiro <vuonghoainam.work@gmail.com>
2023-12-28 17:57:39 +07:00
Louis
7feaf9694d
feat: Deprecate model.json ready state in favor of .download ext (#1238)
* feat: Deprecate model.json ready state in favor of .download ext

* refactor: resolve ts ignore

* chore: fix warning

* fix: path polyfill on Windows
2023-12-28 14:06:13 +07:00
Louis
e0370210a7
fix: #1096 yield error message upon thread switching (#1109) 2023-12-20 14:58:47 +07:00
Louis
4653030bc1
fix: #1097 streaming response is replaced by error message (#1099) 2023-12-19 16:42:13 +07:00
Faisal Amir
4f41dab9b5 feat: move stop inference button into the send button 2023-12-14 16:40:51 +07:00
hiro
16c66e968c chore: Update n_threads to cpu_threads 2023-12-12 06:15:22 +07:00
NamH
121dc119f1
feat: adding model params (#886)
* feat: adding model params

Signed-off-by: James <james@jan.ai>

* chore: inference request parameter

* Improve ui right panel model params

* Remove unused import

* Update slider track for darkmode

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
2023-12-11 23:58:24 +07:00
Louis
b939692187 chore: stop inference event 2023-12-08 23:07:30 +07:00
hiro
1177007ad6 fix: Update code based on comments from @james 2023-12-08 23:07:30 +07:00
hiro
9daee14167 fix: Add hack waiting for model loading 2023-12-08 23:06:49 +07:00
hiro
3987fdc95b feat: Add nitro inference engine stop model handler 2023-12-08 23:06:49 +07:00
hiro
0c3e23665b fix: Add dynamic values from engine settings and model params 2023-12-08 23:06:49 +07:00
hiro
2c648caa5f fix: Update nitro with read/ write for engine.json 2023-12-08 23:06:49 +07:00
hiro
56b778675f feat: Add nitro engine json reader and writer 2023-12-08 23:06:08 +07:00
hiro
337da50840 fix: Add fs to read and write nitro engine settings 2023-12-08 23:06:08 +07:00
hiro
c01737ff69 refactor: Change inference-extension to inference-nitro-extension 2023-12-08 23:06:08 +07:00