28 Commits

Author SHA1 Message Date
Louis
a9579a3cbd
fix: remove redundant gpu detection prompt event (#1254) 2023-12-29 16:37:34 +07:00
hiento09
1ec8174700
Feature GPU detection for Jan on Windows and Linux (#1242)
* Add js function to generate gpu and cuda detection

* inference nitro manage via json file instead of bash and bat script

* Add /usr/lib/x86_64-linux-gnu/ to linux check gpu

* chore: add CPU - GPU toggle

* correct file path

* fix: exist file sync check

* fix: get resources path

* Fix error jan/engines create existed error

* Seting sync to file

* Fix error show notification for GPU

* Set notify default to true

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
2023-12-29 15:56:36 +07:00
Louis
5250061c11
feat: Jan Server, API and decoupled clients (#948)
* chore: expose fs apis

* chore: correct electron import path

* update download api

Signed-off-by: James <james@jan.ai>

* update chat_completion

Signed-off-by: James <james@jan.ai>

* fix electron import

Signed-off-by: James <james@jan.ai>

* feat: adding API support at 1337 (#991)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

* feat: Add /chat/completion api and handler

* chore: add todo for modelList

* chore: read engine.json for openai chat_completion (#1030)

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>

* refactor: move routes to shared node module

* refactor: exported modules from core with types (#1172)

* refactor: exported modules from core with types

* fix: fix file reading args

* refactor: fileManager handles

* fix: app issues with server refactoring

* refactor: shared server module (#1210)

* chore: resolve main

* chore: update makefile

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: hiro <vuonghoainam.work@gmail.com>
2023-12-28 17:57:39 +07:00
Louis
8d5fce9165
fix: malicious redirections & security risk 2023-12-21 14:10:33 +07:00
Louis
e0370210a7
fix: #1096 yield error message upon thread switching (#1109) 2023-12-20 14:58:47 +07:00
Louis
4653030bc1
fix: #1097 streaming response is replaced by error message (#1099) 2023-12-19 16:42:13 +07:00
0xSage
c556427905 more copy nits 2023-12-15 16:33:49 +08:00
Louis
cf7e9350b7 fix: show proper error message 2023-12-15 14:14:59 +07:00
Faisal Amir
4f41dab9b5 feat: move stop inference button into the send button 2023-12-14 16:40:51 +07:00
Louis
3266014b29
fix: 963 can not run openai models on windows (#974) 2023-12-13 16:26:26 +07:00
hiro
16c66e968c chore: Update n_threads to cpu_threads 2023-12-12 06:15:22 +07:00
NamH
121dc119f1
feat: adding model params (#886)
* feat: adding model params

Signed-off-by: James <james@jan.ai>

* chore: inference request parameter

* Improve ui right panel model params

* Remove unused import

* Update slider track for darkmode

---------

Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
2023-12-11 23:58:24 +07:00
hiro
0522d2fe4d fix: inference openai compatible accepts parameters 2023-12-10 20:16:19 +07:00
hiro
bbffaafcdc feat: Added support for Azure OpenAI API 2023-12-09 00:56:39 +07:00
hiro
7e3e648e2a fix: inference extensions small syntax fix 2023-12-09 00:56:24 +07:00
hiro
f9e73b0bbd fix: Change base_url to full_url 2023-12-08 23:07:30 +07:00
Louis
b939692187 chore: stop inference event 2023-12-08 23:07:30 +07:00
hiro
1177007ad6 fix: Update code based on comments from @james 2023-12-08 23:07:30 +07:00
hiro
e1190ec41c fix: Enforce openai inference to load settings from openai.json onLoad and onModelInit 2023-12-08 23:06:49 +07:00
hiro
f34024a329 fix: spreading model.paramters object and update chatCompletion route 2023-12-08 23:06:49 +07:00
hiro
7ed8c31629 fix: Add dynamic values from engine settings and model params 2023-12-08 23:06:49 +07:00
hiro
16f2ffe9b4 fix: Add dynamic values from engine settings and model params to inference request 2023-12-08 23:06:49 +07:00
hiro
516e226290 chore: Move interface definition location 2023-12-08 23:06:49 +07:00
hiro
486c5b8ca0 fix: Update openai with read/ write for engine.json 2023-12-08 23:06:49 +07:00
hiro
8ab36d7cb2 feat: Add openai engine json reader and writer 2023-12-08 23:06:08 +07:00
hiro
9a18d3133c chore: refactor openai file structure 2023-12-08 23:06:08 +07:00
hiro
d69f0e3321 chore: Update openai engine 2023-12-08 23:06:08 +07:00
hiro
48fd8de30c feat: Init commit for inference engine for openai extension 2023-12-08 23:06:08 +07:00