Louis
e0370210a7
fix : #1096 yield error message upon thread switching ( #1109 )
2023-12-20 14:58:47 +07:00
Louis
4653030bc1
fix : #1097 streaming response is replaced by error message ( #1099 )
2023-12-19 16:42:13 +07:00
Faisal Amir
4f41dab9b5
feat: move stop inference button into the send button
2023-12-14 16:40:51 +07:00
hiro
16c66e968c
chore: Update n_threads to cpu_threads
2023-12-12 06:15:22 +07:00
NamH
121dc119f1
feat: adding model params ( #886 )
...
* feat: adding model params
Signed-off-by: James <james@jan.ai>
* chore: inference request parameter
* Improve ui right panel model params
* Remove unused import
* Update slider track for darkmode
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
2023-12-11 23:58:24 +07:00
Louis
b939692187
chore: stop inference event
2023-12-08 23:07:30 +07:00
hiro
1177007ad6
fix: Update code based on comments from @james
2023-12-08 23:07:30 +07:00
hiro
9daee14167
fix: Add hack waiting for model loading
2023-12-08 23:06:49 +07:00
hiro
3987fdc95b
feat: Add nitro inference engine stop model handler
2023-12-08 23:06:49 +07:00
hiro
0c3e23665b
fix: Add dynamic values from engine settings and model params
2023-12-08 23:06:49 +07:00
hiro
2c648caa5f
fix: Update nitro with read/ write for engine.json
2023-12-08 23:06:49 +07:00
hiro
56b778675f
feat: Add nitro engine json reader and writer
2023-12-08 23:06:08 +07:00
hiro
337da50840
fix: Add fs to read and write nitro engine settings
2023-12-08 23:06:08 +07:00
hiro
c01737ff69
refactor: Change inference-extension to inference-nitro-extension
2023-12-08 23:06:08 +07:00
