11 Commits

Author	SHA1	Message	Date
hiro	16c66e968c	chore: Update n_threads to cpu_threads	2023-12-12 06:15:22 +07:00
NamH	121dc119f1	feat: adding model params (#886) ... * feat: adding model params Signed-off-by: James <james@jan.ai> * chore: inference request parameter * Improve ui right panel model params * Remove unused import * Update slider track for darkmode --------- Signed-off-by: James <james@jan.ai> Co-authored-by: James <james@jan.ai> Co-authored-by: Louis <louis@jan.ai> Co-authored-by: Faisal Amir <urmauur@gmail.com>	2023-12-11 23:58:24 +07:00
Louis	b939692187	chore: stop inference event	2023-12-08 23:07:30 +07:00
hiro	1177007ad6	fix: Update code based on comments from @james	2023-12-08 23:07:30 +07:00
hiro	9daee14167	fix: Add hack waiting for model loading	2023-12-08 23:06:49 +07:00
hiro	3987fdc95b	feat: Add nitro inference engine stop model handler	2023-12-08 23:06:49 +07:00
hiro	0c3e23665b	fix: Add dynamic values from engine settings and model params	2023-12-08 23:06:49 +07:00
hiro	2c648caa5f	fix: Update nitro with read/ write for engine.json	2023-12-08 23:06:49 +07:00
hiro	56b778675f	feat: Add nitro engine json reader and writer	2023-12-08 23:06:08 +07:00
hiro	337da50840	fix: Add fs to read and write nitro engine settings	2023-12-08 23:06:08 +07:00
hiro	c01737ff69	refactor: Change inference-extension to inference-nitro-extension	2023-12-08 23:06:08 +07:00