15 Commits

Author SHA1 Message Date
hiro
257011309f fix: Kill nitro many times app onDispose 2023-12-13 16:47:34 +07:00
hiro
96fa392fba
Update extensions/inference-nitro-extension/src/module.ts
Co-authored-by: Louis <louis@jan.ai>
2023-12-13 16:40:56 +07:00
hiro
539f11e583 feat: Add api to kill nitro 2023-12-13 16:35:59 +07:00
hiro
5f404e2c3f
feat: Add prompt template resolver feature to system_prompt, ai_prompt, user_prompt 2023-12-13 14:29:34 +07:00
hiro
14f83ddb70 fix: Revert drogon thread to 1 instead of CPU num 2023-12-12 07:27:25 +07:00
hiro
16c66e968c chore: Update n_threads to cpu_threads 2023-12-12 06:15:22 +07:00
hiro
0e63689eae fix: inference engine nitro stopModel undefined in module.ts 2023-12-12 06:15:22 +07:00
hiro
f528e9ea77 fix: Update inference nitro with n_threads equals to physcial core num 2023-12-12 06:15:22 +07:00
hiro
cafdaaaccd feat: Nitro sensing hardware init 2023-12-12 06:15:22 +07:00
hiro
1177007ad6 fix: Update code based on comments from @james 2023-12-08 23:07:30 +07:00
hiro
3987fdc95b feat: Add nitro inference engine stop model handler 2023-12-08 23:06:49 +07:00
hiro
0c3e23665b fix: Add dynamic values from engine settings and model params 2023-12-08 23:06:49 +07:00
hiro
2c648caa5f fix: Update nitro with read/ write for engine.json 2023-12-08 23:06:49 +07:00
hiro
337da50840 fix: Add fs to read and write nitro engine settings 2023-12-08 23:06:08 +07:00
hiro
c01737ff69 refactor: Change inference-extension to inference-nitro-extension 2023-12-08 23:06:08 +07:00