20 Commits

Author SHA1 Message Date
hiro
7e3e648e2a fix: inference extensions small syntax fix 2023-12-09 00:56:24 +07:00
hiro
c32ad0aff7 fix: small change in nitro bin location 2023-12-09 00:42:48 +07:00
hiro
0ef9a581d3 fix: BAT for nitro 2023-12-09 00:36:55 +07:00
Louis
b939692187 chore: stop inference event 2023-12-08 23:07:30 +07:00
hiro
1177007ad6 fix: Update code based on comments from @james 2023-12-08 23:07:30 +07:00
hiro
9daee14167 fix: Add hack waiting for model loading 2023-12-08 23:06:49 +07:00
hiro
5f3cf2bcce fix: Temporary disable model parameters spreading 2023-12-08 23:06:49 +07:00
hiro
3987fdc95b feat: Add nitro inference engine stop model handler 2023-12-08 23:06:49 +07:00
hiro
44bfcaabd9 fix: Add type def global for nitro extension - inference 2023-12-08 23:06:49 +07:00
hiro
a2cf42ac76 fix: Spreading model.parameters 2023-12-08 23:06:49 +07:00
hiro
0c3e23665b fix: Add dynamic values from engine settings and model params 2023-12-08 23:06:49 +07:00
hiro
4f2a3b7b27 fix: Add dynamic values from engine settings and model params to inference request 2023-12-08 23:06:49 +07:00
hiro
b970e97869 chore: Move interface definition location 2023-12-08 23:06:49 +07:00
hiro
2c648caa5f fix: Update nitro with read/ write for engine.json 2023-12-08 23:06:49 +07:00
hiro
56b778675f feat: Add nitro engine json reader and writer 2023-12-08 23:06:08 +07:00
hiro
68ee6693ba chore: Remove default nitro.json file 2023-12-08 23:06:08 +07:00
hiro
6d3bf24d5c chore: remove gitkeep 2023-12-08 23:06:08 +07:00
hiro
337da50840 fix: Add fs to read and write nitro engine settings 2023-12-08 23:06:08 +07:00
hiro
19637c40bf feat: Add nitro engine settings 2023-12-08 23:06:08 +07:00
hiro
c01737ff69 refactor: Change inference-extension to inference-nitro-extension 2023-12-08 23:06:08 +07:00