3 Commits

Author SHA1 Message Date
Louis
537ef20a54
chore: replace nitro by cortex-cpp (#2912) 2024-05-16 17:46:49 +07:00
hiento09
5fd6025175
Bump nitro version to 0.3.18 (#2652) 2024-04-09 12:31:10 +07:00
Louis
acbec78dbf
fix: refactor inference engines to extends AIEngine (#2347)
* fix: refactor nitro to extends localoaiengine

* fix: refactor openai extension

* chore: refactor groq extension

* chore: refactor triton tensorrt extension

* chore: add tests

* chore: refactor engines
2024-03-22 09:35:14 +07:00