* fix: some regressions for tensorrt nightly build
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: hiro <hiro@jan.ai>
Signed-off-by: James <james@jan.ai>
Co-authored-by: hiro <hiro@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* fix: reduce the number of api call
Signed-off-by: James <james@jan.ai>
* fix: download progress
Signed-off-by: James <james@jan.ai>
* chore: save blob
* fix: server boot up
* fix: download state not updating
Signed-off-by: James <james@jan.ai>
* fix: copy assets
* Add Dockerfile CPU for Jan Server and Jan Web
* Add Dockerfile GPU for Jan Server and Jan Web
* feat: S3 adapter
* Update check find count from ./pre-install and correct copy:asserts command
* server add bundleDependencies @janhq/core
* server add bundleDependencies @janhq/core
* fix: update success/failed download state (#1945)
* fix: update success/failed download state
Signed-off-by: James <james@jan.ai>
* fix: download model progress and state handling for both Desktop and Web
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: refactor
* fix: load models empty first time open
* Add Docker compose
* fix: assistants onUpdate
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat: allow user to move jan folder
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: allow self-signed certificates
* fix: Extra information in self signed error
* chore: simplified PR
* feat: allow https proxies
* fix: trim() may save one or two user headaches
* Update web/context/FeatureToggle.tsx
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
* fix(mistral-ins): clean redundant parameters
* add(yarn-mistral): update new requested model
* fix(trinity-v1): delete trinity v1 from the hub
* add(tulu-2-70b): llama 70b alternative
* fix(lzlv-70b): delete lzlv-70b and changed to tulu-2
* fix(mistral-ins): upgrade model version to v0.2
* fix(model-extention): pump version to 1.0.18
* add(dolphin 8x7b): update the current best moe finetuned model
* add(openchat): the best 7b model
* fix(tinyllama): pump version of the model to v1
* fix(stealth): upgrade stealth to v1.3
* Revert "fix(stealth): upgrade stealth to v1.3"
This reverts commit da24df3fb5d69f93d92cc4dd45f991d548aff6aa.
* fix(stealth): upgrade version to v1.3
* feat(Model): #1028 made model.json optional
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* Add js function to generate gpu and cuda detection
* inference nitro manage via json file instead of bash and bat script
* Add /usr/lib/x86_64-linux-gnu/ to linux check gpu
* chore: add CPU - GPU toggle
* correct file path
* fix: exist file sync check
* fix: get resources path
* Fix error jan/engines create existed error
* Seting sync to file
* Fix error show notification for GPU
* Set notify default to true
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
* chore: expose fs apis
* chore: correct electron import path
* update download api
Signed-off-by: James <james@jan.ai>
* update chat_completion
Signed-off-by: James <james@jan.ai>
* fix electron import
Signed-off-by: James <james@jan.ai>
* feat: adding API support at 1337 (#991)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: Add /chat/completion api and handler
* chore: add todo for modelList
* chore: read engine.json for openai chat_completion (#1030)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* refactor: move routes to shared node module
* refactor: exported modules from core with types (#1172)
* refactor: exported modules from core with types
* fix: fix file reading args
* refactor: fileManager handles
* fix: app issues with server refactoring
* refactor: shared server module (#1210)
* chore: resolve main
* chore: update makefile
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: hiro <vuonghoainam.work@gmail.com>
