* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat: wip ui jan folder setting
* change input disabled
* finished change directory jan folder
* fix overlap value input current path folder
* make app reload to latest page
* fix: add experimental feature toggle til the next release
---------
Co-authored-by: Louis <louis@jan.ai>
* feat: allow self-signed certificates
* fix: Extra information in self signed error
* chore: simplified PR
* feat: allow https proxies
* fix: trim() may save one or two user headaches
* Update web/context/FeatureToggle.tsx
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
## Description
According to #1287, the web version will be updated accordingly. There is no need to use the electron app version anymore. It's to reduce the IPC dependency and reduce requests.
* refactor: deprecate invokers
* refactor: define routes and auto proxying routes
* refactor: declare types for APIs, avoid making dynamic calls to any functions from the web
* chore: deprecate route handling from preload script
* refactor: deprecate unused apis
* Make thread screen as default screen
* Blank state when user have not any model
* Cleanup topbar thread screen
* Improve style right panel
* Add instructions right panel
* Styling thread list history
* Resolve conflict
* Default title new thread
* Fix trigger panel sidebar
* Make default right panel false when no activethread
* Fix CI test
* chore: assistant instruction with system prompt
* Fix title and blank state explore the hub
* Claenup style thread screen and add buble message for assitant
* Remove unused import
* Styling more menus on thread list and right panel, and make max height textarea 400 pixel
* Finished revamp ui thread
* Finished system monitor UI
* Style box running models
* Make animate right panel more smooth
* Add status arround textarea for starting model info
* Temporary disable hide left panel
* chore: system resource monitoring update
* copy nits
* chore: typo
* Reverse icon chevron accordion
* Move my models into setting page
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: 0xSage <n@pragmatic.vc>
