* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* fix: reduce the number of api call
Signed-off-by: James <james@jan.ai>
* fix: download progress
Signed-off-by: James <james@jan.ai>
* chore: save blob
* fix: server boot up
* fix: download state not updating
Signed-off-by: James <james@jan.ai>
* fix: copy assets
* Add Dockerfile CPU for Jan Server and Jan Web
* Add Dockerfile GPU for Jan Server and Jan Web
* feat: S3 adapter
* Update check find count from ./pre-install and correct copy:asserts command
* server add bundleDependencies @janhq/core
* server add bundleDependencies @janhq/core
* fix: update success/failed download state (#1945)
* fix: update success/failed download state
Signed-off-by: James <james@jan.ai>
* fix: download model progress and state handling for both Desktop and Web
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: refactor
* fix: load models empty first time open
* Add Docker compose
* fix: assistants onUpdate
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
chore: Update new model.json with multiple binaries
feat: Add updates for handling multiple model binaries
chore: jan can see
Update Model.json (#1005)
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* chore: model desc nits
* fix(models): adjust the size for solars and pandoras
* add(mixtral): description
---------
Co-authored-by: 0xSage <n@pragmatic.vc>
chore: reformat model.json and use new template
fix(Model): download/abort model (#1163)
* fix(Model): download/abort model
* fix: image preview
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
add preview and reduce time re-render all chat screen
Signed-off-by: James <james@jan.ai>
store files under thread_id/files
Signed-off-by: James <james@jan.ai>
fix: Update llava 1.5 size
fix: Nitro extension path resolver
feat: Add upload preview clearance
chore: Update FileType to multiple targets
fix: delete file preview once new thread created
chore: Add langchain import
support storing pdf file
Signed-off-by: James <james@jan.ai>
feat: add retrieval tool in node runtime
fix: import module done
Co-authored-by: Louis <louis-jan@users.noreply.github.com>
feat: Add type assistant tool
chore: Add tool_retrieval_enabled to InferenceEngine
chore: Add AssistantTool to thread entity
chore: refactor tool retrieval base class
feat: Add handler for assistant with rag enabled
chore: Update inferenceEngine type properly
chore: Update inferenceEngine type properly
fix: Update retrieval tool
chore: main entry correction
refactor: tsconfig files
chore: Update ModelRuntimeParams type
refactor: Remove unused files
fix: wip
chore: remove unused console.log for FileUploadPreview
fix: Update mapping correctly for engine and proxyEngine
feat: Add proxyEngine to type ModelInfo
fix: WIP with test route
fix: Add bundleDependencies to package.json
chore: remove conversational history memory
fix: refactor data passing
reafactor: remove unused code
fix: Update module
chore: export import correction
fix conflict
Signed-off-by: James <james@jan.ai>
fix: resolve after rebased
fix: Update llava 1.5 model json
feat: Add bakllava 1 model json
refactor: node module export, ES syntax and langchain import
fix: WIP
fix: WIP
fix: WIP
fix: external module import
fix: WIP
Add UI attachment fot file upload
Prepare Thumbnail UI image
chore: rebase model folder to dev branch
chore: remove multiple binaries related commits
fix: remove multiple binaries related commits part 2
fix: Remove transformer.js related deps
Fix truncate file name attachment
remove unused code image preview attachment
fix: remove multi binaries error
chore: remove commented code for ModelArtifacts type
Dropzone for drag and drop attachment
Avoid conditional showing 0 using length
fix symbol windows
avoid undefined tools
fix: add tool retrieval to true by default and disable the change
chore: remove unused code
fix: Enable nitro embedding by default
fix: Update code WIP with nitro embedding
chore: remove unused running function
fix: assistant extension missing module
feat: Retrieval ingest, query and reforward
fix: Update hnswlib version conflict
fix: Add tool settings
fix: Update path to thread_id/memory
fix: Add support for nitro embedding usage
fix: RAG does not work with plain content message
fix(Model): #1662 imported model does not use gpu (#1723)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
feat: allow users to update retrieval settings
chore: pass thread assistant settings to assistant extensions
chore: eslint fix
fix bug border right panel showing in thread while not have active thread
Update setting layout retrieval assistant
Renaming file settingcomponent
change default value in core extention
add fake loader generate response
fix conditional fake loader
remove unused import
Proper error message on file typr
fix: loading indicator
fix: chunk size and overlap constraint
conditional drag and drop when retrieval off
fix: enable retrieval middleware as soon as its tool is enabled
fix: configure embedding engine according to request
fix: Retrieval false by default
fix: engine json
chore: migrate assistant
disabled collapse panel when retrieval or children null
chore: remove unused log
chore: Bump nitro version to 0.2.14 for batch embedding
chore: remove unused console.log
* Make thread screen as default screen
* Blank state when user have not any model
* Cleanup topbar thread screen
* Improve style right panel
* Add instructions right panel
* Styling thread list history
* Resolve conflict
* Default title new thread
* Fix trigger panel sidebar
* Make default right panel false when no activethread
* Fix CI test
* chore: assistant instruction with system prompt
* Fix title and blank state explore the hub
* Claenup style thread screen and add buble message for assitant
* Remove unused import
* Styling more menus on thread list and right panel, and make max height textarea 400 pixel
* Finished revamp ui thread
* Finished system monitor UI
* Style box running models
* Make animate right panel more smooth
* Add status arround textarea for starting model info
* Temporary disable hide left panel
* chore: system resource monitoring update
* copy nits
* chore: typo
* Reverse icon chevron accordion
* Move my models into setting page
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: 0xSage <n@pragmatic.vc>
* refactor: model plugin to follow new specs
Signed-off-by: James <james@jan.ai>
* chore: rebase main
chore: rebase main
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: move necessary files to jan root
Signed-off-by: James <james@jan.ai>
* chore: check model dir
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* Eslint import order
* Initial Uikit
* Rename file with camelCase
* Remove unused code
* Remove unused code
* Set position traficlight mac
* Grouping Ribbon, Topbar and Bottombar as layout
* Added image brand
* Moving feature toggle into context folder
* Fix active state of setting menu
* Cleanup downloadModel atom helper
* Cleanup useGetConfigureModel
* Added wave animation
* Create useMainViewState intead of import helper atom
* Remove unused code
* Take a back switch ui
* Toggle using switch component
* Add dynamic primary color
* Cleanup import
* Added uikit scroll area
* Add best practice form
* Added toaster container
* Fix loader container
* Add hooks useDownloadState
* Added tooltip on ribbon menu
* Added case user multiple download model
* Adjust input style with bigger ring
* Restyle my model screen
* Replace useStartStop model with useActiveModel
* Import icon using Icon name
* Fix missing login loading start and stop model
* WIP integrate with cmdk
* Move layout search bar on middle of app
* Added function cancel download
* Cleanup model explore
* Cleanup unused code
* Move app version in bototmbar or footer
* WIP chat screen
* WIP chat screen
* Cleanup style and remove unsed code
* Added command for showing downloaded model
* Fix missing keyframe loader dot animation
* Conditional loader of plugin setting
* WIP history list message
* chore: rebase main
* Adding script ui into root package
* Fix different version react hooks form
* Add close toaster
* Added status model active or not on list of command
* Conditional showing info if user don't have a model
* Disabled toolbar chat when user not yet have convo
* chore: fix state
* fix: get resource atom
* Fix conditional bottom bar
* fix: model download state
* Fix font
* Improve icon my model
* Add toaster delete chat
* Remove test classname
* Fix scroll chat body
* Fix scrolling chat body
* chore: add message update
* Add uikit into depedencies on root package
* Update chat flow
* Fix hot reload ui changes
* Increate background color chat screen light mode
* Added visual conversation active state
* Added build:uikit on gh actions
* chore: attempt to fix CI
* fix: deps
* fix: tests
* chore: attempt to fix CI
---------
Co-authored-by: Louis <louis@jan.ai>
