* refactor: different Jan instances should have different Cortex server port configurations
* chore: update workflow to use env input
* chore: update env for cortex port setting
* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* Web: change API_BASE_URL to build time env
* Update Dockerfile and Docker Compose by adding env API_BASE_URL
* Update make clean
* INFERENCE_URL get from baseApiUrl
* Fix error settings/settings.json not found when start server at the first time
* Update README docker
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
* fix: reduce the number of api call
Signed-off-by: James <james@jan.ai>
* fix: download progress
Signed-off-by: James <james@jan.ai>
* chore: save blob
* fix: server boot up
* fix: download state not updating
Signed-off-by: James <james@jan.ai>
* fix: copy assets
* Add Dockerfile CPU for Jan Server and Jan Web
* Add Dockerfile GPU for Jan Server and Jan Web
* feat: S3 adapter
* Update check find count from ./pre-install and correct copy:asserts command
* server add bundleDependencies @janhq/core
* server add bundleDependencies @janhq/core
* fix: update success/failed download state (#1945)
* fix: update success/failed download state
Signed-off-by: James <james@jan.ai>
* fix: download model progress and state handling for both Desktop and Web
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: refactor
* fix: load models empty first time open
* Add Docker compose
* fix: assistants onUpdate
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
chore: Update new model.json with multiple binaries
feat: Add updates for handling multiple model binaries
chore: jan can see
Update Model.json (#1005)
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* chore: model desc nits
* fix(models): adjust the size for solars and pandoras
* add(mixtral): description
---------
Co-authored-by: 0xSage <n@pragmatic.vc>
chore: reformat model.json and use new template
fix(Model): download/abort model (#1163)
* fix(Model): download/abort model
* fix: image preview
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
add preview and reduce time re-render all chat screen
Signed-off-by: James <james@jan.ai>
store files under thread_id/files
Signed-off-by: James <james@jan.ai>
fix: Update llava 1.5 size
fix: Nitro extension path resolver
feat: Add upload preview clearance
chore: Update FileType to multiple targets
fix: delete file preview once new thread created
chore: Add langchain import
support storing pdf file
Signed-off-by: James <james@jan.ai>
feat: add retrieval tool in node runtime
fix: import module done
Co-authored-by: Louis <louis-jan@users.noreply.github.com>
feat: Add type assistant tool
chore: Add tool_retrieval_enabled to InferenceEngine
chore: Add AssistantTool to thread entity
chore: refactor tool retrieval base class
feat: Add handler for assistant with rag enabled
chore: Update inferenceEngine type properly
chore: Update inferenceEngine type properly
fix: Update retrieval tool
chore: main entry correction
refactor: tsconfig files
chore: Update ModelRuntimeParams type
refactor: Remove unused files
fix: wip
chore: remove unused console.log for FileUploadPreview
fix: Update mapping correctly for engine and proxyEngine
feat: Add proxyEngine to type ModelInfo
fix: WIP with test route
fix: Add bundleDependencies to package.json
chore: remove conversational history memory
fix: refactor data passing
reafactor: remove unused code
fix: Update module
chore: export import correction
fix conflict
Signed-off-by: James <james@jan.ai>
fix: resolve after rebased
fix: Update llava 1.5 model json
feat: Add bakllava 1 model json
refactor: node module export, ES syntax and langchain import
fix: WIP
fix: WIP
fix: WIP
fix: external module import
fix: WIP
Add UI attachment fot file upload
Prepare Thumbnail UI image
chore: rebase model folder to dev branch
chore: remove multiple binaries related commits
fix: remove multiple binaries related commits part 2
fix: Remove transformer.js related deps
Fix truncate file name attachment
remove unused code image preview attachment
fix: remove multi binaries error
chore: remove commented code for ModelArtifacts type
Dropzone for drag and drop attachment
Avoid conditional showing 0 using length
fix symbol windows
avoid undefined tools
fix: add tool retrieval to true by default and disable the change
chore: remove unused code
fix: Enable nitro embedding by default
fix: Update code WIP with nitro embedding
chore: remove unused running function
fix: assistant extension missing module
feat: Retrieval ingest, query and reforward
fix: Update hnswlib version conflict
fix: Add tool settings
fix: Update path to thread_id/memory
fix: Add support for nitro embedding usage
fix: RAG does not work with plain content message
fix(Model): #1662 imported model does not use gpu (#1723)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
feat: allow users to update retrieval settings
chore: pass thread assistant settings to assistant extensions
chore: eslint fix
fix bug border right panel showing in thread while not have active thread
Update setting layout retrieval assistant
Renaming file settingcomponent
change default value in core extention
add fake loader generate response
fix conditional fake loader
remove unused import
Proper error message on file typr
fix: loading indicator
fix: chunk size and overlap constraint
conditional drag and drop when retrieval off
fix: enable retrieval middleware as soon as its tool is enabled
fix: configure embedding engine according to request
fix: Retrieval false by default
fix: engine json
chore: migrate assistant
disabled collapse panel when retrieval or children null
chore: remove unused log
chore: Bump nitro version to 0.2.14 for batch embedding
chore: remove unused console.log
* chore: expose fs apis
* chore: correct electron import path
* update download api
Signed-off-by: James <james@jan.ai>
* update chat_completion
Signed-off-by: James <james@jan.ai>
* fix electron import
Signed-off-by: James <james@jan.ai>
* feat: adding API support at 1337 (#991)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: Add /chat/completion api and handler
* chore: add todo for modelList
* chore: read engine.json for openai chat_completion (#1030)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* refactor: move routes to shared node module
* refactor: exported modules from core with types (#1172)
* refactor: exported modules from core with types
* fix: fix file reading args
* refactor: fileManager handles
* fix: app issues with server refactoring
* refactor: shared server module (#1210)
* chore: resolve main
* chore: update makefile
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: hiro <vuonghoainam.work@gmail.com>
* Eslint import order
* Initial Uikit
* Rename file with camelCase
* Remove unused code
* Remove unused code
* Set position traficlight mac
* Grouping Ribbon, Topbar and Bottombar as layout
* Added image brand
* Moving feature toggle into context folder
* Fix active state of setting menu
* Cleanup downloadModel atom helper
* Cleanup useGetConfigureModel
* Added wave animation
* Create useMainViewState intead of import helper atom
* Remove unused code
* Take a back switch ui
* Toggle using switch component
* Add dynamic primary color
* Cleanup import
* Added uikit scroll area
* Add best practice form
* Added toaster container
* Fix loader container
* Add hooks useDownloadState
* Added tooltip on ribbon menu
* Added case user multiple download model
* Adjust input style with bigger ring
* Restyle my model screen
* Replace useStartStop model with useActiveModel
* Import icon using Icon name
* Fix missing login loading start and stop model
* WIP integrate with cmdk
* Move layout search bar on middle of app
* Added function cancel download
* Cleanup model explore
* Cleanup unused code
* Move app version in bototmbar or footer
* WIP chat screen
* WIP chat screen
* Cleanup style and remove unsed code
* Added command for showing downloaded model
* Fix missing keyframe loader dot animation
* Conditional loader of plugin setting
* WIP history list message
* chore: rebase main
* Adding script ui into root package
* Fix different version react hooks form
* Add close toaster
* Added status model active or not on list of command
* Conditional showing info if user don't have a model
* Disabled toolbar chat when user not yet have convo
* chore: fix state
* fix: get resource atom
* Fix conditional bottom bar
* fix: model download state
* Fix font
* Improve icon my model
* Add toaster delete chat
* Remove test classname
* Fix scroll chat body
* Fix scrolling chat body
* chore: add message update
* Add uikit into depedencies on root package
* Update chat flow
* Fix hot reload ui changes
* Increate background color chat screen light mode
* Added visual conversation active state
* Added build:uikit on gh actions
* chore: attempt to fix CI
* fix: deps
* fix: tests
* chore: attempt to fix CI
---------
Co-authored-by: Louis <louis@jan.ai>
* feat: adding create bot functionality
Signed-off-by: James <james@jan.ai>
* update the temperature progress bar
Signed-off-by: James <james@jan.ai>
* WIP baselayout
* Mapping plugins with available preferences
* Added loader component
* WIP working another screen
* Cleanup types and avoid import one by one
* Prepare bottom bar
* Add css variables colors to enable user select the accent
* Enable change accent color
* Seperate css variable
* Fix conflict
* Add blank state of my model empty
* Restyle explore models page
* Enable user config left sidebar
* Restyle my models page
* WIP styling chat page
* Restyling chat message
* Fix conflict
* Adde form preferences setting plugins
* Fixed form bot info
* Sidebar bot chat
* Showing rightbar for both setting when user created bot
* Fix style bot info
* Using overflow auto intead of scroll
* Remove script built UI from root package
* Fix missig import
* Resolve error linter
* fix e2e tests
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* feat: explore plugins from the npm repository and install them remotely
* refactor: clean out redundant codes
* chore: only show update button on different version
* refactor: move Electron app to main directory and enforce ts strict mode
* chore: add pre-install plugins
* remove duplicated initModel function
Signed-off-by: James <james@jan.ai>
* chore: correct module path
* fix: dynamic import does not work with ts
* chore: web should be able to run on target host browser
* fix: history panel, should display conversations rather just blank state
* chore: init default model
* chore: pluggin in ts
* fix: pre-pack model management
* fix: compiled core should not include plugins
* chore: refactor - invoke plugin function
* refactor download/delete file
Signed-off-by: James <james@jan.ai>
* update prebuild lib
Signed-off-by: James <james@jan.ai>
* chore: yarn workspace
* chore: update yarn workspace
* chore: yarn workspace with nohoist
* fix: llama-cpp-import
* chore: fix data-plugin wrong module path
* chore: correct build step
* chore: - separate inference service (#212)
- remove base-plugin
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* chore: update core plugins
* chore: hide installation prompt and fix model load - management plugin
* chore: remove legacy files; update readme
* fix: refresh page lost the download state
Signed-off-by: James <james@jan.ai>
* fix: ai prompt not passed to plugin
Signed-off-by: James <james@jan.ai>
* chore: module import fix for production
* chore: auto updater
* chore: package is public
* chore: fix yarn workspace config
* update: model management uses Q4_K_M
* chore: fix yarn scripts for publishing
* chore: app updater - progress update message
* chore: user confirms update action
* adding some state for changing page
store downloaded model to database
Signed-off-by: James <james@jan.ai>
* chore: refactor plugins into yarn workspace - a single command to publish all base plugins
* chore update readme (#218)
Co-authored-by: Hien To <tominhhien97@gmail.com>
* change app name and app icon
Signed-off-by: James <james@jan.ai>
* remove: go-to-nowhere actions
* chore: bundle core plugins from root and scan default plugins
* fix: app crashes on different field name lookup
* chore: css fix
* chore: bind download progress to app ui
* chore: bind active model
* chore: simplify app splash-screen only centered jan icon
* feature: system monitoring plugin (#196)
* feat: Add function for system monitoring
* chore: register plugin functions
* chore: move to corresponding directory
* chore: bind system monitoring data to UI
---------
Co-authored-by: Louis <louis@jan.ai>
* chore: add build:plugins step to README
* chore: model searching and fix model name
* fix: plugin file selected appearance
* fix: create new conversation does not work
* fix: delete conversation not update state - messages still exist
* chore: fix asset path prefix
* Add CICD for macos (#221)
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: fix production plugin path
* chore: add shell open url in external browser
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: 0xSage <n@pragmatic.vc>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: namvuong <22463238+vuonghoainam@users.noreply.github.com>
