* feat: integrating cortex
* Temporary prevent crash
Signed-off-by: James <namnh0122@gmail.com>
* fix yarn lint
Signed-off-by: James <namnh0122@gmail.com>
* refactor: remove core node module - fs - extensions and so on (#3151)
* add migration script for threads, messages and models
Signed-off-by: James <namnh0122@gmail.com>
* remove freq_penalty and presence_penalty if model not supported
Signed-off-by: James <namnh0122@gmail.com>
* add back models in my models
Signed-off-by: James <namnh0122@gmail.com>
* fix api-url for setup API key popup
Signed-off-by: James <namnh0122@gmail.com>
* fix using model name for dropdown model
Signed-off-by: James <namnh0122@gmail.com>
* fix can't click to hotkey
Signed-off-by: James <namnh0122@gmail.com>
* fix: disable some UIs
Signed-off-by: James <namnh0122@gmail.com>
* fix build
Signed-off-by: James <namnh0122@gmail.com>
* reduce calling HF api
Signed-off-by: James <namnh0122@gmail.com>
* some ui update
Signed-off-by: James <namnh0122@gmail.com>
* feat: modal migration UI (#3153)
* feat: handle popup migration
* chore: update loader
* chore: integrate script migration
* chore: cleanup import
* chore: moving out spinner loader
* chore: update check thread message success migrate
* chore: add handle script into retry button
* remove warning from joi
Signed-off-by: James <namnh0122@gmail.com>
* chore: fix duplicate children
* fix: path after migrating model
Signed-off-by: James <namnh0122@gmail.com>
* chore: apply mutation for config
* chore: prevent calling too many create assistant api
Signed-off-by: James <namnh0122@gmail.com>
* using cortexso
Signed-off-by: James <namnh0122@gmail.com>
* update download api
Signed-off-by: James <namnh0122@gmail.com>
* fix use on slider item
Signed-off-by: James <namnh0122@gmail.com>
* fix: ui no download model or simple onboarding (#3166)
* fix download huggingface model match with slider item
Signed-off-by: James <namnh0122@gmail.com>
* update owner_logo to logo and author
Signed-off-by: James <namnh0122@gmail.com>
* update new cortexso
Signed-off-by: James <namnh0122@gmail.com>
* Add install python step for macos
* add engine table
Signed-off-by: James <namnh0122@gmail.com>
* fix local icons
Signed-off-by: James <namnh0122@gmail.com>
* feat: add search feature for model hub
Signed-off-by: James <namnh0122@gmail.com>
* fix misalign switch
Signed-off-by: James <namnh0122@gmail.com>
* fix: delete thread not focus on other thread
Signed-off-by: James <namnh0122@gmail.com>
* add get model from hugging face
Signed-off-by: James <namnh0122@gmail.com>
* fix download from hugging face
Signed-off-by: James <namnh0122@gmail.com>
* small update
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* fix system monitor rounded only on the left
Signed-off-by: James <namnh0122@gmail.com>
* chore: update ui new hub screen (#3174)
* chore: update ui new hub screen
* chore: update layout centerpanel thread and hub screen
* chore: update detail model by group
* update cortexso 0.1.13
Signed-off-by: James <namnh0122@gmail.com>
* chore: add file size
Signed-off-by: James <namnh0122@gmail.com>
* chore: put engine to experimental feature
Signed-off-by: James <namnh0122@gmail.com>
* chore: open cortex folder
Signed-off-by: James <namnh0122@gmail.com>
* chore: add back user avatar
Signed-off-by: James <namnh0122@gmail.com>
* chore: minor UI hub (#3182)
* chore: add back right click thread list and update 3 dots are overlapping with the text
* chore: update position dropdown list my models
* chore: make on-device tab showing 6 items instead of 4
* chore: update style description modals detail model
* chore: update isGeneration loader and author name on modal
* feat: integrate cortex single executable
Signed-off-by: James <namnh0122@gmail.com>
* fix build
Signed-off-by: James <namnh0122@gmail.com>
* chore: added blank state
* chore: update ui component blank state
* bump cortex binary version
* fix: logic show modal migration (#3165)
* fix: logic show modal migration
* chore: fixed logic
* chore: read contain format gguf local models
* chore: change return hasLocalModel
* chore: intiial skipmigration state
* chore: filter embedding model
* fix: delete top thread not focus on any other thread
* chore: added UI no result component search models group (#3188)
* fix: remote model should show all when user config that engine
Signed-off-by: James <namnh0122@gmail.com>
* chore: set state thread and models migration using getOnInit (#3189)
* chore: set state thread and models migration using getOnInit
* chore: add state as dependecies hooks
* chore: system monitor panel show engine model (#3192)
* fix: remove config api, replace with engine
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* update reactquery
Signed-off-by: James <namnh0122@gmail.com>
* bump cortex 0.4.35
* feat: add waiting for cortex popup
Signed-off-by: James <namnh0122@gmail.com>
* chore: add loader detail model popup (#3195)
* chore: model start loader (#3197)
* chore: added model loader when user starting chat without model active
* chore: update copies loader
* fix: select min file size if recommended quant does not exist
Signed-off-by: James <namnh0122@gmail.com>
* chore: temporary hide gpu config
* fix: tensorrt not shown
Signed-off-by: James <namnh0122@gmail.com>
* fix lint
Signed-off-by: James <namnh0122@gmail.com>
* fix tests
Signed-off-by: James <namnh0122@gmail.com>
* fix e2e tests (wip)
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* fix: adding element and correct test to adapt new UI
* fix: temp skip unstable part
* fix: only show models which can be supported
Signed-off-by: James <namnh0122@gmail.com>
* Update version.txt
* update send message
Signed-off-by: James <namnh0122@gmail.com>
* fix: not allow user send message when is generating
Signed-off-by: James <namnh0122@gmail.com>
* chore: temp skip Playwright test due to env issue
* chore: temp skip Playwright test due to env issue
* update
Signed-off-by: James <namnh0122@gmail.com>
* chore: minor-ui-feedback (#3202)
---------
Signed-off-by: James <namnh0122@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
Co-authored-by: Van-QA <van@jan.ai>
* Add new feat: Inference Mistral extension
* change settings
* nitpicking fix
* fix model position and add mistral registerModel
* remove irrelevant changes
* change desc of mistral medium
Co-authored-by: Louis <louis@jan.ai>
* change desc of mistral small
Co-authored-by: Louis <louis@jan.ai>
* change desc of mistral large
Co-authored-by: Louis <louis@jan.ai>
* remove unpopular mistral model
* replace placeholder
* sort remaining models using size
---------
Co-authored-by: Jack Tri Le <Jack>
Co-authored-by: Louis <louis@jan.ai>
* Rearrange model position in Hub page
* fix linting
* Update web/screens/ExploreModels/ExploreModelList/index.tsx
Co-authored-by: Louis <louis@jan.ai>
---------
Co-authored-by: Jack Tri Le <Jack>
Co-authored-by: Louis <louis@jan.ai>
* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat: add quick ask
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: add vulkan support on windows and linux
* fix: correct vulkan settings
* fix: gpu settings and enable Vulkan support
* fix: vulkan support 1 device at a time only
* inference-nitro-extension add download vulkaninfo
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: clean up code and remove some lint suppression
Signed-off-by: James <james@jan.ai>
* Update .gitignore
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: allow self-signed certificates
* fix: Extra information in self signed error
* chore: simplified PR
* feat: allow https proxies
* fix: trim() may save one or two user headaches
* Update web/context/FeatureToggle.tsx
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
* feat: adding create bot functionality
Signed-off-by: James <james@jan.ai>
* update the temperature progress bar
Signed-off-by: James <james@jan.ai>
* chore: remove tgz
Signed-off-by: James <james@jan.ai>
* update core dependency
Signed-off-by: James <james@jan.ai>
* fix e2e test
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* @janhq/plugin-core module
* refactor web to use exported services from module
* refactor data-plugin to provide DAL & move model logics to model management plugin
* model-management in TS
* add ci auto package, increate version, and publish to npm repository
* chore: storage operations
* chore: hybrid data-plugin esm & cjs module
* chore: PouchDB Driver
* chore: documentation
---------
Co-authored-by: Hien To <hien@jan.ai>
Co-authored-by: Service Account <service@jan.ai>
* chore: notarize Jan app for macos distribution
* chore: fix entitlements path
* chore: update notarize package
* chore: update post signing hook
* chore: use built-in notarize tool
* chore: update entitlements
* chore: binary code sign
* add auto signing binary file script
* Separate build:plugins for darwin os
---------
Co-authored-by: Hien To <>
* refactor: move Electron app to main directory and enforce ts strict mode
* chore: add pre-install plugins
* remove duplicated initModel function
Signed-off-by: James <james@jan.ai>
* chore: correct module path
* fix: dynamic import does not work with ts
* chore: web should be able to run on target host browser
* fix: history panel, should display conversations rather just blank state
* chore: init default model
* chore: pluggin in ts
* fix: pre-pack model management
* fix: compiled core should not include plugins
* chore: refactor - invoke plugin function
* refactor download/delete file
Signed-off-by: James <james@jan.ai>
* update prebuild lib
Signed-off-by: James <james@jan.ai>
* chore: yarn workspace
* chore: update yarn workspace
* chore: yarn workspace with nohoist
* fix: llama-cpp-import
* chore: fix data-plugin wrong module path
* chore: correct build step
* chore: - separate inference service (#212)
- remove base-plugin
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* chore: update core plugins
* chore: hide installation prompt and fix model load - management plugin
* chore: remove legacy files; update readme
* fix: refresh page lost the download state
Signed-off-by: James <james@jan.ai>
* fix: ai prompt not passed to plugin
Signed-off-by: James <james@jan.ai>
* chore: module import fix for production
* chore: auto updater
* chore: package is public
* chore: fix yarn workspace config
* update: model management uses Q4_K_M
* chore: fix yarn scripts for publishing
* chore: app updater - progress update message
* chore: user confirms update action
* adding some state for changing page
store downloaded model to database
Signed-off-by: James <james@jan.ai>
* chore: refactor plugins into yarn workspace - a single command to publish all base plugins
* chore update readme (#218)
Co-authored-by: Hien To <tominhhien97@gmail.com>
* change app name and app icon
Signed-off-by: James <james@jan.ai>
* remove: go-to-nowhere actions
* chore: bundle core plugins from root and scan default plugins
* fix: app crashes on different field name lookup
* chore: css fix
* chore: bind download progress to app ui
* chore: bind active model
* chore: simplify app splash-screen only centered jan icon
* feature: system monitoring plugin (#196)
* feat: Add function for system monitoring
* chore: register plugin functions
* chore: move to corresponding directory
* chore: bind system monitoring data to UI
---------
Co-authored-by: Louis <louis@jan.ai>
* chore: add build:plugins step to README
* chore: model searching and fix model name
* fix: plugin file selected appearance
* fix: create new conversation does not work
* fix: delete conversation not update state - messages still exist
* chore: fix asset path prefix
* Add CICD for macos (#221)
Co-authored-by: Hien To <tominhhien97@gmail.com>
* chore: fix production plugin path
* chore: add shell open url in external browser
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: 0xSage <n@pragmatic.vc>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: namvuong <22463238+vuonghoainam@users.noreply.github.com>
* hackathon: Refactor Jan into an Electron app
* chore: correct NextJS export output path
* chore: build electron app for all production targets
* fix: correct assetPrefix for production build
* chore: preferences shortcut
* chore: refactor
* chore: refactor into ts
* feature/#52-compile-plugin-with-webpack
* chore: introduce renderer <=> plugins <=> main invocation
* chore: suppress errors - deprecate graphql & next-auth
* chore: data plugin functions
* add llm support
Signed-off-by: James <james@jan.ai>
* chore: update plugin
* chore: introduce data-plugin
* chore: plugin invokes main with args and synchronously
* chore: install db plugin should setup db
* feature: Data Driver Plugin - Load conversations and messages from data plugin
* chore: store text message sent
* chore: shared core services
* feature: inference service
* chore: conversations ordering
* adding model management service
Signed-off-by: James <james@jan.ai>
* chore: strict type
* feature: abstract plugin preferences
* chore: abstract plugin preference
* Revert "chore: strict type"
This reverts commit 9be188d827a0b2e081e9e04b192c323799de5bb5.
* chore: base-plugin styling
* feature: create and delete conversation
* chore: fix plugin search & clean messages
* chore: typing indicator
* chore: refactor useSendChatMessage
* chore: persists inserted id to in-memory messages
* chore: search conversation history
* add delete and download model (#189)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
* chore: add empty state for conversation list
* chore: prompt missing extension function & fix app crashes
* chore: prompt user to install required plugins
* chore: add launch background
* chore: relaunch app on model downloaded
* Jan app add installation instruction (#191)
Co-authored-by: Hien To <>
* Chore: rename folder web-client to app (#192)
* Chore: rename folder web-client to app
---------
Co-authored-by: Hien To <>
* revert: add pre-install package
* add progress for downloading model
Signed-off-by: James <james@jan.ai>
* feature: production bundle
* add download progress
Signed-off-by: James <james@jan.ai>
* chore: add new chat function
* fix: electron asar unpack modules & dynamic import
* chore: fix unpack
* chore: fix dev pack
* Add instruction to build dmg file to README.md
* init model dynamically
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <>
