* fix: update new api from cortex to support 0.5.0
Signed-off-by: James <namnh0122@gmail.com>
* fix stop button for streaming
Signed-off-by: James <namnh0122@gmail.com>
* fix stop inference for nonstreaming
Signed-off-by: James <namnh0122@gmail.com>
* chore: remove umami prevent tracking call to vercel
Signed-off-by: James <namnh0122@gmail.com>
* add warning modal when running more than 2 model concurrently
Signed-off-by: James <namnh0122@gmail.com>
* fix: skip summarize if abort
Signed-off-by: James <namnh0122@gmail.com>
* 0.5.0-3
* add inference error popup
Signed-off-by: James <namnh0122@gmail.com>
* add back import local model
Signed-off-by: James <namnh0122@gmail.com>
* fix: max token issue (#3225)
Signed-off-by: James <namnh0122@gmail.com>
* format status
Signed-off-by: James <namnh0122@gmail.com>
* fix migration missing instructions
Signed-off-by: James <namnh0122@gmail.com>
* fix: wait for cortex process overlay should be on top (#3224)
* fix: wait for cortex process overlay should be on top
* chore: update cortex.js
* Cortex 0.5.0-5
* add import model to my model screen
Signed-off-by: James <namnh0122@gmail.com>
* fix: should migrate symlink models (#3226)
* fix import on windows (#3229)
Signed-off-by: James <namnh0122@gmail.com>
* fix yarn lint
Signed-off-by: James <namnh0122@gmail.com>
* fix: clean up port before start jan (#3232)
Signed-off-by: James <namnh0122@gmail.com>
---------
Signed-off-by: James <namnh0122@gmail.com>
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
Co-authored-by: Louis <louis@jan.ai>
* feat: integrating cortex
* Temporary prevent crash
Signed-off-by: James <namnh0122@gmail.com>
* fix yarn lint
Signed-off-by: James <namnh0122@gmail.com>
* refactor: remove core node module - fs - extensions and so on (#3151)
* add migration script for threads, messages and models
Signed-off-by: James <namnh0122@gmail.com>
* remove freq_penalty and presence_penalty if model not supported
Signed-off-by: James <namnh0122@gmail.com>
* add back models in my models
Signed-off-by: James <namnh0122@gmail.com>
* fix api-url for setup API key popup
Signed-off-by: James <namnh0122@gmail.com>
* fix using model name for dropdown model
Signed-off-by: James <namnh0122@gmail.com>
* fix can't click to hotkey
Signed-off-by: James <namnh0122@gmail.com>
* fix: disable some UIs
Signed-off-by: James <namnh0122@gmail.com>
* fix build
Signed-off-by: James <namnh0122@gmail.com>
* reduce calling HF api
Signed-off-by: James <namnh0122@gmail.com>
* some ui update
Signed-off-by: James <namnh0122@gmail.com>
* feat: modal migration UI (#3153)
* feat: handle popup migration
* chore: update loader
* chore: integrate script migration
* chore: cleanup import
* chore: moving out spinner loader
* chore: update check thread message success migrate
* chore: add handle script into retry button
* remove warning from joi
Signed-off-by: James <namnh0122@gmail.com>
* chore: fix duplicate children
* fix: path after migrating model
Signed-off-by: James <namnh0122@gmail.com>
* chore: apply mutation for config
* chore: prevent calling too many create assistant api
Signed-off-by: James <namnh0122@gmail.com>
* using cortexso
Signed-off-by: James <namnh0122@gmail.com>
* update download api
Signed-off-by: James <namnh0122@gmail.com>
* fix use on slider item
Signed-off-by: James <namnh0122@gmail.com>
* fix: ui no download model or simple onboarding (#3166)
* fix download huggingface model match with slider item
Signed-off-by: James <namnh0122@gmail.com>
* update owner_logo to logo and author
Signed-off-by: James <namnh0122@gmail.com>
* update new cortexso
Signed-off-by: James <namnh0122@gmail.com>
* Add install python step for macos
* add engine table
Signed-off-by: James <namnh0122@gmail.com>
* fix local icons
Signed-off-by: James <namnh0122@gmail.com>
* feat: add search feature for model hub
Signed-off-by: James <namnh0122@gmail.com>
* fix misalign switch
Signed-off-by: James <namnh0122@gmail.com>
* fix: delete thread not focus on other thread
Signed-off-by: James <namnh0122@gmail.com>
* add get model from hugging face
Signed-off-by: James <namnh0122@gmail.com>
* fix download from hugging face
Signed-off-by: James <namnh0122@gmail.com>
* small update
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* fix system monitor rounded only on the left
Signed-off-by: James <namnh0122@gmail.com>
* chore: update ui new hub screen (#3174)
* chore: update ui new hub screen
* chore: update layout centerpanel thread and hub screen
* chore: update detail model by group
* update cortexso 0.1.13
Signed-off-by: James <namnh0122@gmail.com>
* chore: add file size
Signed-off-by: James <namnh0122@gmail.com>
* chore: put engine to experimental feature
Signed-off-by: James <namnh0122@gmail.com>
* chore: open cortex folder
Signed-off-by: James <namnh0122@gmail.com>
* chore: add back user avatar
Signed-off-by: James <namnh0122@gmail.com>
* chore: minor UI hub (#3182)
* chore: add back right click thread list and update 3 dots are overlapping with the text
* chore: update position dropdown list my models
* chore: make on-device tab showing 6 items instead of 4
* chore: update style description modals detail model
* chore: update isGeneration loader and author name on modal
* feat: integrate cortex single executable
Signed-off-by: James <namnh0122@gmail.com>
* fix build
Signed-off-by: James <namnh0122@gmail.com>
* chore: added blank state
* chore: update ui component blank state
* bump cortex binary version
* fix: logic show modal migration (#3165)
* fix: logic show modal migration
* chore: fixed logic
* chore: read contain format gguf local models
* chore: change return hasLocalModel
* chore: intiial skipmigration state
* chore: filter embedding model
* fix: delete top thread not focus on any other thread
* chore: added UI no result component search models group (#3188)
* fix: remote model should show all when user config that engine
Signed-off-by: James <namnh0122@gmail.com>
* chore: set state thread and models migration using getOnInit (#3189)
* chore: set state thread and models migration using getOnInit
* chore: add state as dependecies hooks
* chore: system monitor panel show engine model (#3192)
* fix: remove config api, replace with engine
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* update reactquery
Signed-off-by: James <namnh0122@gmail.com>
* bump cortex 0.4.35
* feat: add waiting for cortex popup
Signed-off-by: James <namnh0122@gmail.com>
* chore: add loader detail model popup (#3195)
* chore: model start loader (#3197)
* chore: added model loader when user starting chat without model active
* chore: update copies loader
* fix: select min file size if recommended quant does not exist
Signed-off-by: James <namnh0122@gmail.com>
* chore: temporary hide gpu config
* fix: tensorrt not shown
Signed-off-by: James <namnh0122@gmail.com>
* fix lint
Signed-off-by: James <namnh0122@gmail.com>
* fix tests
Signed-off-by: James <namnh0122@gmail.com>
* fix e2e tests (wip)
Signed-off-by: James <namnh0122@gmail.com>
* update
Signed-off-by: James <namnh0122@gmail.com>
* fix: adding element and correct test to adapt new UI
* fix: temp skip unstable part
* fix: only show models which can be supported
Signed-off-by: James <namnh0122@gmail.com>
* Update version.txt
* update send message
Signed-off-by: James <namnh0122@gmail.com>
* fix: not allow user send message when is generating
Signed-off-by: James <namnh0122@gmail.com>
* chore: temp skip Playwright test due to env issue
* chore: temp skip Playwright test due to env issue
* update
Signed-off-by: James <namnh0122@gmail.com>
* chore: minor-ui-feedback (#3202)
---------
Signed-off-by: James <namnh0122@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
Co-authored-by: Van-QA <van@jan.ai>
* feat: add extesion settings
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat: add quick ask
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: add react developer tools to electron
* feat: add small convert modal
* feat: separate modals and add hugging face extension
* feat: fully implement hugging face converter
* fix: forgot to uncomment this...
* fix: typo
* feat: try hf-to-gguf script first and then use convert.py
HF-to-GGUF has support for some unusual models
maybe using convert.py first would be better but we can change the usage order later
* fix: pre-install directory changed
* fix: sometimes exit code is undefined
* chore: download additional files for qwen
* fix: event handling changed
* chore: add one more necessary package
* feat: download gguf-py from llama.cpp
* fix: cannot interpret wildcards on GNU tar
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
---------
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
* fix: message should only be interrupted when i start another thread
* fix: thread lost message streaming if navigate to another thread
* fix: state issue with useThreads
* fix: local server blank parameters if there is no thread selected
* fix: show errors only when the selected model is started while starting the server
* fix: show loading progress of selected model only
* fix: reduce the number of api call
Signed-off-by: James <james@jan.ai>
* fix: download progress
Signed-off-by: James <james@jan.ai>
* chore: save blob
* fix: server boot up
* fix: download state not updating
Signed-off-by: James <james@jan.ai>
* fix: copy assets
* Add Dockerfile CPU for Jan Server and Jan Web
* Add Dockerfile GPU for Jan Server and Jan Web
* feat: S3 adapter
* Update check find count from ./pre-install and correct copy:asserts command
* server add bundleDependencies @janhq/core
* server add bundleDependencies @janhq/core
* fix: update success/failed download state (#1945)
* fix: update success/failed download state
Signed-off-by: James <james@jan.ai>
* fix: download model progress and state handling for both Desktop and Web
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: refactor
* fix: load models empty first time open
* Add Docker compose
* fix: assistants onUpdate
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
chore: Update new model.json with multiple binaries
feat: Add updates for handling multiple model binaries
chore: jan can see
Update Model.json (#1005)
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* chore: model desc nits
* fix(models): adjust the size for solars and pandoras
* add(mixtral): description
---------
Co-authored-by: 0xSage <n@pragmatic.vc>
chore: reformat model.json and use new template
fix(Model): download/abort model (#1163)
* fix(Model): download/abort model
* fix: image preview
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
add preview and reduce time re-render all chat screen
Signed-off-by: James <james@jan.ai>
store files under thread_id/files
Signed-off-by: James <james@jan.ai>
fix: Update llava 1.5 size
fix: Nitro extension path resolver
feat: Add upload preview clearance
chore: Update FileType to multiple targets
fix: delete file preview once new thread created
chore: Add langchain import
support storing pdf file
Signed-off-by: James <james@jan.ai>
feat: add retrieval tool in node runtime
fix: import module done
Co-authored-by: Louis <louis-jan@users.noreply.github.com>
feat: Add type assistant tool
chore: Add tool_retrieval_enabled to InferenceEngine
chore: Add AssistantTool to thread entity
chore: refactor tool retrieval base class
feat: Add handler for assistant with rag enabled
chore: Update inferenceEngine type properly
chore: Update inferenceEngine type properly
fix: Update retrieval tool
chore: main entry correction
refactor: tsconfig files
chore: Update ModelRuntimeParams type
refactor: Remove unused files
fix: wip
chore: remove unused console.log for FileUploadPreview
fix: Update mapping correctly for engine and proxyEngine
feat: Add proxyEngine to type ModelInfo
fix: WIP with test route
fix: Add bundleDependencies to package.json
chore: remove conversational history memory
fix: refactor data passing
reafactor: remove unused code
fix: Update module
chore: export import correction
fix conflict
Signed-off-by: James <james@jan.ai>
fix: resolve after rebased
fix: Update llava 1.5 model json
feat: Add bakllava 1 model json
refactor: node module export, ES syntax and langchain import
fix: WIP
fix: WIP
fix: WIP
fix: external module import
fix: WIP
Add UI attachment fot file upload
Prepare Thumbnail UI image
chore: rebase model folder to dev branch
chore: remove multiple binaries related commits
fix: remove multiple binaries related commits part 2
fix: Remove transformer.js related deps
Fix truncate file name attachment
remove unused code image preview attachment
fix: remove multi binaries error
chore: remove commented code for ModelArtifacts type
Dropzone for drag and drop attachment
Avoid conditional showing 0 using length
fix symbol windows
avoid undefined tools
fix: add tool retrieval to true by default and disable the change
chore: remove unused code
fix: Enable nitro embedding by default
fix: Update code WIP with nitro embedding
chore: remove unused running function
fix: assistant extension missing module
feat: Retrieval ingest, query and reforward
fix: Update hnswlib version conflict
fix: Add tool settings
fix: Update path to thread_id/memory
fix: Add support for nitro embedding usage
fix: RAG does not work with plain content message
fix(Model): #1662 imported model does not use gpu (#1723)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
feat: allow users to update retrieval settings
chore: pass thread assistant settings to assistant extensions
chore: eslint fix
fix bug border right panel showing in thread while not have active thread
Update setting layout retrieval assistant
Renaming file settingcomponent
change default value in core extention
add fake loader generate response
fix conditional fake loader
remove unused import
Proper error message on file typr
fix: loading indicator
fix: chunk size and overlap constraint
conditional drag and drop when retrieval off
fix: enable retrieval middleware as soon as its tool is enabled
fix: configure embedding engine according to request
fix: Retrieval false by default
fix: engine json
chore: migrate assistant
disabled collapse panel when retrieval or children null
chore: remove unused log
chore: Bump nitro version to 0.2.14 for batch embedding
chore: remove unused console.log
* feat: adding model params
Signed-off-by: James <james@jan.ai>
* chore: inference request parameter
* Improve ui right panel model params
* Remove unused import
* Update slider track for darkmode
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
* Make thread screen as default screen
* Blank state when user have not any model
* Cleanup topbar thread screen
* Improve style right panel
* Add instructions right panel
* Styling thread list history
* Resolve conflict
* Default title new thread
* Fix trigger panel sidebar
* Make default right panel false when no activethread
* Fix CI test
* chore: assistant instruction with system prompt
* Fix title and blank state explore the hub
* Claenup style thread screen and add buble message for assitant
* Remove unused import
* Styling more menus on thread list and right panel, and make max height textarea 400 pixel
* Finished revamp ui thread
* Finished system monitor UI
* Style box running models
* Make animate right panel more smooth
* Add status arround textarea for starting model info
* Temporary disable hide left panel
* chore: system resource monitoring update
* copy nits
* chore: typo
* Reverse icon chevron accordion
* Move my models into setting page
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: 0xSage <n@pragmatic.vc>
* refactor: model plugin to follow new specs
Signed-off-by: James <james@jan.ai>
* chore: rebase main
chore: rebase main
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
