* feat: tensorrt-llm-extension
* fix: loading
* feat: add download tensorrt llm runner
Signed-off-by: James <james@jan.ai>
* feat: update to rollupjs instead of webpack for monitoring extension
Signed-off-by: James <james@jan.ai>
* feat: move update nvidia info to monitor extension
Signed-off-by: James <james@jan.ai>
* allow download tensorrt
Signed-off-by: James <james@jan.ai>
* update
Signed-off-by: James <james@jan.ai>
* allow download tensor rt based on gpu setting
Signed-off-by: James <james@jan.ai>
* update downloaded models
Signed-off-by: James <james@jan.ai>
* feat: add extension compatibility
* dynamic tensor rt engines
Signed-off-by: James <james@jan.ai>
* update models
Signed-off-by: James <james@jan.ai>
* chore: remove ts-ignore
* feat: getting installation state from extension
Signed-off-by: James <james@jan.ai>
* chore: adding type for decompress
Signed-off-by: James <james@jan.ai>
* feat: update according Louis's comment
Signed-off-by: James <james@jan.ai>
* feat: add progress for installing extension
Signed-off-by: James <james@jan.ai>
* chore: remove args from extension installation
* fix: model download does not work properly
* fix: do not allow user to stop tensorrtllm inference
* fix: extension installed style
* fix: download tensorrt does not update state
Signed-off-by: James <james@jan.ai>
* chore: replace int4 by fl16
* feat: modal for installing extension
Signed-off-by: James <james@jan.ai>
* fix: start download immediately after press install
Signed-off-by: James <james@jan.ai>
* fix: error switching between engines
* feat: rename inference provider to ai engine and refactor to core
* fix: missing ulid
* fix: core bundler
* feat: add cancel extension installing
Signed-off-by: James <james@jan.ai>
* remove mocking for mac
Signed-off-by: James <james@jan.ai>
* fix: show models only when extension is ready
* add tensorrt badge for model
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: add compatible check (#2342)
* fix: add compatible check
Signed-off-by: James <james@jan.ai>
* fix: copy
* fix: font
* fix: copy
* fix: broken monitoring extension
* chore: bump engine
* fix: copy
* fix: model copy
* fix: copy
* fix: model json
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* fix: vulkan support
* fix: installation button padding
* fix: empty script
* fix: remove hard code string
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat: add quick ask
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* feat: jan can see
feat: Add GPT-4 Vision model (Preview)
fix: Add visionModel as property in ModelInfo
fix: Fix condition to load local messages in useSetActiveThread hook
feat: Enable Image as input for chat
fix: Update model parameters in JSON files for remote GPT models
fix: Add thread as optional
fix: Add support for message as image
fix: Linter
fix: Update proxyModel to proxy_model and add textModel
chore: Change proxyModel to proxy_model
fix: Update settings with visionModel and textModel
fix: vision model passed through the retrieval tool
fix: linter
* fix: could not load image and request is not able to be sent
---------
Co-authored-by: Louis <louis@jan.ai>
* chore: add react developer tools to electron
* feat: add small convert modal
* feat: separate modals and add hugging face extension
* feat: fully implement hugging face converter
* fix: forgot to uncomment this...
* fix: typo
* feat: try hf-to-gguf script first and then use convert.py
HF-to-GGUF has support for some unusual models
maybe using convert.py first would be better but we can change the usage order later
* fix: pre-install directory changed
* fix: sometimes exit code is undefined
* chore: download additional files for qwen
* fix: event handling changed
* chore: add one more necessary package
* feat: download gguf-py from llama.cpp
* fix: cannot interpret wildcards on GNU tar
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
---------
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
* feat: add vulkan support on windows and linux
* fix: correct vulkan settings
* fix: gpu settings and enable Vulkan support
* fix: vulkan support 1 device at a time only
* inference-nitro-extension add download vulkaninfo
---------
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
* Web: change API_BASE_URL to build time env
* Update Dockerfile and Docker Compose by adding env API_BASE_URL
* Update make clean
* INFERENCE_URL get from baseApiUrl
* Fix error settings/settings.json not found when start server at the first time
* Update README docker
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
* fix: reduce the number of api call
Signed-off-by: James <james@jan.ai>
* fix: download progress
Signed-off-by: James <james@jan.ai>
* chore: save blob
* fix: server boot up
* fix: download state not updating
Signed-off-by: James <james@jan.ai>
* fix: copy assets
* Add Dockerfile CPU for Jan Server and Jan Web
* Add Dockerfile GPU for Jan Server and Jan Web
* feat: S3 adapter
* Update check find count from ./pre-install and correct copy:asserts command
* server add bundleDependencies @janhq/core
* server add bundleDependencies @janhq/core
* fix: update success/failed download state (#1945)
* fix: update success/failed download state
Signed-off-by: James <james@jan.ai>
* fix: download model progress and state handling for both Desktop and Web
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
* chore: refactor
* fix: load models empty first time open
* Add Docker compose
* fix: assistants onUpdate
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: NamH <NamNh0122@gmail.com>
* feat(FactoryReset): add factory reset feature
Signed-off-by: nam <namnh0122@gmail.com>
Signed-off-by: James <james@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
Co-authored-by: James <james@jan.ai>
chore: Update new model.json with multiple binaries
feat: Add updates for handling multiple model binaries
chore: jan can see
Update Model.json (#1005)
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* add(mixtral): add model.json for mixtral
* archived some models + update the model.json
* add(model): add pandora 10.7b
* fix(model): update description
* fix(model): pump vers and change the featured model to trinity
* fix(model): archive neuralchat
* fix(model): decapriated all old models
* fix(trinity): add cover image and change description
* fix(trinity): update cover png
* add(pandora): cover image
* fix(pandora): cover image
* chore: model desc nits
* fix(models): adjust the size for solars and pandoras
* add(mixtral): description
---------
Co-authored-by: 0xSage <n@pragmatic.vc>
chore: reformat model.json and use new template
fix(Model): download/abort model (#1163)
* fix(Model): download/abort model
* fix: image preview
Signed-off-by: James <james@jan.ai>
---------
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
Co-authored-by: Louis <louis@jan.ai>
add preview and reduce time re-render all chat screen
Signed-off-by: James <james@jan.ai>
store files under thread_id/files
Signed-off-by: James <james@jan.ai>
fix: Update llava 1.5 size
fix: Nitro extension path resolver
feat: Add upload preview clearance
chore: Update FileType to multiple targets
fix: delete file preview once new thread created
chore: Add langchain import
support storing pdf file
Signed-off-by: James <james@jan.ai>
feat: add retrieval tool in node runtime
fix: import module done
Co-authored-by: Louis <louis-jan@users.noreply.github.com>
feat: Add type assistant tool
chore: Add tool_retrieval_enabled to InferenceEngine
chore: Add AssistantTool to thread entity
chore: refactor tool retrieval base class
feat: Add handler for assistant with rag enabled
chore: Update inferenceEngine type properly
chore: Update inferenceEngine type properly
fix: Update retrieval tool
chore: main entry correction
refactor: tsconfig files
chore: Update ModelRuntimeParams type
refactor: Remove unused files
fix: wip
chore: remove unused console.log for FileUploadPreview
fix: Update mapping correctly for engine and proxyEngine
feat: Add proxyEngine to type ModelInfo
fix: WIP with test route
fix: Add bundleDependencies to package.json
chore: remove conversational history memory
fix: refactor data passing
reafactor: remove unused code
fix: Update module
chore: export import correction
fix conflict
Signed-off-by: James <james@jan.ai>
fix: resolve after rebased
fix: Update llava 1.5 model json
feat: Add bakllava 1 model json
refactor: node module export, ES syntax and langchain import
fix: WIP
fix: WIP
fix: WIP
fix: external module import
fix: WIP
Add UI attachment fot file upload
Prepare Thumbnail UI image
chore: rebase model folder to dev branch
chore: remove multiple binaries related commits
fix: remove multiple binaries related commits part 2
fix: Remove transformer.js related deps
Fix truncate file name attachment
remove unused code image preview attachment
fix: remove multi binaries error
chore: remove commented code for ModelArtifacts type
Dropzone for drag and drop attachment
Avoid conditional showing 0 using length
fix symbol windows
avoid undefined tools
fix: add tool retrieval to true by default and disable the change
chore: remove unused code
fix: Enable nitro embedding by default
fix: Update code WIP with nitro embedding
chore: remove unused running function
fix: assistant extension missing module
feat: Retrieval ingest, query and reforward
fix: Update hnswlib version conflict
fix: Add tool settings
fix: Update path to thread_id/memory
fix: Add support for nitro embedding usage
fix: RAG does not work with plain content message
fix(Model): #1662 imported model does not use gpu (#1723)
Signed-off-by: James <james@jan.ai>
Co-authored-by: James <james@jan.ai>
feat: allow users to update retrieval settings
chore: pass thread assistant settings to assistant extensions
chore: eslint fix
fix bug border right panel showing in thread while not have active thread
Update setting layout retrieval assistant
Renaming file settingcomponent
change default value in core extention
add fake loader generate response
fix conditional fake loader
remove unused import
Proper error message on file typr
fix: loading indicator
fix: chunk size and overlap constraint
conditional drag and drop when retrieval off
fix: enable retrieval middleware as soon as its tool is enabled
fix: configure embedding engine according to request
fix: Retrieval false by default
fix: engine json
chore: migrate assistant
disabled collapse panel when retrieval or children null
chore: remove unused log
chore: Bump nitro version to 0.2.14 for batch embedding
chore: remove unused console.log
