Faisal Amir
daa7c0ca21
feat: better hardware setting ( #4471 )
...
* feat: better hardware setting
* chore: update layout
* feat: better hardware setting
* chore: fix title section
* chore: added hardware engine management
* chore: integrate gpus and enable set gpu activate
* chore: update calculate ram and vram
* chore: update calulate vram and ram used
* fix: set active gpus
* chore: fix progress bar spacing
* chore: always update cache vram gpu
* chore: update cpu usage percentage
* chore: fix type usage cpu
* chore: update ram cpus usage getsystemmonitor from new api harware engine management system
* test: update test case data using hardware management extension
* chore: resolve conflict lock json
* chore: cleanup app services
* chore: update type OperationSystemInfo
* chore: update app service
* chore: show list gpus on system monitor
* chore: remove monitoring extension
* chore: update test case app service
* chore: remove unused hooks useGpusSetting
* chore: remove monitor from shource index
* chore: fix test core
* chore: update gpu and cpu info on engine management ext
* chore: fix app service test
* chore: update test appService include cpu info
* chore: filter gpus show or hide on system monitor based activated gpu
* chore: remove unused run_mode
* chore: remove tensort
* chore: update check gpu run_mode
* chore: handle undefined gpus
* chore: cleanup PR
* chore: cleanup process node error
* chore: fix type
2025-02-03 22:01:08 +07:00
Ashley
1174772958
Updated some copies in Settings
2025-01-14 22:13:10 +07:00
Faisal Amir
2a0601f75a
feat: remote engine management ( #4364 )
...
* feat: remote engine management
* chore: fix linter issue
* chore: remove unused imports
* fix: populate engines, models and legacy settings (#4403 )
* fix: populate engines, models and legacy settings
* chore: legacy logics update configured remote engine
* fix: check exist path before reading
* fix: engines and models persist - race condition
* chore: update issue state
* test: update test cases
* chore: bring back Cortex extension settings
* chore: setup button gear / plus based apikey
* chore: fix remote engine from welcome screen
* chore: resolve linter issue
* chore: support request headers template
* chore: update engines using header_template instead of api_key_template
* chore: update models on changes
* fix: anthropic response template
* chore: fix welcome screen and debounce update value input
* chore: update engines list on changes
* chore: update engines list on change
* chore: update desc form add modal remote engines
* chore: bump cortex version to latest RC
* chore: fix linter
* fix: transform payload of Anthropic and OpenAI
* fix: typo
* fix: openrouter model id for auto routing
* chore: remove remote engine URL setting
* chore: add cohere engine and model support
* fix: should not clean on app launch - models list display issue
* fix: local engine check logic
* chore: bump app version to latest release 0.5.13
* test: fix failed tests
---------
Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Louis
b8bd846744
chore: refactor extensions build script for optimization
2024-12-30 22:10:48 +07:00
Faisal Amir
a6a0cb325b
feat: local engine management ( #4334 )
...
* feat: local engine management
* chore: move remote engine into engine page instead extension page
* chore: set default engine from extension
* chore: update endpoint update engine
* chore: update event onEngineUpdate
* chore: filter out engine download
* chore: update version env
* chore: select default engine variant base on user device specs
* chore: symlink engine variants
* chore: rolldown.config in mjs format
* chore: binary codesign
* fix: download state in footer bar and variant status
* chore: update yarn.lock
* fix: rimraf failure
* fix: setup-node@v3 for built-in cache
* fix: cov pipeline
* fix: build syntax
* chore: fix build step
* fix: create engines folder on launch
* chore: update ui delete engine variant with modal confirmation
* chore: fix linter
* chore: add installing progress for Local Engine download
* chore: wording
---------
Co-authored-by: Louis <louis@jan.ai>
2024-12-30 17:27:51 +07:00
hiento09
bd0e525d66
chore: upgrade to turbo v2 and reduce ci quality gate runtime ( #4324 )
...
* chore: upgrade to turbo v2 and reduce ci quality gate runtime
* chore: upgrade to yarn v4 and deprecate turborepo
* chore: reconfigure modules and fix tests
* chore: switch to github-hosted runner
* fix: dependency resolving
* chore: clean redundant step
* chore: headless test
* chore: remove headed param
* fix: resolve dependency version
* fix: ubuntu no-sandbox test
---------
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
2024-12-29 17:46:15 +07:00
Louis
4e43f9798d
fix: fetch threads and messages without limiting ( #4304 )
...
* fix: threads and messages are cutoff
* fix: threads sorting
* chore: bump cortex latest release and app version
2024-12-20 17:55:23 +07:00
Louis
fe6412e1d4
feat: configure HuggingfaceToken via cortex.cpp
2024-11-21 13:13:29 +07:00
Louis
3ea2d9c0ae
fix: bump cortex.cpp to latest version - recursively scanning models folder should also include remote models
2024-11-20 12:33:42 +07:00
Louis
b4f25408c4
chore: append vision models to legacy list
2024-11-20 00:08:56 +07:00
Louis
11637c5244
fix: correct OpenAI o1 model parameters
2024-11-19 22:10:12 +07:00
Louis
28add39a51
chore: add model pull options - correct url path
2024-11-19 16:39:23 +07:00
Louis
bd850fb357
chore: reduce destroy attempts
2024-11-19 13:27:49 +07:00
Louis
363008d37f
fix: model import edge cases
2024-11-19 11:44:19 +07:00
Louis
e9fd7f4554
fix: models load
2024-11-18 18:22:09 +07:00
Louis
1bd58e1327
fix: shift model events subscription to cortex
2024-11-12 15:46:14 +07:00
Louis
4618dea029
fix: inconsistent model dropdown list and my models
2024-11-11 14:02:05 +07:00
Louis
848f9c5eed
fix: migrate model settings and parameters but still allow model.yml editing
2024-11-09 12:54:06 +07:00
Louis
9d57ecd6f3
chore: retrieves the exact model running status upon message error
2024-11-08 13:38:34 +07:00
Louis
a773e169fc
fix: an edge case where auto import does not work with relative model file path
2024-11-07 14:26:41 +07:00
Louis
2e9b7fdad2
chore: add import name for legacy models
2024-11-07 13:34:09 +07:00
Louis
264720c71a
chore: support customized OpenAI model.json
2024-11-06 16:46:27 +07:00
Louis
46d5faf59f
chore: new cortex-cpp binary - model import option and model size
2024-11-04 20:36:04 +07:00
Louis
a986c6de2d
chore: decide model name on pull and import
2024-11-04 15:37:20 +07:00
Louis
5ddbf5fb34
fix: unlink the entire model folder on delete
2024-11-04 15:37:20 +07:00
Louis
1ab02b706f
fix: model import symlink
2024-11-04 15:37:19 +07:00
Louis
e5f5d887e3
fix: persists model.json on download (legacy models)
2024-11-04 15:37:19 +07:00
Louis
a466bbca38
chore: update legacy tensorrt-llm download and run
2024-11-04 15:37:19 +07:00
Louis
2c11caf87e
chore: shared cuda dependencies
2024-11-04 15:37:18 +07:00
Louis
3643c8866e
fix: correct model settings on startup and strip down irrelevant model parameters
2024-11-04 15:37:18 +07:00
Louis
8f778ee90f
feat: app supports cortex.cpp model downloader and legacy downloader - maintain legacy JSON models
2024-11-04 15:37:18 +07:00
Louis
523c745150
chore: try catch legacy assistant creation
2024-11-04 15:37:15 +07:00
Louis
716fd96d56
test: add tests for migration strategy
2024-11-04 15:37:15 +07:00
Louis
5edf121d96
test: add tests to legacy model-json utilities
2024-11-04 15:37:15 +07:00
Louis
895c3d4246
fix: tests - useModels with remote models filter
2024-11-04 15:37:15 +07:00
Louis
ba59425e6a
fix: tests
2024-11-04 15:37:14 +07:00
Louis
03e15fb70f
feat: sync model hub and download progress from cortex.cpp
2024-11-04 15:37:14 +07:00
Louis
f44f291bd8
chore: download progress finished should reload model list
2024-11-04 15:37:13 +07:00
Louis
4080dc4b65
feat: model and cortex extensions update
2024-11-04 15:37:12 +07:00
Faisal Amir
b14f54e866
fix: inconsistent state of downloading multimodal ( #3862 )
2024-10-22 15:44:13 +07:00
Louis
024992264f
fix: error handling for model imports should be handled gracefully
2024-10-03 19:44:52 +07:00
Louis
143f2f5c58
fix: wrong model download location when there is a mismatch model_id ( #3733 )
2024-09-26 12:43:34 +07:00
Louis
c0b59ece4d
fix : #3558 wrong model metadata import or download from HuggingFace ( #3725 )
...
* fix : #3558 wrong model metadata import
* chore: remove redundant metadata retrieval
2024-09-24 10:07:53 +07:00
Louis
aee8624338
fix : #3693 broken thread.json should not break the entire threads ( #3709 )
...
* fix : #3693 broken thread.json should not break the entire threads
* test: add tests
2024-09-23 14:20:01 +07:00
Louis
8e603bd5db
fix : #3476 - Mismatch id between model json and path ( #3645 )
...
* fix: mismatch between model json and path
* chore: revert preserve model settings
* test: add tests
2024-09-17 16:43:47 +07:00
Louis
429a319f93
fix: unable to import model due to missing metadata ( #3439 )
2024-08-22 16:10:40 +07:00
Louis
7c9d49ba60
fix: preserve model settings should maintain all settings ( #3435 )
...
* fix: preserve model settings should maintain all settings
* fix: a legacy bug that allow sending empty stop string
* fix: blank default settings
* fix: incorrect persisting model update
2024-08-22 15:19:44 +07:00
Louis
ad9a4a0b4d
feat: preserve model settings ( #3427 )
...
* feat: preserve model settings
* feat: preserve model settings across new threads
* chore: lint fix
* fix: feature toggle off should also affect default value retrieve
2024-08-21 21:28:29 +07:00
Louis
c9490d466b
chore: add log prefix
2024-08-21 14:21:56 +07:00
Louis
96f393a7a2
refactor: remove deprecated scripts
2024-08-20 17:12:15 +07:00
