104 Commits

Author SHA1 Message Date
Louis
7a6890bd7f
chore: remote engine error handling (#4646)
* chore: Gemini error handling

* chore: remote provider error handling

* chore: remote provider error handling

* chore: fix anthropic unsupported parameters

* chore: fix tests
2025-02-13 18:32:33 +07:00
Louis
470fd64ab5
chore: bump cortex.cpp server 1.0.10-rc6 (#4642)
* chore: bump cortex.cpp server 1.0.10-rc6

* chore: don't force stop model on delete if its not currently running
2025-02-13 12:39:04 +07:00
Louis
2510ed7bfe
chore: bump cortex-cpp to the rc5 to address race condition issue (#4630) 2025-02-11 20:56:38 +07:00
Louis
931d70fc50
chore: add back env paths setting so cortex engine can load libraries properly (#4625)
* chore: add back env paths setting so cortex engine can load libraries properly

* chore: bump cortex
2025-02-11 13:55:25 +07:00
Louis
a6d2dac406
chore: change cortex.cpp log level to info for easier log observation (#4623) 2025-02-11 11:05:13 +07:00
Louis
ceb93cafef
chore: bump cortex to the latest version 1.0.10-rc1 to address hardware UI issues (#4622)
* chore: bump cortex to the latest version 1.0.10-rc1 to address hardware API issues

* fix: app crashes while reading properties from undefined value

* fix: cuda engine variant selection logic
2025-02-11 10:24:47 +07:00
Louis
a70735b8a5
chore: bump cortex with conversation patch update (#4598)
* chore: correct conversational PATCH methods with latest cortex update (#4568)

# Conflicts:
#	extensions/inference-cortex-extension/bin/version.txt

* chore: bump cortex 1.0.9-rc8
2025-02-06 21:03:02 +07:00
Ashley
ca220d18a6
chore: Updated copies in-app (#4527)
* Updated copies in Advanced Settings

* Updated copies in Extensions Settings

* Updated copies in Engines Settings

* Updated copies in Engines Settings

* Updated copies in Install Engine modal

* chore: lint fix

---------

Co-authored-by: Louis <louis@jan.ai>
2025-02-06 10:09:32 +07:00
Louis
c32c9e1dcb
chore: add DeepSeek R1 Distill models to Hub (#4586) 2025-02-05 23:10:40 +07:00
Faisal Amir
daa7c0ca21
feat: better hardware setting (#4471)
* feat: better hardware setting

* chore: update layout

* feat: better hardware setting

* chore: fix title section

* chore: added hardware engine management

* chore: integrate gpus and enable set gpu activate

* chore: update calculate ram and vram

* chore: update calulate vram and ram used

* fix: set active gpus

* chore: fix progress bar spacing

* chore: always update cache vram gpu

* chore: update cpu usage percentage

* chore: fix type usage cpu

* chore: update ram cpus usage getsystemmonitor from new api harware engine management system

* test: update test case data using hardware management extension

* chore: resolve conflict lock json

* chore: cleanup app services

* chore: update type OperationSystemInfo

* chore: update app service

* chore: show list gpus on system monitor

* chore: remove monitoring extension

* chore: update test case app service

* chore: remove unused hooks useGpusSetting

* chore: remove monitor from shource index

* chore: fix test core

* chore: update gpu and cpu info on engine management ext

* chore: fix app service test

* chore: update test appService include cpu info

* chore: filter gpus show or hide on system monitor based activated gpu

* chore: remove unused run_mode

* chore: remove tensort

* chore: update check gpu run_mode

* chore: handle undefined gpus

* chore: cleanup PR

* chore: cleanup process node error

* chore: fix type
2025-02-03 22:01:08 +07:00
Louis
144b836935
fix: app does not reload model when prompt template is updated (#4537)
* fix: app does not reload model when prompt template is updated

* chore: lint fix
2025-01-29 21:50:17 +07:00
Louis
27a4d979f3
Merge branch 'main' into release/v0.5.14
# Conflicts:
#	extensions/inference-cortex-extension/download.bat
#	extensions/inference-cortex-extension/download.sh
#	extensions/inference-cortex-extension/rollup.config.ts
2025-01-23 11:27:31 +07:00
Louis
a2ca6a685f
chore: bump llama.cpp to the latest version 2025-01-21 15:43:02 +07:00
Louis
b81516a50f
chore: bump cortex latest rc 1.0.9-rc4 - fix engines list in my models page 2025-01-17 18:06:04 +07:00
Louis
99c8ef1341
chore: bump cortex server rc3 2025-01-16 16:47:20 +07:00
Louis
713926e68c
chore: attempt to stop model before switching engine variant 2025-01-16 16:18:32 +07:00
Louis
687b034b06 fix: file symlink does not work on windows for cuda dependencies 2025-01-16 16:04:28 +07:00
Louis
a4649fa9cc
chore: bump engine version to 0.1.46 2025-01-16 15:26:15 +07:00
Louis
f5e2712172
chore: symlink dll should be type file instead of junction 2025-01-16 13:25:27 +07:00
Louis
ae7a6c5d64
chore: update symbolic type 2025-01-16 12:36:07 +07:00
Louis
58bb1b4939
fix: incorrect default max_tokens set - legacy issue (#4451)
* fix: incorrect default max_tokens set - legacy issue

* chore: bump cortex server
2025-01-15 12:37:29 +07:00
Faisal Amir
2a0601f75a
feat: remote engine management (#4364)
* feat: remote engine management

* chore: fix linter issue

* chore: remove unused imports

* fix: populate engines, models and legacy settings (#4403)

* fix: populate engines, models and legacy settings

* chore: legacy logics update configured remote engine

* fix: check exist path before reading

* fix: engines and models persist - race condition

* chore: update issue state

* test: update test cases

* chore: bring back Cortex extension settings

* chore: setup button gear / plus based apikey

* chore: fix remote engine from welcome screen

* chore: resolve linter issue

* chore: support request headers template

* chore: update engines using header_template instead of api_key_template

* chore: update models on changes

* fix: anthropic response template

* chore: fix welcome screen and debounce update value input

* chore: update engines list on changes

* chore: update engines list on change

* chore: update desc form add modal remote engines

* chore: bump cortex version to latest RC

* chore: fix linter

* fix: transform payload of Anthropic and OpenAI

* fix: typo

* fix: openrouter model id for auto routing

* chore: remove remote engine URL setting

* chore: add cohere engine and model support

* fix: should not clean on app launch - models list display issue

* fix: local engine check logic

* chore: bump app version to latest release 0.5.13

* test: fix failed tests

---------

Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Louis
dfdf417cc1
Merge pull request #4438 from janhq/chore/bump-engine-version-to-0.1.43
chore: bump engine version to 0.1.43
2025-01-13 09:34:36 +07:00
Louis
a3077ea4a5
chore: bump engine version to 0.1.43 2025-01-13 09:15:45 +07:00
Louis
d2717fb8df fix: load model fail on windows 2025-01-12 16:10:37 +07:00
Louis
09dacef0de
chore: correct CSS of extension settings 2025-01-08 06:53:33 +07:00
Louis
d63c24851a
enhancement: Update Cortex page with better description & UX 2025-01-08 00:40:48 +07:00
Louis
b4d2176280
Merge pull request #4408 from janhq/main
Sync release 0.5.13 into dev
2025-01-06 21:01:49 +07:00
Louis
e3d44c9e7b
chore: resolve hotfix into dev (#4409) 2025-01-06 20:43:16 +07:00
Louis
3cd4c9852a
chore: bump latest cortex release 1.0.8 (#4405) 2025-01-06 14:24:12 +07:00
Louis
d17c2ea5e5
fix: input scrolls to the bottom when set the caret to the top (#4399)
* fix: input scrolls to the bottom on long inputs

* test: fix failed tests
2025-01-03 23:47:27 +07:00
Faisal Amir
538a6bf923
fix: send event opt out (#4390)
* fux: send event opt out from button deny

* chore: fix copy

* chore: update placeholder
2025-01-02 21:04:09 +07:00
Louis
27e40c35d8
chore: add cpu_threads settings in cortex extension 2025-01-02 13:03:16 +07:00
Louis
8ccf02a26d
fix: bump llama.cpp engine hotfix version to address mode load issue on some Intel machines 2024-12-31 19:25:47 +07:00
Louis
6d88b824a3
Merge pull request #4363 from janhq/chore/reduce-extensions-build-time
chore: refactor extensions build script for optimization
2024-12-31 10:04:18 +07:00
Louis
da55b46240
Merge pull request #4360 from janhq/main
chore: sync latest main into dev
2024-12-30 22:37:02 +07:00
Louis
b8bd846744
chore: refactor extensions build script for optimization 2024-12-30 22:10:48 +07:00
Faisal Amir
a6a0cb325b
feat: local engine management (#4334)
* feat: local engine management

* chore: move remote engine into engine page instead extension page

* chore: set default engine from extension

* chore: update endpoint update engine

* chore: update event onEngineUpdate

* chore: filter out engine download

* chore: update version env

* chore: select default engine variant base on user device specs

* chore: symlink engine variants

* chore: rolldown.config in mjs format

* chore: binary codesign

* fix: download state in footer bar and variant status

* chore: update yarn.lock

* fix: rimraf failure

* fix: setup-node@v3 for built-in cache

* fix: cov pipeline

* fix: build syntax

* chore: fix build step

* fix: create engines folder on launch

* chore: update ui delete engine variant with modal confirmation

* chore: fix linter

* chore: add installing progress for Local Engine download

* chore: wording

---------

Co-authored-by: Louis <louis@jan.ai>
2024-12-30 17:27:51 +07:00
Louis
a33563be9a
chore: bump cortex latest version 1.0.7 (#4357) 2024-12-30 16:36:24 +07:00
Louis
9b8d8ab3f7
chore: bump cortex 1.0.7 RC (#4355)
* chore: bump cortex 1.0.7 rc

* chore: test update
2024-12-30 13:37:16 +07:00
hiento09
bd0e525d66
chore: upgrade to turbo v2 and reduce ci quality gate runtime (#4324)
* chore: upgrade to turbo v2 and reduce ci quality gate runtime

* chore: upgrade to yarn v4 and deprecate turborepo

* chore: reconfigure modules and fix tests

* chore: switch to github-hosted runner

* fix: dependency resolving

* chore: clean redundant step

* chore: headless test

* chore: remove headed param

* fix: resolve dependency version

* fix: ubuntu no-sandbox test

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
2024-12-29 17:46:15 +07:00
Louis
3cd4db0a92
chore: bump latest cortex stable release version (#4336) 2024-12-26 10:52:16 +07:00
Louis
dccd9dd77c
chore: bump cortex 1.0.6-rc (#4330) 2024-12-24 09:56:02 +07:00
Louis
4e43f9798d
fix: fetch threads and messages without limiting (#4304)
* fix: threads and messages are cutoff

* fix: threads sorting

* chore: bump cortex latest release and app version
2024-12-20 17:55:23 +07:00
Louis
6e786170e8
chore: bump cortex 1.0.5 rc2 2024-12-18 16:56:07 +07:00
Louis
ef4dcb7d9e
chore: bump cortex and engine 2024-12-16 22:10:58 +07:00
Louis
68a8293179
chore: add NGL settings for vision models 2024-12-04 13:40:39 +07:00
Louis
fb0a916c50
fix: 4155 - Queue up health check on server restarting 2024-12-03 16:17:46 +07:00
Louis
a4467cf5bf
chore: bump version 0.5.10 2024-12-02 17:33:01 +07:00
Louis
541a37b8f1
fix: 4171 - Model loading gets stuck on stop 2024-12-02 14:04:13 +07:00