548 Commits

Author SHA1 Message Date
Louis
931d70fc50
chore: add back env paths setting so cortex engine can load libraries properly (#4625)
* chore: add back env paths setting so cortex engine can load libraries properly

* chore: bump cortex
2025-02-11 13:55:25 +07:00
Louis
a6d2dac406
chore: change cortex.cpp log level to info for easier log observation (#4623) 2025-02-11 11:05:13 +07:00
Louis
ceb93cafef
chore: bump cortex to the latest version 1.0.10-rc1 to address hardware UI issues (#4622)
* chore: bump cortex to the latest version 1.0.10-rc1 to address hardware API issues

* fix: app crashes while reading properties from undefined value

* fix: cuda engine variant selection logic
2025-02-11 10:24:47 +07:00
Louis
e877871dc6
fix: inconsistent models list on first launch (#4618) 2025-02-10 21:00:56 +07:00
Faisal Amir
6e891d9a3b
fix: remove from list dropdown when deleted remote model (#4616)
* fix: remove from list dropdown when deleted remote model

* chore: update logic
2025-02-10 20:19:47 +07:00
Louis
45edb9cc51
fix: error handling - pull remote models list raise an error on fail (#4615)
* chore: pull models list on /models update

* chore: correct engine extension name

* chore: fix undefined error

* chore: revert auto populating remote models on update
2025-02-09 19:40:32 +07:00
Faisal Amir
c5f17b4e83
fix: remote engine model auto select (#4609) 2025-02-09 13:06:57 +07:00
Louis
42f767c191
chore: update remote provider response transform template (#4602) 2025-02-08 07:55:57 +07:00
Louis
a70735b8a5
chore: bump cortex with conversation patch update (#4598)
* chore: correct conversational PATCH methods with latest cortex update (#4568)

# Conflicts:
#	extensions/inference-cortex-extension/bin/version.txt

* chore: bump cortex 1.0.9-rc8
2025-02-06 21:03:02 +07:00
Louis
a87bbd2840
chore: add google gemini and deepseek as new supported remote engine providers (#4596)
* chore: add google gemini and deepseek as new supported remote engine providers

* chore: add logos

* chore: fallback default error message on empty

* chore: update open router models

* chore: typo fix

* chore: remove unusable queen vl
2025-02-06 20:52:42 +07:00
Ashley
ca220d18a6
chore: Updated copies in-app (#4527)
* Updated copies in Advanced Settings

* Updated copies in Extensions Settings

* Updated copies in Engines Settings

* Updated copies in Engines Settings

* Updated copies in Install Engine modal

* chore: lint fix

---------

Co-authored-by: Louis <louis@jan.ai>
2025-02-06 10:09:32 +07:00
Louis
c32c9e1dcb
chore: add DeepSeek R1 Distill models to Hub (#4586) 2025-02-05 23:10:40 +07:00
Louis
b79edc225b
chore: add default inference parameters for custom remote models (#4584) 2025-02-05 21:21:36 +07:00
Faisal Amir
f2f31d8dc8
chore: calculate model label (#4585)
* chore: fix claculate model label

* chore: update test model label
2025-02-05 20:29:46 +07:00
Louis
4846befd4a
chore: engine model adding ux refinement (#4580)
* fix: enhance remote engine models adding UX

* fix: OpenAI o3 support template

* chore: fix models populating error

* chore: missing dependency
2025-02-05 15:28:35 +07:00
Faisal Amir
0cc6f29f7f
fix: download progress import from hgf (#4567) 2025-02-04 19:09:20 +07:00
Faisal Amir
daa7c0ca21
feat: better hardware setting (#4471)
* feat: better hardware setting

* chore: update layout

* feat: better hardware setting

* chore: fix title section

* chore: added hardware engine management

* chore: integrate gpus and enable set gpu activate

* chore: update calculate ram and vram

* chore: update calulate vram and ram used

* fix: set active gpus

* chore: fix progress bar spacing

* chore: always update cache vram gpu

* chore: update cpu usage percentage

* chore: fix type usage cpu

* chore: update ram cpus usage getsystemmonitor from new api harware engine management system

* test: update test case data using hardware management extension

* chore: resolve conflict lock json

* chore: cleanup app services

* chore: update type OperationSystemInfo

* chore: update app service

* chore: show list gpus on system monitor

* chore: remove monitoring extension

* chore: update test case app service

* chore: remove unused hooks useGpusSetting

* chore: remove monitor from shource index

* chore: fix test core

* chore: update gpu and cpu info on engine management ext

* chore: fix app service test

* chore: update test appService include cpu info

* chore: filter gpus show or hide on system monitor based activated gpu

* chore: remove unused run_mode

* chore: remove tensort

* chore: update check gpu run_mode

* chore: handle undefined gpus

* chore: cleanup PR

* chore: cleanup process node error

* chore: fix type
2025-02-03 22:01:08 +07:00
Faisal Amir
72b9aaeba1
enhancement: remote engine model (#4560)
* enhancement: add option delete model remote engine

* enhancement: add menu delete remote engine models
2025-02-03 20:36:31 +07:00
Faisal Amir
043284f51e
chore: reasoning block (#4551)
* chore: reasoning text block

* chore: update interface support all theme

* chore: update failed test

* chore: update state collapsed based on message index

* fix: use reserve_id instead of message index

* chore: clean up

* chore: fix loading indicator

---------

Co-authored-by: Louis <louis@jan.ai>
2025-02-01 22:22:45 +07:00
Faisal Amir
f2bb9c91de
chore: align item menu action error message (#4548) 2025-01-30 21:20:55 +07:00
Louis
33db5135b1
feat: auto pull models list when setting up remote engine (#4547) 2025-01-30 17:26:46 +07:00
Louis
144b836935
fix: app does not reload model when prompt template is updated (#4537)
* fix: app does not reload model when prompt template is updated

* chore: lint fix
2025-01-29 21:50:17 +07:00
Faisal Amir
cdc7d2ba47
enhancement: minor ui refinements (#4521)
* enhancement: minor ui refinements

* chore: update test case
2025-01-26 20:41:52 +07:00
Louis
27a4d979f3
Merge branch 'main' into release/v0.5.14
# Conflicts:
#	extensions/inference-cortex-extension/download.bat
#	extensions/inference-cortex-extension/download.sh
#	extensions/inference-cortex-extension/rollup.config.ts
2025-01-23 11:27:31 +07:00
Louis
a2ca6a685f
chore: bump llama.cpp to the latest version 2025-01-21 15:43:02 +07:00
Louis
b81516a50f
chore: bump cortex latest rc 1.0.9-rc4 - fix engines list in my models page 2025-01-17 18:06:04 +07:00
Louis
fd5c6fcfd3
chore: correct mistral AI request transformation template 2025-01-17 17:38:46 +07:00
Louis
96a14c23c4
chore: fix remote engines request templates 2025-01-17 13:24:17 +07:00
Louis
a8cac58355
chore: refactor - clean out useEngines - mutate swr to update 2025-01-17 12:43:35 +07:00
Louis
99c8ef1341
chore: bump cortex server rc3 2025-01-16 16:47:20 +07:00
Louis
713926e68c
chore: attempt to stop model before switching engine variant 2025-01-16 16:18:32 +07:00
Louis
687b034b06 fix: file symlink does not work on windows for cuda dependencies 2025-01-16 16:04:28 +07:00
Louis
a4649fa9cc
chore: bump engine version to 0.1.46 2025-01-16 15:26:15 +07:00
Louis
f5e2712172
chore: symlink dll should be type file instead of junction 2025-01-16 13:25:27 +07:00
Louis
ae7a6c5d64
chore: update symbolic type 2025-01-16 12:36:07 +07:00
Louis
99388f4418
chore: log engine variant symlink error 2025-01-16 11:52:59 +07:00
hiento09
63c938e2f5
fix: windows uninstall not force close app (#4459) 2025-01-15 22:05:03 +07:00
Louis
1964a9cf4d
fix: hide placeholder python engine and unsupported openai o1 system role (#4455) 2025-01-15 19:26:44 +07:00
Faisal Amir
231c7116ea
chore: add chat completion field form add remote engine (#4452) 2025-01-15 15:45:52 +07:00
Louis
06ee10be1b
chore: deprecate tensorrt-llm extension (#4453) 2025-01-15 15:43:16 +07:00
Louis
58bb1b4939
fix: incorrect default max_tokens set - legacy issue (#4451)
* fix: incorrect default max_tokens set - legacy issue

* chore: bump cortex server
2025-01-15 12:37:29 +07:00
Ashley
1174772958 Updated some copies in Settings 2025-01-14 22:13:10 +07:00
Ashley
97cd0224f1 Updated parameters descriptions 2025-01-14 20:54:26 +07:00
Faisal Amir
2a0601f75a
feat: remote engine management (#4364)
* feat: remote engine management

* chore: fix linter issue

* chore: remove unused imports

* fix: populate engines, models and legacy settings (#4403)

* fix: populate engines, models and legacy settings

* chore: legacy logics update configured remote engine

* fix: check exist path before reading

* fix: engines and models persist - race condition

* chore: update issue state

* test: update test cases

* chore: bring back Cortex extension settings

* chore: setup button gear / plus based apikey

* chore: fix remote engine from welcome screen

* chore: resolve linter issue

* chore: support request headers template

* chore: update engines using header_template instead of api_key_template

* chore: update models on changes

* fix: anthropic response template

* chore: fix welcome screen and debounce update value input

* chore: update engines list on changes

* chore: update engines list on change

* chore: update desc form add modal remote engines

* chore: bump cortex version to latest RC

* chore: fix linter

* fix: transform payload of Anthropic and OpenAI

* fix: typo

* fix: openrouter model id for auto routing

* chore: remove remote engine URL setting

* chore: add cohere engine and model support

* fix: should not clean on app launch - models list display issue

* fix: local engine check logic

* chore: bump app version to latest release 0.5.13

* test: fix failed tests

---------

Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Louis
dfdf417cc1
Merge pull request #4438 from janhq/chore/bump-engine-version-to-0.1.43
chore: bump engine version to 0.1.43
2025-01-13 09:34:36 +07:00
Louis
a3077ea4a5
chore: bump engine version to 0.1.43 2025-01-13 09:15:45 +07:00
Louis
d2717fb8df fix: load model fail on windows 2025-01-12 16:10:37 +07:00
Louis
09dacef0de
chore: correct CSS of extension settings 2025-01-08 06:53:33 +07:00
Louis
d63c24851a
enhancement: Update Cortex page with better description & UX 2025-01-08 00:40:48 +07:00
Louis
b4d2176280
Merge pull request #4408 from janhq/main
Sync release 0.5.13 into dev
2025-01-06 21:01:49 +07:00