48 Commits

Author SHA1 Message Date
Louis
9d64e9bef4
chore: merge release/v0.5.16 into dev (#4833)
* chore: bump cortex 1.0.11-rc10

* chore: bump to latest cortex release

* feat: Cortex API Authorization

* chore: correct CI CD repo name

* chore: correct new menloresearch repo name

* feat: rotate api token for each run (#4820)

* feat: rotate api token for each run

* chore: correct github repo url

* chore: correct github api url

* chore: should not filter out models first launch

* chore: bump cortex release

* chore: should get hardware information on launch (#4821)

* chore: should have an option to not revalidate hardware information

* chore: cortex.cpp gpu activation could cause a race condition (#4825)

* fix: jan beta logo displayed in jan release (#4828)

---------

Co-authored-by: David <davidpt.janai@gmail.com>
Co-authored-by: Nguyen Ngoc Minh <91668012+Minh141120@users.noreply.github.com>
2025-03-24 11:53:30 +07:00
Louis
c0f4517c34
chore: bump llama.cpp to support gemma3 2025-03-12 22:11:43 +08:00
Louis
a84f10cba2
chore: correct cohere response template 2025-03-12 16:03:23 +07:00
Louis
3c4afea5c7
chore: do not symlink engine on linux 2025-03-11 21:42:33 +07:00
David
c000f75593
Merge pull request #4794 from janhq/fix/appimage-could-not-load-model
fix: app image - could not load model
2025-03-11 13:42:47 +07:00
Louis
f4f4d411aa
chore: bump cortex version (#4793) 2025-03-11 13:42:42 +07:00
Louis
580cf5d38f
fix: app image - could not load model 2025-03-11 13:30:24 +07:00
Louis
55aa045991
fix: cohere response template correction for proper markdown parsing 2025-03-11 10:11:34 +07:00
Louis
ba282d637e
fix: anthropic response template correction 2025-03-10 15:23:15 +07:00
Louis
455d320d35
fix: engine version update - cortex version bump - update tests (#4787) 2025-03-10 13:26:48 +07:00
Louis
b0deeed937
chore: sync initial hub models (#4778)
* chore: sync initial hub models

* fix: openai request template
2025-03-04 22:33:19 +07:00
Minh
fb93226aff feat: add openai 4.5 preview and anthropic claude 3.7 sonnet models 2025-03-01 00:31:17 +07:00
Louis
6a0fb09610
fix: correct default engine variant setup on first launch (#4747)
* fix: there is a case where app selects incorrect engine variant first launch

* refactor: clean up legacy settings hook
2025-02-27 09:03:01 +07:00
Louis
916b28044d
fix: onboarding screen should show persisted cloud providers (#4738) 2025-02-26 14:29:36 +07:00
Louis
60257635ad
fix: should not select vulkan by default when there are Nvidia GPUs detected (#4720) 2025-02-24 18:51:22 +07:00
Louis
bc2f382e64
chore: migrate engine settings on update (#4719)
* chore: migrate engine settings on update

* chore: queue engine migration to ensure it only execute when server is on

* chore: ensure queue is empty instead of running in the queue
2025-02-24 11:29:11 +07:00
Louis
a47942d7df
chore: streaming should be turned on by default (#4712) 2025-02-21 00:52:07 +07:00
Louis
badc632ee4
refactor: different Jan builds should have different Cortex server port (#4699)
* refactor: different Jan instances should have different Cortex server port configurations

* chore: update workflow to use env input

* chore: update env for cortex port setting
2025-02-20 15:53:16 +07:00
Louis
6c6fc08a45
chore: fix engine template for remote providers (#4680) 2025-02-18 13:05:23 +07:00
Louis
e0437afb2c
fix: app stucks at generating response state after stopped the previous session (#4662)
* chore: add OpenAI o3-mini model to ship with the app by default

* chore: should not reload model on inference parameters update

* chore: update cortex.cpp rc build
2025-02-17 15:24:43 +07:00
Louis
7a6890bd7f
chore: remote engine error handling (#4646)
* chore: Gemini error handling

* chore: remote provider error handling

* chore: remote provider error handling

* chore: fix anthropic unsupported parameters

* chore: fix tests
2025-02-13 18:32:33 +07:00
Faisal Amir
aed42edb3f
fix: multiple gpu (#4641)
* fix: multiple gpu

* chore: check vulkan when app load

* chore: remove log

* chore: update engine variant conditional
2025-02-12 22:50:56 +07:00
Louis
ab3b47f134
chore: fix engine variant for mac targets (#4626) 2025-02-11 14:28:08 +07:00
Louis
ceb93cafef
chore: bump cortex to the latest version 1.0.10-rc1 to address hardware UI issues (#4622)
* chore: bump cortex to the latest version 1.0.10-rc1 to address hardware API issues

* fix: app crashes while reading properties from undefined value

* fix: cuda engine variant selection logic
2025-02-11 10:24:47 +07:00
Louis
e877871dc6
fix: inconsistent models list on first launch (#4618) 2025-02-10 21:00:56 +07:00
Louis
45edb9cc51
fix: error handling - pull remote models list raise an error on fail (#4615)
* chore: pull models list on /models update

* chore: correct engine extension name

* chore: fix undefined error

* chore: revert auto populating remote models on update
2025-02-09 19:40:32 +07:00
Louis
42f767c191
chore: update remote provider response transform template (#4602) 2025-02-08 07:55:57 +07:00
Louis
a87bbd2840
chore: add google gemini and deepseek as new supported remote engine providers (#4596)
* chore: add google gemini and deepseek as new supported remote engine providers

* chore: add logos

* chore: fallback default error message on empty

* chore: update open router models

* chore: typo fix

* chore: remove unusable queen vl
2025-02-06 20:52:42 +07:00
Louis
b79edc225b
chore: add default inference parameters for custom remote models (#4584) 2025-02-05 21:21:36 +07:00
Louis
4846befd4a
chore: engine model adding ux refinement (#4580)
* fix: enhance remote engine models adding UX

* fix: OpenAI o3 support template

* chore: fix models populating error

* chore: missing dependency
2025-02-05 15:28:35 +07:00
Faisal Amir
daa7c0ca21
feat: better hardware setting (#4471)
* feat: better hardware setting

* chore: update layout

* feat: better hardware setting

* chore: fix title section

* chore: added hardware engine management

* chore: integrate gpus and enable set gpu activate

* chore: update calculate ram and vram

* chore: update calulate vram and ram used

* fix: set active gpus

* chore: fix progress bar spacing

* chore: always update cache vram gpu

* chore: update cpu usage percentage

* chore: fix type usage cpu

* chore: update ram cpus usage getsystemmonitor from new api harware engine management system

* test: update test case data using hardware management extension

* chore: resolve conflict lock json

* chore: cleanup app services

* chore: update type OperationSystemInfo

* chore: update app service

* chore: show list gpus on system monitor

* chore: remove monitoring extension

* chore: update test case app service

* chore: remove unused hooks useGpusSetting

* chore: remove monitor from shource index

* chore: fix test core

* chore: update gpu and cpu info on engine management ext

* chore: fix app service test

* chore: update test appService include cpu info

* chore: filter gpus show or hide on system monitor based activated gpu

* chore: remove unused run_mode

* chore: remove tensort

* chore: update check gpu run_mode

* chore: handle undefined gpus

* chore: cleanup PR

* chore: cleanup process node error

* chore: fix type
2025-02-03 22:01:08 +07:00
Faisal Amir
72b9aaeba1
enhancement: remote engine model (#4560)
* enhancement: add option delete model remote engine

* enhancement: add menu delete remote engine models
2025-02-03 20:36:31 +07:00
Louis
33db5135b1
feat: auto pull models list when setting up remote engine (#4547) 2025-01-30 17:26:46 +07:00
Louis
144b836935
fix: app does not reload model when prompt template is updated (#4537)
* fix: app does not reload model when prompt template is updated

* chore: lint fix
2025-01-29 21:50:17 +07:00
Louis
fd5c6fcfd3
chore: correct mistral AI request transformation template 2025-01-17 17:38:46 +07:00
Louis
96a14c23c4
chore: fix remote engines request templates 2025-01-17 13:24:17 +07:00
Louis
a8cac58355
chore: refactor - clean out useEngines - mutate swr to update 2025-01-17 12:43:35 +07:00
Louis
a4649fa9cc
chore: bump engine version to 0.1.46 2025-01-16 15:26:15 +07:00
Louis
ae7a6c5d64
chore: update symbolic type 2025-01-16 12:36:07 +07:00
Louis
99388f4418
chore: log engine variant symlink error 2025-01-16 11:52:59 +07:00
Louis
1964a9cf4d
fix: hide placeholder python engine and unsupported openai o1 system role (#4455) 2025-01-15 19:26:44 +07:00
Faisal Amir
231c7116ea
chore: add chat completion field form add remote engine (#4452) 2025-01-15 15:45:52 +07:00
Ashley
1174772958 Updated some copies in Settings 2025-01-14 22:13:10 +07:00
Faisal Amir
2a0601f75a
feat: remote engine management (#4364)
* feat: remote engine management

* chore: fix linter issue

* chore: remove unused imports

* fix: populate engines, models and legacy settings (#4403)

* fix: populate engines, models and legacy settings

* chore: legacy logics update configured remote engine

* fix: check exist path before reading

* fix: engines and models persist - race condition

* chore: update issue state

* test: update test cases

* chore: bring back Cortex extension settings

* chore: setup button gear / plus based apikey

* chore: fix remote engine from welcome screen

* chore: resolve linter issue

* chore: support request headers template

* chore: update engines using header_template instead of api_key_template

* chore: update models on changes

* fix: anthropic response template

* chore: fix welcome screen and debounce update value input

* chore: update engines list on changes

* chore: update engines list on change

* chore: update desc form add modal remote engines

* chore: bump cortex version to latest RC

* chore: fix linter

* fix: transform payload of Anthropic and OpenAI

* fix: typo

* fix: openrouter model id for auto routing

* chore: remove remote engine URL setting

* chore: add cohere engine and model support

* fix: should not clean on app launch - models list display issue

* fix: local engine check logic

* chore: bump app version to latest release 0.5.13

* test: fix failed tests

---------

Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Louis
d2717fb8df fix: load model fail on windows 2025-01-12 16:10:37 +07:00
Louis
2f755eeb8e
fix: if the default engine isn't installed, the app should reset it 2025-01-01 14:03:43 +07:00
Louis
b8bd846744
chore: refactor extensions build script for optimization 2024-12-30 22:10:48 +07:00
Faisal Amir
a6a0cb325b
feat: local engine management (#4334)
* feat: local engine management

* chore: move remote engine into engine page instead extension page

* chore: set default engine from extension

* chore: update endpoint update engine

* chore: update event onEngineUpdate

* chore: filter out engine download

* chore: update version env

* chore: select default engine variant base on user device specs

* chore: symlink engine variants

* chore: rolldown.config in mjs format

* chore: binary codesign

* fix: download state in footer bar and variant status

* chore: update yarn.lock

* fix: rimraf failure

* fix: setup-node@v3 for built-in cache

* fix: cov pipeline

* fix: build syntax

* chore: fix build step

* fix: create engines folder on launch

* chore: update ui delete engine variant with modal confirmation

* chore: fix linter

* chore: add installing progress for Local Engine download

* chore: wording

---------

Co-authored-by: Louis <louis@jan.ai>
2024-12-30 17:27:51 +07:00