116 Commits

Author SHA1 Message Date
Faisal Amir
2a0601f75a
feat: remote engine management (#4364)
* feat: remote engine management

* chore: fix linter issue

* chore: remove unused imports

* fix: populate engines, models and legacy settings (#4403)

* fix: populate engines, models and legacy settings

* chore: legacy logics update configured remote engine

* fix: check exist path before reading

* fix: engines and models persist - race condition

* chore: update issue state

* test: update test cases

* chore: bring back Cortex extension settings

* chore: setup button gear / plus based apikey

* chore: fix remote engine from welcome screen

* chore: resolve linter issue

* chore: support request headers template

* chore: update engines using header_template instead of api_key_template

* chore: update models on changes

* fix: anthropic response template

* chore: fix welcome screen and debounce update value input

* chore: update engines list on changes

* chore: update engines list on change

* chore: update desc form add modal remote engines

* chore: bump cortex version to latest RC

* chore: fix linter

* fix: transform payload of Anthropic and OpenAI

* fix: typo

* fix: openrouter model id for auto routing

* chore: remove remote engine URL setting

* chore: add cohere engine and model support

* fix: should not clean on app launch - models list display issue

* fix: local engine check logic

* chore: bump app version to latest release 0.5.13

* test: fix failed tests

---------

Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Louis
b8bd846744
chore: refactor extensions build script for optimization 2024-12-30 22:10:48 +07:00
Faisal Amir
a6a0cb325b
feat: local engine management (#4334)
* feat: local engine management

* chore: move remote engine into engine page instead extension page

* chore: set default engine from extension

* chore: update endpoint update engine

* chore: update event onEngineUpdate

* chore: filter out engine download

* chore: update version env

* chore: select default engine variant base on user device specs

* chore: symlink engine variants

* chore: rolldown.config in mjs format

* chore: binary codesign

* fix: download state in footer bar and variant status

* chore: update yarn.lock

* fix: rimraf failure

* fix: setup-node@v3 for built-in cache

* fix: cov pipeline

* fix: build syntax

* chore: fix build step

* fix: create engines folder on launch

* chore: update ui delete engine variant with modal confirmation

* chore: fix linter

* chore: add installing progress for Local Engine download

* chore: wording

---------

Co-authored-by: Louis <louis@jan.ai>
2024-12-30 17:27:51 +07:00
hiento09
bd0e525d66
chore: upgrade to turbo v2 and reduce ci quality gate runtime (#4324)
* chore: upgrade to turbo v2 and reduce ci quality gate runtime

* chore: upgrade to yarn v4 and deprecate turborepo

* chore: reconfigure modules and fix tests

* chore: switch to github-hosted runner

* fix: dependency resolving

* chore: clean redundant step

* chore: headless test

* chore: remove headed param

* fix: resolve dependency version

* fix: ubuntu no-sandbox test

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
2024-12-29 17:46:15 +07:00
Louis
4e43f9798d
fix: fetch threads and messages without limiting (#4304)
* fix: threads and messages are cutoff

* fix: threads sorting

* chore: bump cortex latest release and app version
2024-12-20 17:55:23 +07:00
Louis
fe6412e1d4
feat: configure HuggingfaceToken via cortex.cpp 2024-11-21 13:13:29 +07:00
Louis
3ea2d9c0ae
fix: bump cortex.cpp to latest version - recursively scanning models folder should also include remote models 2024-11-20 12:33:42 +07:00
Louis
b4f25408c4
chore: append vision models to legacy list 2024-11-20 00:08:56 +07:00
Louis
11637c5244
fix: correct OpenAI o1 model parameters 2024-11-19 22:10:12 +07:00
Louis
28add39a51
chore: add model pull options - correct url path 2024-11-19 16:39:23 +07:00
Louis
bd850fb357
chore: reduce destroy attempts 2024-11-19 13:27:49 +07:00
Louis
363008d37f
fix: model import edge cases 2024-11-19 11:44:19 +07:00
Louis
e9fd7f4554
fix: models load 2024-11-18 18:22:09 +07:00
Louis
1bd58e1327 fix: shift model events subscription to cortex 2024-11-12 15:46:14 +07:00
Louis
4618dea029
fix: inconsistent model dropdown list and my models 2024-11-11 14:02:05 +07:00
Louis
848f9c5eed
fix: migrate model settings and parameters but still allow model.yml editing 2024-11-09 12:54:06 +07:00
Louis
9d57ecd6f3
chore: retrieves the exact model running status upon message error 2024-11-08 13:38:34 +07:00
Louis
a773e169fc
fix: an edge case where auto import does not work with relative model file path 2024-11-07 14:26:41 +07:00
Louis
2e9b7fdad2
chore: add import name for legacy models 2024-11-07 13:34:09 +07:00
Louis
264720c71a
chore: support customized OpenAI model.json 2024-11-06 16:46:27 +07:00
Louis
46d5faf59f
chore: new cortex-cpp binary - model import option and model size 2024-11-04 20:36:04 +07:00
Louis
a986c6de2d
chore: decide model name on pull and import 2024-11-04 15:37:20 +07:00
Louis
5ddbf5fb34
fix: unlink the entire model folder on delete 2024-11-04 15:37:20 +07:00
Louis
1ab02b706f
fix: model import symlink 2024-11-04 15:37:19 +07:00
Louis
e5f5d887e3
fix: persists model.json on download (legacy models) 2024-11-04 15:37:19 +07:00
Louis
a466bbca38
chore: update legacy tensorrt-llm download and run 2024-11-04 15:37:19 +07:00
Louis
2c11caf87e
chore: shared cuda dependencies 2024-11-04 15:37:18 +07:00
Louis
3643c8866e
fix: correct model settings on startup and strip down irrelevant model parameters 2024-11-04 15:37:18 +07:00
Louis
8f778ee90f
feat: app supports cortex.cpp model downloader and legacy downloader - maintain legacy JSON models 2024-11-04 15:37:18 +07:00
Louis
523c745150
chore: try catch legacy assistant creation 2024-11-04 15:37:15 +07:00
Louis
716fd96d56
test: add tests for migration strategy 2024-11-04 15:37:15 +07:00
Louis
5edf121d96
test: add tests to legacy model-json utilities 2024-11-04 15:37:15 +07:00
Louis
895c3d4246
fix: tests - useModels with remote models filter 2024-11-04 15:37:15 +07:00
Louis
ba59425e6a
fix: tests 2024-11-04 15:37:14 +07:00
Louis
03e15fb70f
feat: sync model hub and download progress from cortex.cpp 2024-11-04 15:37:14 +07:00
Louis
f44f291bd8
chore: download progress finished should reload model list 2024-11-04 15:37:13 +07:00
Louis
4080dc4b65
feat: model and cortex extensions update 2024-11-04 15:37:12 +07:00
Faisal Amir
b14f54e866
fix: inconsistent state of downloading multimodal (#3862) 2024-10-22 15:44:13 +07:00
Louis
024992264f
fix: error handling for model imports should be handled gracefully 2024-10-03 19:44:52 +07:00
Louis
143f2f5c58
fix: wrong model download location when there is a mismatch model_id (#3733) 2024-09-26 12:43:34 +07:00
Louis
c0b59ece4d
fix: #3558 wrong model metadata import or download from HuggingFace (#3725)
* fix: #3558 wrong model metadata import

* chore: remove redundant metadata retrieval
2024-09-24 10:07:53 +07:00
Louis
aee8624338
fix: #3693 broken thread.json should not break the entire threads (#3709)
* fix: #3693 broken thread.json should not break the entire threads

* test: add tests
2024-09-23 14:20:01 +07:00
Louis
8e603bd5db
fix: #3476 - Mismatch id between model json and path (#3645)
* fix: mismatch between model json and path

* chore: revert preserve model settings

* test: add tests
2024-09-17 16:43:47 +07:00
Louis
429a319f93
fix: unable to import model due to missing metadata (#3439) 2024-08-22 16:10:40 +07:00
Louis
7c9d49ba60
fix: preserve model settings should maintain all settings (#3435)
* fix: preserve model settings should maintain all settings

* fix: a legacy bug that allow sending empty stop string

* fix: blank default settings

* fix: incorrect persisting model update
2024-08-22 15:19:44 +07:00
Louis
ad9a4a0b4d
feat: preserve model settings (#3427)
* feat: preserve model settings

* feat: preserve model settings across new threads

* chore: lint fix

* fix: feature toggle off should also affect default value retrieve
2024-08-21 21:28:29 +07:00
Louis
c9490d466b
chore: add log prefix 2024-08-21 14:21:56 +07:00
Louis
96f393a7a2 refactor: remove deprecated scripts 2024-08-20 17:12:15 +07:00
Louis
dfd9c54154 feat: import model with gguf metadata extraction 2024-08-20 17:12:15 +07:00
Louis
a699f8f32f
Revert "Jan integrates Cortex"
This reverts commit ad6fbea22df6deaba31e146dddb456e4a5d5dd75

Revert "chore: add engine logo from local instead of metadata logo (#3363)"

This reverts commit ad6fbea22df6deaba31e146dddb456e4a5d5dd75.

Revert "fix: LaTex formula render issue (#3353)"

This reverts commit 3b2c84c4fee61b886c883c68801be3bc5a8584ad.

Revert "chore: minor ui improvement (#3352)"

This reverts commit 6dd387db2b5b9890f19d0c3505cf9cb770fd492f.

Revert "fix: failed to relaunch app to update (#3351)"

This reverts commit fcaf98a2fa4e674799602e8093914bcc04ced153.

Revert "chore: add back GPU information to system monitoring bar (#3350)"

This reverts commit 03455a91807c7af6c6325901997c6d7231d2cd0d.

Revert "fix: empty model page not shown when delete all threads and models (#3343)"

This reverts commit 9e29fcd69eb9085843896686806fd453a1285723.

Revert "feat: allow user configure remote model from my model (#3348)"

This reverts commit fdab8af057f80cf1ccaae0dc42c4e5161925f51e.

Revert "chore: ui fix button outline for configure cloud model (#3347)"

This reverts commit fe8ed1f26dc86ead92ffea4f36e2989caf7dad88.

Revert "feat: move icon create new thread into top panel (#3346)"

This reverts commit 46cb1b45b997181e2188f8dafb2fc0d0cc12ddcd.

Revert "chore(UI): update experience model dropdown (#3342)"

This reverts commit 8b44613015a907dc491113aeb99c963080424892.

Revert "Chore/simple bug template and correct a copy (#3344)"

This reverts commit 23cd5fd3979e7529811045da5c4912369bcc7532.

Revert "chore(ui): fix alignment loader starter screen (#3338)"

This reverts commit e9f5d2f837ce323b0851ea04cded913ab433388c.

Revert "Increase retry upload to R2 to 5 times (#3337)"

This reverts commit dcfb497934edc795955d971b6d391ee1e6309a03.

Revert "fix: broken jan build - add log trace (jan.log) (#3336)"

This reverts commit 77422c3a7ed240909942ac0d8c4b259af8d87a28.

Revert "chore: disable quick ask (#3334)"

This reverts commit 6e4b6b09ae009149f262d86d5b19bb8096267c19.

Revert "fix: update legacy path (#3328)"

This reverts commit 5eb112142c6431cfe0cdf11ce28810ca650a5427.

Revert "chore: add cortex version (#3318)"

This reverts commit 60587649c56a1f24272e763f25aa5b4042f7719a.

Revert "fix: broken app due to incorrect api path (#3316)"

This reverts commit 3de4eab2a0dfbf9f593d73b9dde6bca1d9df2279.

Revert "feat: modal waiting cortex (#3306)"

This reverts commit 1f5168d4af9080b867c19d334c398bf32e4f54b8.

Revert "fix: refresh should not create new thread (#3314)"

This reverts commit 624d07703c50ea332ed4eeac9dc3a26bc8190d08.

Revert "fix: avoid lose title threads (#3307)"

This reverts commit a4f5fda104c2d1e01ea72798f055e5b4e3cfd616.

Revert "feat: change data folder (#3309)"

This reverts commit b43242b9b24352c7f90995eccab753dede679616.

Revert "feat: embed cortex into jan as a js module (#3305)"

This reverts commit b348110fb73bd5f13c69f1b915168687dea776d0.

Revert "fix: migration item in setting detail omit buttons (#3298)"

This reverts commit 709204b2bc9d9ed08e2245cbb084482f5908ab3a.

Revert "fix: merge gpu arch and os tensorrt models (#3299)"

This reverts commit aa7dbdc9fa701debeee28d9c7eb4af6258685321.

Revert "chore: update cortex new version (#3300)"

This reverts commit 602097909d38b4874db8b9f19a729c65a0ac9619.

Revert "fix: engine logo on model dropdown (#3291)"

This reverts commit 8eb8611c28f6c4cdf1ab142a6e18c82bcc4c2073.

Revert "fix: icon setting can close and open right panel (#3295)"

This reverts commit be31e9315e2df5c483de3f46bd37740d277cfccd.

Revert "fix: error while importing local model is not shown (#3294)"

This reverts commit 26be941e8426462e1e3a28e5b9bf1f834f462f82.

Revert "fix: add lower case quantization support (#3293)"

This reverts commit 3135ccc27e894a4056f882cd25f0bf7e10e56f49.

Revert "fix: onnx can't be selected in download model modal (#3283)"

This reverts commit 2521e1db518e9e01493e89dcc98c181ccd2b48a2.

Revert "feat: add chunk count (#3290)"

This reverts commit bad481bf05aa38edcf553e1273f5d692a65c9225.

Revert "fix: RAM always show 0% (#3287)"

This reverts commit 2201e6c5f87538b953503937fe6b135fe1aa2d94.

Revert "fix: remote engine should not allow reinit (#3284)"

This reverts commit 98abff0da3467c090618233db12a25bfa4c1db69.

Revert "chore": update minor UI (#3281)"

This reverts commit 105a9aa1a1830648a32ae285f751b4078c8ac2b2.

Revert "chore: update z-index tooltip (#3280)"

This reverts commit 5a81865508c205ed8c54df209092553a0c40054f.

Revert "feat: add nvidia engine (#3279)"

This reverts commit 8372f30f0ee99606b123351e7bb62636c62c8b23.

Revert "fix: migration wrong directory (#3278)"

This reverts commit 7fb1354287677f577070ccb065ed3a5f9e5b9882.

Revert "fix: clearer app loading prompt (#3275)"

This reverts commit 44a6401000334b79b225ab6fd6afb79f9da4bd51.

Revert "fix: allow user to reinit engine from settings page (#3277)"

This reverts commit 57cf3c7b3d5bface785763d06813906ba6eab7c9.

Revert "feat: enable copy over instructions (#3266)"

This reverts commit 2074511067201f0addb9d274cc90d1e782f2bc1d.

Revert "chore: toast message on model import fail with reason (#3276)"

This reverts commit 3bebdfe67e1571c7414065a36d16eb5941115ee0.

Revert "fix: should not let second instance terminate cortex (#3274)"

This reverts commit d074a5a445b73ca195a49814a935300f9e895aaa.

Revert "chore: remnove focus button (#3272)"

This reverts commit 07fa79e71a401becdbc0f474c27b860654a8bd62.

Revert "chore: update hub search result (#3273)"

This reverts commit 10b4a9087af709d147b34f6c3ee63d2d3b75c77a.

Revert "chore: temporary hidden import model (#3270)"

This reverts commit db5d8aba454fd4cc1e07253ca4805d4b1b3e7fb2.

Revert "fix: set cortex data folder path when starting jan (#3252)"

This reverts commit 91c77eda78ecd251d480e58b853fe7b261f6de50.

Revert "fix: remote model added manually does not shown in model drop down (#3261)"

This reverts commit 224ca3f7cc25b2577ab123829907964b78b78aa8.

Revert "feat: add more options for cortex popup (#3236)"

This reverts commit 5e06ed8a122aaed9d68fbd04ce42b65bf8987e58.

Revert "feat: manage cloud models from threads screen (#3223)"

This reverts commit 37a3c4f844419e66cfe3f2a9ff79ba688538241f.

Revert "chore: check the legacy incompatible message type (#3248)"

This reverts commit c10caf8d7f1f9cf68551e41de5d54cd4450cf44a.

Revert "chore: minor copy for grammar (#3235)"

This reverts commit f0f23078f31f58e01ba27787d6926f5c1eb2ff0b.

Revert "fix: add back normalize message function (#3234)"

This reverts commit 83579df3a40ff61eac25975da8295fceaec679dc.

Revert "chore: update conditional starter screen after cortex load (#3227)"

This reverts commit 4d3a97f1dca9e6c3ea746586e8607541f2d1c0b3.

Revert "fix: broken status parse due to empty category (#3233)"

This reverts commit 68714eeaf9212a6fdacd5c6a48d8691db9cc99eb.

Revert "feat: make scroll area type auto for make default visible scrollbar (#3220)"

This reverts commit 13428d60e7d3ea6a24c0df8871ea13e2dec0d5fd.

Revert "fix: update new api from cortex to support 0.5.0 (#3221)"

This reverts commit ec9b5bf682a8676e132a08075b6ae03cf9e23132.

Revert "feat: new starter screen (#3217)"

This reverts commit e8ee694abd33b34112d2c7d09f8c03370c2d22cc.

Revert "bump-cortex-0.5.0-1 (#3218)"

This reverts commit 5369da78f5b83b1c8761cb48820ccf3111728a90.

Revert "Deprecate Docker and K8s (#3219)"

This reverts commit 7611a05c44982d07465bec57658d5bf965f30ad5.

Revert "chore: set container max width for chat message and new hub screen (#3213)"

This reverts commit 007daa71616268b0e741e7a890b319401e49a81e.

Revert "feat: integrating cortex (#3001)"

This reverts commit 101268f6f36df96b62982a9eeb8581ebe103a909.
2024-08-15 10:44:47 +07:00