Akarshan Biswas
da23673a44
feat: Add API key generation for Llama.cpp
...
This commit introduces API key generation for the Llama.cpp extension. The API key is now generated on the server side using HMAC-SHA256 and a secret key to ensure security and uniqueness. The frontend now passes the model ID and API secret to the server to generate the key. This addresses the requirement for secure model access and authorization.
2025-07-02 12:27:12 +07:00
Akarshan Biswas
31971e7821
(WIP)randomly generate api-key hash each session
2025-07-02 12:27:12 +07:00
Akarshan Biswas
7481fae0df
remove ununsed imports and remove n_ctx key from loadOptions
2025-07-02 12:27:11 +07:00
Thien Tran
d5c07acdb5
feat: add LlamacppConfig for llama.cpp extension to improve settings ( #5121 )
...
* add engine settings
* update load options
* rename variable
2025-07-02 12:27:11 +07:00
Akarshan Biswas
742e731e96
Add --reasoning_budget option
2025-07-02 12:27:10 +07:00
Thien Tran
cd36b423b6
add basic model list
2025-07-02 12:27:10 +07:00
Thien Tran
d523166b61
implement delete
2025-07-02 12:27:09 +07:00
Akarshan Biswas
587ed3c83c
refactor OAI request payload type to support image and audio
2025-07-02 12:27:09 +07:00
Thien Tran
ded9ae733a
feat: Model import (download + local import) for llama.cpp extension ( #5087 )
...
* add pull and abortPull
* add model import (download only)
* write model.yaml. support local model import
* remove cortex-related command
* add TODO
* remove cortex-related command
2025-07-02 12:27:09 +07:00
Akarshan Biswas
a7a2dcc8d8
refactor load/unload again; move types to core and refactor AIEngine abstract class
2025-07-02 12:27:09 +07:00
Akarshan Biswas
ee2cb9e625
remove override from localOAIEngine and OAIEngine
2025-07-02 12:27:09 +07:00
Akarshan Biswas
bbbf4779df
refactor load/unload
2025-07-02 12:27:08 +07:00
Louis
942f2f51b7
chore: send chat completion with messages history ( #5070 )
...
* chore: send chat completion with messages history
* chore: handle abort controllers
* chore: change max attempts setting
* chore: handle stop running models in system monitor screen
* Update web-app/src/services/models.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: format time
* chore: handle stop model load action
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-22 20:13:50 +07:00
Louis
0627f29059
chore: enable / disable proxy configrations ( #5050 )
...
* chore: enable / disable proxy configrations
* Update web-app/src/routes/settings/https-proxy.tsx
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update web-app/src/lib/completion.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-21 14:18:25 +07:00
Louis
6676e0ced8
chore: add relocate jan data folder function to new FE ( #5043 )
...
* chore: typo
* fix: linter issues
* chore: fix linter
* chore: fix linter
* chore: add relocate data folder
2025-05-21 10:48:10 +07:00
Louis
e9f37e98d1
refactor: remove hardcoded provider names ( #4995 )
...
* refactor: remove hardcoded provider names
* chore: continue the replacement
2025-05-15 22:10:43 +07:00
Thien Tran
dc23cc2716
Use token.js for non-tools calls ( #4973 )
...
* deprecate inference()
* fix tool_choice. only startModel for Cortex
* appease linter
* remove sse
* add stopInferencing support. temporarily with OpenAI
* use abortSignal in token.js
* bump token.js version
2025-05-15 17:11:19 +07:00
Louis
72a7157509
feat: Jan Tool Use - MCP frontend implementation
2025-05-15 17:10:20 +07:00
Louis
b64749b4bb
fix: distinguish between hub and models search ( #4989 )
...
* fix: distinguish between hub and models search
* chore: refresh models hub when going to hub screen
2025-05-14 12:08:33 +07:00
Louis
55aa045991
fix: cohere response template correction for proper markdown parsing
2025-03-11 10:11:34 +07:00
Louis
ba282d637e
fix: anthropic response template correction
2025-03-10 15:23:15 +07:00
Louis
dc06a07c71
Merge branch 'release/v0.5.15' into chore/sync-release-to-dev
...
# Conflicts:
# extensions/engine-management-extension/rolldown.config.mjs
# extensions/inference-cortex-extension/bin/version.txt
# extensions/yarn.lock
# web/containers/Layout/BottomPanel/SystemMonitor/index.tsx
# web/containers/ModelDropdown/index.tsx
# web/containers/ModelLabel/ModelLabel.test.tsx
# web/screens/Settings/HuggingFaceRepoDetailModal/ModelDownloadRow/index.tsx
# web/screens/Thread/ThreadCenterPanel/TextMessage/MarkdownTextMessage.tsx
# web/screens/Thread/ThreadCenterPanel/TextMessage/index.tsx
# yarn.lock
2025-02-18 16:33:58 +07:00
Louis
7a6890bd7f
chore: remote engine error handling ( #4646 )
...
* chore: Gemini error handling
* chore: remote provider error handling
* chore: remote provider error handling
* chore: fix anthropic unsupported parameters
* chore: fix tests
2025-02-13 18:32:33 +07:00
Faisal Amir
daa7c0ca21
feat: better hardware setting ( #4471 )
...
* feat: better hardware setting
* chore: update layout
* feat: better hardware setting
* chore: fix title section
* chore: added hardware engine management
* chore: integrate gpus and enable set gpu activate
* chore: update calculate ram and vram
* chore: update calulate vram and ram used
* fix: set active gpus
* chore: fix progress bar spacing
* chore: always update cache vram gpu
* chore: update cpu usage percentage
* chore: fix type usage cpu
* chore: update ram cpus usage getsystemmonitor from new api harware engine management system
* test: update test case data using hardware management extension
* chore: resolve conflict lock json
* chore: cleanup app services
* chore: update type OperationSystemInfo
* chore: update app service
* chore: show list gpus on system monitor
* chore: remove monitoring extension
* chore: update test case app service
* chore: remove unused hooks useGpusSetting
* chore: remove monitor from shource index
* chore: fix test core
* chore: update gpu and cpu info on engine management ext
* chore: fix app service test
* chore: update test appService include cpu info
* chore: filter gpus show or hide on system monitor based activated gpu
* chore: remove unused run_mode
* chore: remove tensort
* chore: update check gpu run_mode
* chore: handle undefined gpus
* chore: cleanup PR
* chore: cleanup process node error
* chore: fix type
2025-02-03 22:01:08 +07:00
Louis
83f090826e
feat: Jan Hub Revamp ( #4491 )
...
* feat: model hub revamp UI
* chore: model description - consistent markdown css
* chore: add model versions dropdown
* chore: integrate APIs - model sources
* chore: update model display name
* chore: lint fix
* chore: page transition animation
* feat: model search dropdown - deeplink
* chore: bump cortex version
* chore: add remote model sources
* chore: model download state
* chore: fix model metadata label
* chore: polish model detail page markdown
* test: fix test cases
* chore: initialize default Hub model sources
* chore: fix model stats
* chore: clean up click outside and inside hooks
* feat: change hub banner
* chore: lint fix
* chore: fix css long model id
2025-01-28 22:23:25 +07:00
Louis
6dd090acc1
feat: allow users to add remote models ( #4534 )
2025-01-28 18:07:59 +07:00
Louis
b81516a50f
chore: bump cortex latest rc 1.0.9-rc4 - fix engines list in my models page
2025-01-17 18:06:04 +07:00
Faisal Amir
2a0601f75a
feat: remote engine management ( #4364 )
...
* feat: remote engine management
* chore: fix linter issue
* chore: remove unused imports
* fix: populate engines, models and legacy settings (#4403 )
* fix: populate engines, models and legacy settings
* chore: legacy logics update configured remote engine
* fix: check exist path before reading
* fix: engines and models persist - race condition
* chore: update issue state
* test: update test cases
* chore: bring back Cortex extension settings
* chore: setup button gear / plus based apikey
* chore: fix remote engine from welcome screen
* chore: resolve linter issue
* chore: support request headers template
* chore: update engines using header_template instead of api_key_template
* chore: update models on changes
* fix: anthropic response template
* chore: fix welcome screen and debounce update value input
* chore: update engines list on changes
* chore: update engines list on change
* chore: update desc form add modal remote engines
* chore: bump cortex version to latest RC
* chore: fix linter
* fix: transform payload of Anthropic and OpenAI
* fix: typo
* fix: openrouter model id for auto routing
* chore: remove remote engine URL setting
* chore: add cohere engine and model support
* fix: should not clean on app launch - models list display issue
* fix: local engine check logic
* chore: bump app version to latest release 0.5.13
* test: fix failed tests
---------
Co-authored-by: Louis <louis@jan.ai>
2025-01-14 17:29:56 +07:00
Faisal Amir
a6a0cb325b
feat: local engine management ( #4334 )
...
* feat: local engine management
* chore: move remote engine into engine page instead extension page
* chore: set default engine from extension
* chore: update endpoint update engine
* chore: update event onEngineUpdate
* chore: filter out engine download
* chore: update version env
* chore: select default engine variant base on user device specs
* chore: symlink engine variants
* chore: rolldown.config in mjs format
* chore: binary codesign
* fix: download state in footer bar and variant status
* chore: update yarn.lock
* fix: rimraf failure
* fix: setup-node@v3 for built-in cache
* fix: cov pipeline
* fix: build syntax
* chore: fix build step
* fix: create engines folder on launch
* chore: update ui delete engine variant with modal confirmation
* chore: fix linter
* chore: add installing progress for Local Engine download
* chore: wording
---------
Co-authored-by: Louis <louis@jan.ai>
2024-12-30 17:27:51 +07:00
Louis
b81b008a93
chore: use seconds timestamp system
2024-12-19 11:38:10 +07:00
Louis
8613e35c15
fix: timestamp issue
2024-12-17 17:12:03 +07:00
Louis
174f1c7dcb
feat: reroute threads and messages requests to the backend
2024-12-12 16:38:55 +07:00
Louis
4da37087b6
fix: 4162 - Graceful Openrouter error handling
2024-12-03 16:01:43 +07:00
Louis
c6e1bb55f9
chore: remote models error handling
2024-11-20 21:14:37 +07:00
Louis
11637c5244
fix: correct OpenAI o1 model parameters
2024-11-19 22:10:12 +07:00
Louis
28add39a51
chore: add model pull options - correct url path
2024-11-19 16:39:23 +07:00
Louis
9d57ecd6f3
chore: retrieves the exact model running status upon message error
2024-11-08 13:38:34 +07:00
Louis
46d5faf59f
chore: new cortex-cpp binary - model import option and model size
2024-11-04 20:36:04 +07:00
Louis
a986c6de2d
chore: decide model name on pull and import
2024-11-04 15:37:20 +07:00
Louis
61f72e6775
chore: bump cortex-cpp v1.0.2-rc1
2024-11-04 15:37:19 +07:00
Louis
83edc1fbc7
chore: linter and test
2024-11-04 15:37:19 +07:00
Louis
a466bbca38
chore: update legacy tensorrt-llm download and run
2024-11-04 15:37:19 +07:00
Louis
ba59425e6a
fix: tests
2024-11-04 15:37:14 +07:00
Louis
03e15fb70f
feat: sync model hub and download progress from cortex.cpp
2024-11-04 15:37:14 +07:00
Louis
f3aa40bc0b
chore: clean obsolete local provider codes
2024-11-04 15:37:13 +07:00
Louis
4080dc4b65
feat: model and cortex extensions update
2024-11-04 15:37:12 +07:00
Louis
c5e0c93ab4
test: add missing tests ( #3716 )
2024-09-23 13:54:52 +07:00
Louis
302b73ae73
test: add web helpers, services, utils tests ( #3669 )
...
* test: add web helpers tests
* fix: coverage report
* test: add more tests
* test: add more generated tests
* chore: add more tests
* test: add more tests
2024-09-20 14:24:51 +07:00
Louis
8e603bd5db
fix : #3476 - Mismatch id between model json and path ( #3645 )
...
* fix: mismatch between model json and path
* chore: revert preserve model settings
* test: add tests
2024-09-17 16:43:47 +07:00
Louis
846efb3126
test: add core modules test cases ( #3498 )
...
* chore: add core module test cases
* chore: fix tests
* chore: add code coverage report
* chore: split coverage step
* chore: split coverage step
* Update jan-electron-linter-and-test.yml
* Update jan-electron-linter-and-test.yml
* Update jan-electron-linter-and-test.yml
* chore: update tests
* chore: add web utils test cases
* chore: add restful and helper tests
* chore: add tests
2024-09-06 11:14:28 +07:00
