NamH 101268f6f3
feat: integrating cortex (#3001)
* feat: integrating cortex

* Temporary prevent crash

Signed-off-by: James <namnh0122@gmail.com>

* fix yarn lint

Signed-off-by: James <namnh0122@gmail.com>

* refactor: remove core node module - fs - extensions and so on (#3151)

* add migration script for threads, messages and models

Signed-off-by: James <namnh0122@gmail.com>

* remove freq_penalty and presence_penalty if model not supported

Signed-off-by: James <namnh0122@gmail.com>

* add back models in my models

Signed-off-by: James <namnh0122@gmail.com>

* fix api-url for setup API key popup

Signed-off-by: James <namnh0122@gmail.com>

* fix using model name for dropdown model

Signed-off-by: James <namnh0122@gmail.com>

* fix can't click to hotkey

Signed-off-by: James <namnh0122@gmail.com>

* fix: disable some UIs

Signed-off-by: James <namnh0122@gmail.com>

* fix build

Signed-off-by: James <namnh0122@gmail.com>

* reduce calling HF api

Signed-off-by: James <namnh0122@gmail.com>

* some ui update

Signed-off-by: James <namnh0122@gmail.com>

* feat: modal migration UI  (#3153)

* feat: handle popup migration

* chore: update loader

* chore: integrate script migration

* chore: cleanup import

* chore: moving out spinner loader

* chore: update check thread message success migrate

* chore: add handle script into retry button

* remove warning from joi

Signed-off-by: James <namnh0122@gmail.com>

* chore: fix duplicate children

* fix: path after migrating model

Signed-off-by: James <namnh0122@gmail.com>

* chore: apply mutation for config

* chore: prevent calling too many create assistant api

Signed-off-by: James <namnh0122@gmail.com>

* using cortexso

Signed-off-by: James <namnh0122@gmail.com>

* update download api

Signed-off-by: James <namnh0122@gmail.com>

* fix use on slider item

Signed-off-by: James <namnh0122@gmail.com>

* fix: ui no download model or simple onboarding (#3166)

* fix download huggingface model match with slider item

Signed-off-by: James <namnh0122@gmail.com>

* update owner_logo to logo and author

Signed-off-by: James <namnh0122@gmail.com>

* update new cortexso

Signed-off-by: James <namnh0122@gmail.com>

* Add install python step for macos

* add engine table

Signed-off-by: James <namnh0122@gmail.com>

* fix local icons

Signed-off-by: James <namnh0122@gmail.com>

* feat: add search feature for model hub

Signed-off-by: James <namnh0122@gmail.com>

* fix misalign switch

Signed-off-by: James <namnh0122@gmail.com>

* fix: delete thread not focus on other thread

Signed-off-by: James <namnh0122@gmail.com>

* add get model from hugging face

Signed-off-by: James <namnh0122@gmail.com>

* fix download from hugging face

Signed-off-by: James <namnh0122@gmail.com>

* small update

Signed-off-by: James <namnh0122@gmail.com>

* update

Signed-off-by: James <namnh0122@gmail.com>

* fix system monitor rounded only on the left

Signed-off-by: James <namnh0122@gmail.com>

* chore: update ui new hub screen (#3174)

* chore: update ui new hub screen

* chore: update layout centerpanel thread and hub screen

* chore: update detail model by group

* update cortexso 0.1.13

Signed-off-by: James <namnh0122@gmail.com>

* chore: add file size

Signed-off-by: James <namnh0122@gmail.com>

* chore: put engine to experimental feature

Signed-off-by: James <namnh0122@gmail.com>

* chore: open cortex folder

Signed-off-by: James <namnh0122@gmail.com>

* chore: add back user avatar

Signed-off-by: James <namnh0122@gmail.com>

* chore: minor UI hub (#3182)

* chore: add back right click thread list and update 3 dots are overlapping with the text

* chore: update position dropdown list my models

* chore: make on-device tab showing 6 items instead of 4

* chore: update style description modals detail model

* chore: update isGeneration loader and author name on modal

* feat: integrate cortex single executable

Signed-off-by: James <namnh0122@gmail.com>

* fix build

Signed-off-by: James <namnh0122@gmail.com>

* chore: added blank state

* chore: update ui component blank state

* bump cortex binary version

* fix: logic show modal migration (#3165)

* fix: logic show modal migration

* chore: fixed logic

* chore: read contain format gguf local models

* chore: change return hasLocalModel

* chore: intiial skipmigration state

* chore: filter embedding model

* fix: delete top thread not focus on any other thread

* chore: added UI no result component search models group (#3188)

* fix: remote model should show all when user config that engine

Signed-off-by: James <namnh0122@gmail.com>

* chore: set state thread and models migration using getOnInit (#3189)

* chore: set state thread and models migration using getOnInit

* chore: add state as dependecies hooks

* chore: system monitor panel show engine model (#3192)

* fix: remove config api, replace with engine

Signed-off-by: James <namnh0122@gmail.com>

* update

Signed-off-by: James <namnh0122@gmail.com>

* update reactquery

Signed-off-by: James <namnh0122@gmail.com>

* bump cortex 0.4.35

* feat: add waiting for cortex popup

Signed-off-by: James <namnh0122@gmail.com>

* chore: add loader detail model popup (#3195)

* chore: model start loader (#3197)

* chore: added model loader when user starting chat without model active

* chore: update copies loader

* fix: select min file size if recommended quant does not exist

Signed-off-by: James <namnh0122@gmail.com>

* chore: temporary hide gpu config

* fix: tensorrt not shown

Signed-off-by: James <namnh0122@gmail.com>

* fix lint

Signed-off-by: James <namnh0122@gmail.com>

* fix tests

Signed-off-by: James <namnh0122@gmail.com>

* fix e2e tests (wip)

Signed-off-by: James <namnh0122@gmail.com>

* update

Signed-off-by: James <namnh0122@gmail.com>

* fix: adding element and correct test to adapt new UI

* fix: temp skip unstable part

* fix: only show models which can be supported

Signed-off-by: James <namnh0122@gmail.com>

* Update version.txt

* update send message

Signed-off-by: James <namnh0122@gmail.com>

* fix: not allow user send message when is generating

Signed-off-by: James <namnh0122@gmail.com>

* chore: temp skip Playwright test due to env issue

* chore: temp skip Playwright test due to env issue

* update

Signed-off-by: James <namnh0122@gmail.com>

* chore: minor-ui-feedback (#3202)

---------

Signed-off-by: James <namnh0122@gmail.com>
Co-authored-by: Louis <louis@jan.ai>
Co-authored-by: Faisal Amir <urmauur@gmail.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: Van Pham <64197333+Van-QA@users.noreply.github.com>
Co-authored-by: Van-QA <van@jan.ai>
2024-07-26 17:52:43 +07:00

229 lines
8.0 KiB
TypeScript

import { Fragment, useCallback, useEffect, useRef, useState } from 'react'
import { ResourceStatus } from '@janhq/core'
import { Progress } from '@janhq/joi'
import { useClickOutside } from '@janhq/joi'
import { fetchEventSource } from '@microsoft/fetch-event-source'
import { useAtom, useAtomValue } from 'jotai'
import {
MonitorIcon,
XIcon,
ChevronDown,
ChevronUp,
FolderOpenIcon,
} from 'lucide-react'
import { twMerge } from 'tailwind-merge'
import { toGibibytes } from '@/utils/converter'
import TableActiveModel from './TableActiveModel'
import { showSystemMonitorPanelAtom } from '@/helpers/atoms/App.atom'
import { hostAtom } from '@/helpers/atoms/AppConfig.atom'
import { reduceTransparentAtom } from '@/helpers/atoms/Setting.atom'
import {
cpuUsageAtom,
gpusAtom,
ramUtilitizedAtom,
totalRamAtom,
usedRamAtom,
} from '@/helpers/atoms/SystemBar.atom'
const SystemMonitor: React.FC = () => {
const host = useAtomValue(hostAtom)
const [usedRam, setUsedRam] = useAtom(usedRamAtom)
const [totalRam, setTotalRam] = useAtom(totalRamAtom)
const [cpuUsage, setCpuUsage] = useAtom(cpuUsageAtom)
const gpus = useAtomValue(gpusAtom)
const [showFullScreen, setShowFullScreen] = useState(false)
const ramUtilitized = useAtomValue(ramUtilitizedAtom)
const [showSystemMonitorPanel, setShowSystemMonitorPanel] = useAtom(
showSystemMonitorPanelAtom
)
const [control, setControl] = useState<HTMLDivElement | null>(null)
const [elementExpand, setElementExpand] = useState<HTMLDivElement | null>(
null
)
const reduceTransparent = useAtomValue(reduceTransparentAtom)
const abortControllerRef = useRef<AbortController | null>(null)
const onOpenAppLogClick = useCallback(() => {
window?.electronAPI?.openAppLog()
}, [])
const register = useCallback(async () => {
if (abortControllerRef.current) return
abortControllerRef.current = new AbortController()
await fetchEventSource(`${host}/events/resources`, {
onmessage(ev) {
if (!ev.data || ev.data === '') return
try {
const resourceEvent = JSON.parse(ev.data) as ResourceStatus
setUsedRam(resourceEvent.mem.used)
setTotalRam(resourceEvent.mem.total)
setCpuUsage(resourceEvent.cpu.usage)
} catch (err) {
console.error(err)
}
},
signal: abortControllerRef.current.signal,
})
}, [host, setTotalRam, setUsedRam, setCpuUsage])
const unregister = useCallback(() => {
if (!abortControllerRef.current) return
abortControllerRef.current.abort()
abortControllerRef.current = null
}, [])
useClickOutside(
() => {
setShowSystemMonitorPanel(false)
setShowFullScreen(false)
},
null,
[control, elementExpand]
)
useEffect(() => {
register()
return () => {
unregister()
}
}, [register, unregister])
return (
<Fragment>
<div
ref={setControl}
className={twMerge(
'flex cursor-pointer items-center gap-x-1 rounded px-1 py-0.5 hover:bg-[hsla(var(--secondary-bg))]',
showSystemMonitorPanel && 'bg-[hsla(var(--secondary-bg))]'
)}
onClick={() => {
setShowSystemMonitorPanel(!showSystemMonitorPanel)
setShowFullScreen(false)
}}
>
<MonitorIcon size={12} className="text-[hsla(var(--text-primary))]" />
<span className="font-medium">System Monitor</span>
</div>
{showSystemMonitorPanel && (
<div
ref={setElementExpand}
className={twMerge(
'fixed bottom-9 left-[49px] z-50 flex w-[calc(100%-48px-8px)] flex-shrink-0 flex-col rounded-lg rounded-b-none border-t border-[hsla(var(--app-border))] bg-[hsla(var(--app-bg))]',
showFullScreen && 'h-[calc(100%-63px)]',
reduceTransparent && 'w-[calc(100%-48px)] rounded-none'
)}
>
<div className="flex h-8 flex-shrink-0 items-center justify-between border-b border-[hsla(var(--app-border))] px-4">
<h6 className="font-medium text-[hsla(var(--text-primary))]">
Running Models
</h6>
<div className="unset-drag flex cursor-pointer items-center gap-x-2">
<div
className="flex cursor-pointer items-center gap-x-1 rounded px-1 py-0.5 hover:bg-[hsla(var(--secondary-bg))]"
onClick={() => onOpenAppLogClick()}
>
<FolderOpenIcon size={12} /> App Log
</div>
{showFullScreen ? (
<ChevronDown
size={20}
className="text-[hsla(var(--text-secondary))]"
onClick={() => setShowFullScreen(!showFullScreen)}
/>
) : (
<ChevronUp
size={20}
className="text-[hsla(var(--text-secondary))]"
onClick={() => setShowFullScreen(!showFullScreen)}
/>
)}
<XIcon
size={16}
className="text-[hsla(var(--text-secondary))]"
onClick={() => {
setShowSystemMonitorPanel(false)
setShowFullScreen(false)
}}
/>
</div>
</div>
<div className="flex h-full gap-4">
<TableActiveModel />
<div className="w-1/2 border-l border-[hsla(var(--app-border))] p-4">
<div className="mb-4 border-b border-[hsla(var(--app-border))] pb-4">
<h6 className="font-bold">CPU</h6>
<div className="flex items-center gap-x-4">
<Progress value={cpuUsage} className="w-full" size="small" />
<span className="flex-shrink-0 ">{cpuUsage}%</span>
</div>
</div>
<div className="mb-4 border-b border-[hsla(var(--app-border))] pb-4">
<div className="flex items-center justify-between gap-2">
<h6 className="font-bold">Memory</h6>
<span>
{toGibibytes(usedRam, { hideUnit: true })}/
{toGibibytes(totalRam, { hideUnit: true })} GB
</span>
</div>
<div className="flex items-center gap-x-4">
<Progress
value={Math.round((usedRam / totalRam) * 100)}
className="w-full"
size="small"
/>
<span className="flex-shrink-0 ">{ramUtilitized}%</span>
</div>
</div>
{gpus.length > 0 && (
<div className="mb-4 border-b border-[hsla(var(--app-border))] pb-4 last:border-none">
{gpus.map((gpu, index) => (
<div key={index} className="mt-4 flex flex-col gap-x-2">
<div className="flex w-full items-start justify-between">
<span className="line-clamp-1 w-1/2 font-bold">
{gpu.name}
</span>
<div className="flex gap-x-2">
<div className="">
<span>
{gpu.memoryTotal - gpu.memoryFree}/
{gpu.memoryTotal}
</span>
<span> MB</span>
</div>
</div>
</div>
<div className="flex items-center gap-x-4">
<Progress
value={gpu.utilization}
className="w-full"
size="small"
/>
<span className="flex-shrink-0 ">
{gpu.utilization}%
</span>
</div>
</div>
))}
</div>
)}
</div>
</div>
</div>
)}
</Fragment>
)
}
export default SystemMonitor