Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: use modelId instead of sessionId for unloading

Browse Source 
The loop now extracts session info to retrieve the model ID, ensuring correct unloading of sessions by their associated model identifiers rather than session IDs. This aligns the cleanup process with the actual model resources being managed.
This commit is contained in:
Akarshan Biswas 2025-06-02 06:42:29 +05:30 committed by Louis
parent e3d6cbd80f
commit 331c0e04a5
No known key found for this signature in database
GPG Key ID: 44FA9F4D33C37DE2
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
extensions/llamacpp-extension/src/index.ts
View File

@ -139,11 +139,11 @@ export default class llamacpp_extension extends AIEngine {
override async onUnload(): Promise<void> {
// Terminate all active sessions
for (const [sessionId, _] of this.activeSessions) {
for (const [_, sInfo] of this.activeSessions) {
try {
await this.unload(sessionId)
await this.unload(sInfo.modelId)
} catch (error) {
console.error(`Failed to unload session ${sessionId}:`, error)
console.error(`Failed to unload model ${sInfo.modelId}:`, error)
}
}