Nicholai/jan
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update max_tokens for llama-3.1-8b-instant

Browse Source
This commit is contained in:
Sharun 2024-10-19 19:43:33 -04:00
parent 331e2bd35c
commit 72d178f3c3
No known key found for this signature in database
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extensions/inference-groq-extension/resources/models.json
View File

@ -106,7 +106,7 @@
"format": "api", "format": "api",
"settings": {}, "settings": {},
"parameters": { "parameters": {
"max_tokens": 8192, "max_tokens": 8000,
"temperature": 0.7, "temperature": 0.7,
"top_p": 0.95, "top_p": 0.95,
"stream": true, "stream": true,