Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: Adjust model hub v0.4.13 #2879

Merged
merged 39 commits into from
May 13, 2024
Merged

Feat: Adjust model hub v0.4.13 #2879

Changes from 1 commit
Commits
Show all changes
39 commits
Select commit Hold shift click to select a range
500ed5d
fix: correct phi3
hahuyhoang411 May 8, 2024
33e53e5
redundant phi2 dolphin
hahuyhoang411 May 8, 2024
4489413
add: hermes llama3
hahuyhoang411 May 8, 2024
e345931
add: ngl settings
hahuyhoang411 May 8, 2024
fe79079
correct ctx len
hahuyhoang411 May 8, 2024
1c4d256
correct ngl
hahuyhoang411 May 8, 2024
cd41e5c
correct maxlen ngl
hahuyhoang411 May 8, 2024
a5fd13d
disable phi3
hahuyhoang411 May 8, 2024
a369581
add ngl
hahuyhoang411 May 8, 2024
0ba3dde
add ngl
hahuyhoang411 May 8, 2024
627013e
add ngl
hahuyhoang411 May 8, 2024
7fd1637
add ngl
hahuyhoang411 May 8, 2024
e173a40
add ngl
hahuyhoang411 May 8, 2024
8e471a3
add ngl
hahuyhoang411 May 8, 2024
8bd880c
add ngl
hahuyhoang411 May 8, 2024
fc6b075
remove redundant hermes pro
hahuyhoang411 May 8, 2024
8b511e1
add ngl
hahuyhoang411 May 8, 2024
1a8f96e
add ngl
hahuyhoang411 May 8, 2024
ee95ffe
add ngl
hahuyhoang411 May 8, 2024
2645df7
remove miqu
hahuyhoang411 May 8, 2024
a2587a1
add ngl
hahuyhoang411 May 8, 2024
15c8146
add ngl
hahuyhoang411 May 8, 2024
baa2fb4
add ngl
hahuyhoang411 May 8, 2024
e840a3f
add ngl
hahuyhoang411 May 8, 2024
13f80dc
remove redundant
hahuyhoang411 May 8, 2024
8f276fc
add ngl
hahuyhoang411 May 8, 2024
1b9f302
add ngl
hahuyhoang411 May 8, 2024
710fc25
add ngl
hahuyhoang411 May 8, 2024
fd38f75
add ngl
hahuyhoang411 May 8, 2024
4484231
add ngl
hahuyhoang411 May 8, 2024
5747c4d
add ngl
hahuyhoang411 May 8, 2024
2ff1a16
add ngl
hahuyhoang411 May 8, 2024
ba34c43
add ngl
hahuyhoang411 May 8, 2024
bb2b440
add ngl
hahuyhoang411 May 8, 2024
6d58a2e
version package bump
hahuyhoang411 May 8, 2024
9c07126
feat: resolve issue of cannot found model in the extensions due to th…
May 13, 2024
3f25920
feat: completely remove hermes-pro-7b
May 13, 2024
f3b84b9
feat: completely remove openhermes-neural-7b and miqu-70b, and add ll…
May 13, 2024
18eb3b5
fix: correct description
hahuyhoang411 May 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add ngl
  • Loading branch information
@hahuyhoang411
hahuyhoang411 committed May 8, 2024
commit 0ba3ddead2cf6b9e9872991551a4bbc39b2caf8c
3 changes: 2 additions & 1 deletion extensions/inference-nitro-extension/resources/models/command-r-34b/model.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 14,8 @@
"settings": {
"ctx_len": 131072,
"prompt_template": "<|START_OF_TURN_TOKEN|><|USER_TOKEN|>{prompt}<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>",
"llama_model_path": "c4ai-command-r-v01-Q4_K_M.gguf"
"llama_model_path": "c4ai-command-r-v01-Q4_K_M.gguf",
"ngl": 64
},
"parameters": {
"temperature": 0.7,
Expand Down
Loading