mirror of
https://github.com/mudler/LocalAI.git
synced 2025-05-31 07:54:59 +00:00
tests: add rwkv (#261)
This commit is contained in:
parent
76a1267799
commit
a035de2fdd
5 changed files with 49 additions and 2 deletions
19
tests/fixtures/rwkv.yaml
vendored
Normal file
19
tests/fixtures/rwkv.yaml
vendored
Normal file
|
@ -0,0 +1,19 @@
|
|||
name: rwkv_test
|
||||
parameters:
|
||||
model: rwkv
|
||||
top_k: 80
|
||||
temperature: 0.9
|
||||
max_tokens: 100
|
||||
top_p: 0.8
|
||||
context_size: 1024
|
||||
threads: 14
|
||||
backend: "rwkv"
|
||||
cutwords:
|
||||
- "Bob:.*"
|
||||
roles:
|
||||
user: "Bob:"
|
||||
system: "Alice:"
|
||||
assistant: "Alice:"
|
||||
template:
|
||||
completion: rwkv_completion
|
||||
chat: rwkv_chat
|
13
tests/fixtures/rwkv_chat.tmpl
vendored
Normal file
13
tests/fixtures/rwkv_chat.tmpl
vendored
Normal file
|
@ -0,0 +1,13 @@
|
|||
The following is a verbose detailed conversation between Bob and a woman, Alice. Alice is intelligent, friendly and likeable. Alice is likely to agree with Bob.
|
||||
|
||||
Bob: Hello Alice, how are you doing?
|
||||
|
||||
Alice: Hi Bob! Thanks, I'm fine. What about you?
|
||||
|
||||
Bob: I am very good! It's nice to see you. Would you mind me chatting with you for a while?
|
||||
|
||||
Alice: Not at all! I'm listening.
|
||||
|
||||
{{.Input}}
|
||||
|
||||
Alice:
|
1
tests/fixtures/rwkv_completion.tmpl
vendored
Normal file
1
tests/fixtures/rwkv_completion.tmpl
vendored
Normal file
|
@ -0,0 +1 @@
|
|||
Complete the following sentence: {{.Input}}
|
Loading…
Add table
Add a link
Reference in a new issue