tests: add rwkv (#261)

This commit is contained in:
Ettore Di Giacinto 2023-05-15 08:15:01 +02:00 committed by GitHub
parent 76a1267799
commit a035de2fdd
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
5 changed files with 49 additions and 2 deletions

19
tests/fixtures/rwkv.yaml vendored Normal file
View file

@ -0,0 +1,19 @@
name: rwkv_test
parameters:
model: rwkv
top_k: 80
temperature: 0.9
max_tokens: 100
top_p: 0.8
context_size: 1024
threads: 14
backend: "rwkv"
cutwords:
- "Bob:.*"
roles:
user: "Bob:"
system: "Alice:"
assistant: "Alice:"
template:
completion: rwkv_completion
chat: rwkv_chat

13
tests/fixtures/rwkv_chat.tmpl vendored Normal file
View file

@ -0,0 +1,13 @@
The following is a verbose detailed conversation between Bob and a woman, Alice. Alice is intelligent, friendly and likeable. Alice is likely to agree with Bob.
Bob: Hello Alice, how are you doing?
Alice: Hi Bob! Thanks, I'm fine. What about you?
Bob: I am very good! It's nice to see you. Would you mind me chatting with you for a while?
Alice: Not at all! I'm listening.
{{.Input}}
Alice:

1
tests/fixtures/rwkv_completion.tmpl vendored Normal file
View file

@ -0,0 +1 @@
Complete the following sentence: {{.Input}}