docs(phi-2): add example (#1525)

This commit is contained in:
Ettore Di Giacinto 2024-01-01 04:51:47 -05:00 committed by GitHub
parent 726fe416bb
commit f068efe509
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 26 additions and 0 deletions

View file

@ -67,6 +67,17 @@ curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/jso
```
### Phi-2
```
cp -r examples/configurations/phi-2.yaml models/
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "phi-2",
"messages": [{"role": "user", "content": "How are you doing?", "temperature": 0.1}]
}'
```
### Mixtral
```