dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-21 02:55:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

Update README

Browse source
This commit is contained in:
mudler 2023-04-13 01:28:15 +02:00
parent d426571789
commit e786576b95
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
README.md
View file

@ -55,7 +55,7 @@ Below is an instruction that describes a task. Write a response that appropriate
To begin, run: To begin, run:
``` ```
docker run -ti --rm quay.io/go-skynet/llama-cli:v0.6 --instruction "What's an alpaca?" --topk 10000 --model ... docker run -ti --rm quay.io/go-skynet/llama-cli:latest --instruction "What's an alpaca?" --topk 10000 --model ...
``` ```
Where `--model` is the path of the model you want to use. Where `--model` is the path of the model you want to use.
@ -64,7 +64,7 @@ Note: you need to mount a volume to the docker container in order to load a mode
``` ```
# assuming your model is in /path/to/your/models/foo.bin # assuming your model is in /path/to/your/models/foo.bin
docker run -v /path/to/your/models:/models -ti --rm quay.io/go-skynet/llama-cli:v0.6 --instruction "What's an alpaca?" --topk 10000 --model /models/foo.bin docker run -v /path/to/your/models:/models -ti --rm quay.io/go-skynet/llama-cli:latest --instruction "What's an alpaca?" --topk 10000 --model /models/foo.bin
``` ```
You will receive a response like the following: You will receive a response like the following:
@ -109,7 +109,7 @@ This will generate text based on the given model and instruction.
Example of starting the API with `docker`: Example of starting the API with `docker`:
```bash ```bash
docker run -p 8080:8080 -ti --rm quay.io/go-skynet/llama-cli:v0.6 api --models-path /path/to/models --context-size 700 --threads 4 docker run -p 8080:8080 -ti --rm quay.io/go-skynet/llama-cli:latest api --models-path /path/to/models --context-size 700 --threads 4
``` ```
And you'll see: And you'll see: