11 commits

Author	SHA1	Message	Date
mudler	b710147b95	Add mutex on same models (parallel isn't supported yet)	2023-04-08 11:45:36 +02:00
mudler	ba70363330	Use template input	2023-04-08 11:24:25 +02:00
mudler	9fb581739b	Allow to template model prompts inputs	2023-04-08 10:46:51 +02:00
mudler	12eee097b7	Make it compatible with openAI api, support multiple models ... Signed-off-by: mudler <mudler@c3os.io>	2023-04-07 11:30:59 +02:00
mudler	b33d015b8c	Use go-llama.cpp	2023-04-07 10:08:15 +02:00
mudler	e860e62036	Add mutex, build only lite images	2023-03-27 01:01:38 +02:00
mudler	abee34f60a	Cleanup leftover	2023-03-25 01:10:50 +01:00
mudler	dbc70dc13c	Add a simple web-page as index of the API for helping with inference testing	2023-03-25 01:09:51 +01:00
mudler	9ba30c9c44	Update llama-go, allow to set context-size and enable alpaca model by default	2023-03-21 19:20:23 +01:00
mudler	2ce1d51ad5	No need to set 0 for default context anymore	2023-03-20 00:12:26 +01:00
mudler	d4720150b5	First import	2023-03-18 23:59:06 +01:00