dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-28 14:35:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 12

chianlit example (#1238)

Browse source
This commit is contained in:
Samuel Walker 2023-11-02 17:56:46 -04:00 • committed by GitHub
parent 035fea676a
commit 23c7fbfe6b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
5 changed files with 146 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

25
examples/chainlit/README.md Normal file
View file

@ -0,0 +1,25 @@
# LocalAI Demonstration with Embeddings and Chainlit
This demonstration shows you how to use embeddings with existing data in `LocalAI`, and how to integrate it with Chainlit for an interactive querying experience. We are using the `llama_index` library to facilitate the embedding and querying processes, and `chainlit` to provide an interactive interface. The `Weaviate` client is used as the embedding source.
## Prerequisites
Before proceeding, make sure you have the following installed:
- Weaviate client
- LocalAI and its dependencies
- Chainlit and its dependencies
## Getting Started
1. Clone this repository:
2. Navigate to the project directory:
3. Run the example: `chainlit run main.py`
# Highlight on `llama_index` and `chainlit`
`llama_index` is the key library that facilitates the process of embedding and querying data in LocalAI. It provides a seamless interface to integrate various components, such as `WeaviateVectorStore`, `LocalAI`, `ServiceContext`, and more, for a smooth querying experience.
`chainlit` is used to provide an interactive interface for users to query the data and see the results in real-time. It integrates with llama_index to handle the querying process and display the results to the user.
In this example, `llama_index` is used to set up the `VectorStoreIndex` and `QueryEngine`, and `chainlit` is used to handle the user interactions with `LocalAI` and display the results.