kotaemon/libs/ktem
ian_Cin df12dec732 Feat/local endpoint llm (#148)
* serve local model in a different process from the app
---------

Co-authored-by: albert <albert@cinnamon.is>
Co-authored-by: trducng <trungduc1992@gmail.com>
2024-03-15 16:17:33 +07:00
..
khapptests Update docs (#106) 2024-01-30 18:50:17 +07:00
ktem Feat/local endpoint llm (#148) 2024-03-15 16:17:33 +07:00
migrations Optionally allow database migration with Alembic 2024-01-28 19:54:15 +07:00
.gitignore Make ktem official (#134) 2024-01-23 10:54:18 +07:00
alembic.ini Optionally allow database migration with Alembic 2024-01-28 19:54:15 +07:00
flowsettings.py Feat/local endpoint llm (#148) 2024-03-15 16:17:33 +07:00
launch.py Feat/local endpoint llm (#148) 2024-03-15 16:17:33 +07:00
MANIFEST.in Improve kotaemon based on insights from projects (#147) 2024-02-28 22:18:29 +07:00
pyproject.toml Create user management functionality (#152) 2024-03-07 14:19:37 +07:00
README.md Make ktem official (#134) 2024-01-23 10:54:18 +07:00
requirements.txt Make ktem official (#134) 2024-01-23 10:54:18 +07:00

Example of MVP pipeline for example

Prerequisite

To run the system out-of-the-box, please supply the following environment variables:

OPENAI_API_KEY=
OPENAI_API_BASE=
OPENAI_API_VERSION=
SERPAPI_API_KEY=
COHERE_API_KEY=
OPENAI_API_KEY_EMBEDDING=

# optional
KH_APP_NAME=

Run

gradio launch.py