Feat/local endpoint llm (#148)

* serve local model in a different process from the app
---------

Co-authored-by: albert <albert@cinnamon.is>
Co-authored-by: trducng <trungduc1992@gmail.com>
This commit is contained in:
ian_Cin
2024-03-15 16:17:33 +07:00
committed by GitHub
parent 2950e6ed02
commit df12dec732
20 changed files with 675 additions and 79 deletions

3
.gitignore vendored
View File

@@ -466,4 +466,5 @@ examples/example1/assets
storage/*
# Conda and env storages
install_dir/
*install_dir/
doc_env