kotaemon/knowledgehub
Nguyen Trung Duc (john) f8b8d86d4e Move LLM-related components into LLM module (#74)
* Move splitter into indexing module
* Rename post_processing module to parsers
* Migrate LLM-specific composite pipelines into llms module

This change moves the `splitters` module into `indexing` module. The `indexing` module will be created soon, to house `indexing`-related components.

This change renames `post_processing` module into `parsers` module. Post-processing is a generic term which provides very little information. In the future, we will add other extractors into the `parser` module, like Metadata extractor...

This change migrates the composite elements into `llms` module. These elements heavily assume that the internal nodes are llm-specific. As a result, migrating these elements into `llms` module will make them more discoverable, and simplify code base structure.
2023-11-15 16:26:53 +07:00
..
base Move Document and other interface into base/schema (#69) 2023-11-14 11:51:10 +07:00
chatbot Move Document and other interface into base/schema (#69) 2023-11-14 11:51:10 +07:00
contribs Upgrade the declarative pipeline for cleaner interface (#51) 2023-10-24 11:12:22 +07:00
embeddings Use new Langchain's dedicated Azure OpenAI embedding class (#76) 2023-11-15 14:46:32 +07:00
indexing Move LLM-related components into LLM module (#74) 2023-11-15 16:26:53 +07:00
llms Move LLM-related components into LLM module (#74) 2023-11-15 16:26:53 +07:00
loaders Move Document and other interface into base/schema (#69) 2023-11-14 11:51:10 +07:00
parsers Move LLM-related components into LLM module (#74) 2023-11-15 16:26:53 +07:00
pipelines Move LLM-related components into LLM module (#74) 2023-11-15 16:26:53 +07:00
storages Combine docstores and vectorstores within a storages component (#72) 2023-11-14 17:50:57 +07:00
__init__.py Move prompts into LLMs module (#70) 2023-11-14 16:00:10 +07:00
cli.py Provide ready binary for Mac and Linux to do sharing tunneling (#49) 2023-10-17 17:19:29 +07:00