kotaemon

Author	SHA1	Message	Date
Nguyen Trung Duc (john)	98c76c4700	Refactor excel Loader (#79 )	2023-11-16 11:30:11 +07:00
Nguyen Trung Duc (john)	8532138842	Move Document and other interface into base/schema (#69 )	2023-11-14 11:51:10 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)	4704e2c11a	Add new OCRReader with PDF+OCR text merging (#66 ) This change speeds up OCR extraction by allowing bypassing OCR for texts that are irrelevant (not in table). --------- Co-authored-by: Nguyen Trung Duc (john) <trungduc1992@gmail.com>	2023-11-13 17:43:02 +07:00
ian_Cin	6095526dc7	Add Huggingface embeddings and Cohere embeddings (#63 ) * Add huggingface embeddings and cohere embeddings * Update openai interface and the mock for newer OpenAI SDK --------- Co-authored-by: trducng <trungduc1992@gmail.com>	2023-11-10 09:38:30 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)	56bc41b673	Update Base interface of Index/Retrieval pipeline (#36 ) * add base Tool * minor update test_tool * update test dependency * update test dependency * Fix namespace conflict * update test * add base Agent Interface, add ReWoo Agent * minor update * update test * fix typo * remove unneeded print * update rewoo agent * add LLMTool * update BaseAgent type * add ReAct agent * add ReAct agent * minor update * minor update * minor update * minor update * update base reader with BaseComponent * add splitter * update agent and tool * update vectorstores * update load/save for indexing and retrieving pipeline * update test_agent for more use-cases * add missing dependency for test * update test case for in memory vectorstore * add TextSplitter to BaseComponent * update type hint basetool --------- Co-authored-by: trducng <trungduc1992@gmail.com>	2023-10-04 14:27:44 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)	6c3d614973	[AUR-432] Add layout-aware table parsing PDF reader (#27 ) * add OCRReader, MathPixReader and ExcelReader * update test case for ocr reader * reformat * minor fix	2023-09-26 15:52:44 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)	21350153d4	[AUR-391, AUR-393] Add Document and DocumentReader base (#6 ) * Declare BaseComponent * Brainstorming base class for LLM call * Define base LLM * Add tests * Clean telemetry environment for accurate testing * Fix README * Fix typing * add base document reader * update test * update requirements * Cosmetic change * update requirements * reformat --------- Co-authored-by: trducng <trungduc1992@gmail.com>	2023-08-31 11:24:12 +07:00
ian_Cin	5241edbc46	[AUR-361] Setup pre-commit, pytest, GitHub actions, ssh-secret (#3 ) Co-authored-by: trducng <trungduc1992@gmail.com>	2023-08-30 07:22:01 +07:00
trducng	043209fda7	Initiate repository	2023-08-16 14:56:48 +07:00

9 Commits