Public/kotaemon
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
304 Commits 1 Branch 0 Tags 15 MiB
952026da6c
Commit Graph

170 Commits

Author SHA1 Message Date
Varun Sharma
952026da6c
fix: ValueError breaks Ui #629 (#630) #none 2025-02-14 21:33:35 +07:00
Jinke
8b04f8475a
fix: encoding error after brand new installation (#654) #none 
fix: encoding error after brand new installation
 2025-02-14 21:32:39 +07:00
Varun Sharma
e3921f7704
fix: selecting search all does not work on LightRAG / NanoGraphRAG (#627) #none 
* fix: base path

* fix: select all doesn't work

* fix: adding new documents should update the existing index within the file collection instead of creating new one #561

* fix linter issues

* feat: update NanoGraphRAG with global collection search

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2025-02-14 21:13:39 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
0b090896fd
feat: add support for reasoning llm with thought visualization (#652) bump:patch 
* fix: lanceDB query with empty file_ids

* feat: add thinking display

* feat: add low request mode for local llm
 2025-02-05 13:45:12 +07:00
Hideyuki Kagami
f5b2200ffa
fix: update parameter name in AzureAIDocumentIntelligenceLoader (#593) bump:patch 2025-02-03 08:10:10 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
756f46893f
fix: lightrag settings (#649) #none 
* Update lightrag_pipelines.py

* Update nano_pipelines.py

* fix: lightrag setting prompts

---------

Co-authored-by: RoadToNowhereX <37441177+RoadToNowhereX@users.noreply.github.com>
 2025-02-03 08:07:53 +07:00
Tadashi
3b87945ab0
fix: plotly requirements #none 2025-02-02 18:58:37 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
3bd3830b8d
feat: sso login, demo mode & new mindmap support (#644) bump:minor 
* fix: update .env.example

* feat: add SSO login

* fix: update flowsetting

* fix: add requirement

* fix: refine UI

* fix: update group id-based operation

* fix: improve citation logics

* fix: UI enhancement

* fix: user_id to string in models

* fix: improve chat suggestion UI and flow

* fix: improve group id handling

* fix: improve chat suggestion

* fix: secure download for single file

* fix: file limiting in docstore

* fix: improve chat suggestion logics & language conform

* feat: add markmap and select text to highlight function

* fix: update Dockerfile

* fix: user id auto generate

* fix: default user id

* feat: add demo mode

* fix: update flowsetting

* fix: revise default params for demo

* feat: sso_app alternative

* feat: sso login demo

* feat: demo specific customization

* feat: add login using API key

* fix: disable key-based login

* fix: optimize duplicate upload

* fix: gradio routing

* fix: disable arm build for demo

* fix: revise full-text search js logic

* feat: add rate limit

* fix: update Dockerfile with new launch script

* fix: update Dockerfile

* fix: update Dockerignore

* fix: update ratelimit logic

* fix: user_id in user management page

* fix: rename conv logic

* feat: update demo hint

* fix: minor fix

* fix: highlight on long PDF load

* feat: add HF paper list

* fix: update HF papers load logic

* feat: fly config

* fix: update fly config

* fix: update paper list pull api

* fix: minor update root routing

* fix: minor update root routing

* fix: simplify login flow & paper list UI

* feat: add paper recommendation

* fix: update Dockerfile

* fix: update Dockerfile

* fix: update default model

* feat: add long context Ollama through LCOllama

* feat: espose Gradio share to env

* fix: revert customized changes

* fix: list group at app load

* fix: relocate share conv button

* fix: update launch script

* fix: update Docker CI

* feat: add Ollama model selection at first setup

* docs: update README
 2025-02-02 15:19:48 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
5343d0d3ee
fix: openai async (#585) bump:patch 2024-12-24 09:45:15 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
95191f53d9
feat: add web search (#580) bump:patch 
* feat: add web search

* feat: update requirements
 2024-12-23 09:28:24 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
4fe080737a
fix: improve citation logic (#578) bump:patch 2024-12-18 20:27:53 +07:00
Tadashi
3bd19f399f
fix: tei_fast_rerank logic bump:patch 2024-12-17 17:33:47 +07:00
Elias Judin
54320d08df
feat(loader): implement markdown parsing in MathpixPDFReader (#498) 
* ✨ feat(loader): implement markdown parsing in MathpixPDFReader

Add functionality to properly handle PDF content:
- Add parse_markdown_text_to_tables method to separate tables and text
- Fix load_data implementation to properly process documents
- Fix lazy_load_data method
- Improve document metadata handling for tables and text sections

The loader now correctly processes PDFs through Mathpix API and converts content to proper Document objects.

* fix(loader): remove super() calls blocking MathpixPDFReader implementation

Remove early returns using super() in load_data and lazy_load_data methods that were preventing the actual implementation from being executed. This fixes the "not implemented" error while maintaining the full PDF reader functionality.
 2024-12-17 17:30:17 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
cd87a7e35f
fix: UI tab name and reranking process for TeiFastReranking (#576) 
* fix: update user-management.md

* fix: reranking process when TeiFastReranking is specified.

---------

Co-authored-by: Ryuichi Takano <45957617+tknrych@users.noreply.github.com>
Co-authored-by: Ryuichi Takano <ryuichi.takano@jp.ricoh.com>
 2024-12-17 17:23:54 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
9039b4f32b
fix: using a base path breaks file preview (#575) 
* fix: using a base path breaks file preview

* fix: comfort precommit

---------

Co-authored-by: Varun Sharma <contactvarun27@gmail.com>
 2024-12-17 17:12:27 +07:00
eddprogrammer
a8b8fcea32
fix: add retry to lightrag llm_func call (#572) 
* add retry to lightrag llm_func call

* fix: update logic for nanographrag

---------

Co-authored-by: Song Lin <song.lin@kirkland.com>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-12-17 17:02:06 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
1d3c4f4433
feat: add graphrag modes (#574) #none 
* feat: add support for retrieval modes in LightRAG & NanoGraphRAG

* feat: expose custom prompts in LightRAG & NanoGraphRAG

* fix: optimize setting UI

* fix: update non local mode in LightRAG

* fix: update graphRAG mode
 2024-12-17 16:49:37 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
7a02cb72af
feat: add URL indexing directly from chat input (#571) bump:patch 
* feat: enable lightrag by default and add graphrag key check

* feat: add URL indexing from chatbox
 2024-12-15 23:13:52 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
a0c9a6e8de
feat: add quick setting for follow up chat suggestions & add more common languages (#556) bump:patch 
* feat: add chat suggestion quick setting

* feat: add more common languages

* fix: minor fixes
 2024-12-07 09:19:21 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6650b15c64
feat: add citation style quick setting (#554) bump:patch 2024-12-05 19:55:59 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b016a84b97
feat: add Google embedding support & update setup (#550) bump:patch 2024-12-04 11:09:57 +07:00
Pedro Lima
159f4da7c9
fix: Remove Collections from all index names (#473) 
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-12-04 09:40:46 +07:00
Tran Huu Hoang
32732c35de
feat: set user being able to set chunk size and overlap for indices (#524) 
* use tzlocal to get the local time

* delete tmp folder

* update date_created and date_updated with current timezone

* pass precommit

* update date_created field default by local time

* add chunk size and chunk overlap param for indices

* refactor code to pass pre-commit

* fix: minor update logics

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-12-04 09:04:50 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
a1fecfac45
feat: add toggle for conversation control sidebar (#546) #none 2024-12-04 07:53:28 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
ab6b3fc529
feat: add quick file selection upon tagging on Chat input (#533) bump:patch 
* fix: improve inline citation logics without rag

* fix: improve explanation for citation options

* feat: add quick file selection on Chat input
 2024-11-28 21:12:56 +07:00
Tadashi
f15abdbb23
fix: improve inline citation parsing bump:patch 2024-11-26 20:52:03 +07:00
Tadashi
f3a2a293f2
fix: remove debug print #none 2024-11-25 16:07:56 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
7e34e4343b
feat: add inline citation style (#523) bump:minor 
* feat: add URL quick index, export mindmap, refine UI & animation

* fix: inject multimodal mode from env var

* fix: minor update css

* feat: add citation inline mode

* fix: minor update citation inline pipeline

* feat: add citation quick setting

* fix: minor update

* fix: minor update
 2024-11-25 12:07:02 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
013f6f4103
fix: code block overflow in chat (#509) bump:patch 2024-11-20 16:08:31 +07:00
Tadashi
747bff8ee0
fix: minor update bump:patch 2024-11-19 13:39:04 +07:00
Tadashi
8b454db888
fix: Gradio table display with Firefox 2024-11-19 13:35:47 +07:00
Tadashi
db2737d309
fix: relocate information panel expand button bump:patch 2024-11-18 16:45:08 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
74124323e8
feat: refine UI and add go to chat btn (#500) bump:minor 2024-11-18 14:48:15 +07:00
Quang (Albert)
56c40f1c05
feat: integrate with docling (#471) bump:patch 
* feat: add docling reader implementation

* feat: expose docling to UI

* fix: improve docling output parsing

* docs: update README

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-16 10:04:57 +07:00
cin-cris
5b828c213c
fix: fix Application UI using UTC time (#472) bump:patch 
* use tzlocal to get the local time

* delete tmp folder

* update date_created and date_updated with current timezone

* pass precommit

* update date_created field default by local time
 2024-11-11 16:51:38 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6a81c77dd8
fix: update Docker file for graphrag (#477) #none 2024-11-08 17:00:51 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
aeace96c48
feat: add lightrag support (#474) bump:patch 
* feat: add lightrag support

* docs: update README
 2024-11-07 17:22:41 +07:00
Pedro Lima
908452cc18
allow chunk_overlap with zero value (#457) #none 
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-05 14:12:52 +07:00
KennyWu
d127fec9f7
feat: support for visualizing citation results (via embeddings) (#461) 
* feat:support for visualizing citation results (via embeddings)

Signed-off-by: Kennywu <jdlow@live.cn>

* fix: remove ktem dependency in visualize_cited

* fix: limit onnx version for fastembed

* fix: test case of indexing

* fix: minor update

* fix: chroma req

* fix: chroma req

---------

Signed-off-by: Kennywu <jdlow@live.cn>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-05 14:02:57 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
bd2490bef1
fix: clean chatUI and simplify regen logic (#452) bump:patch 2024-11-02 17:19:10 +07:00
Tadashi
fb241a467c
fix: nano-graphrag import when not installed 2024-10-31 09:22:55 +07:00
Tadashi
cce3639074
fix: update pymupdf version in requirements 2024-10-31 08:32:16 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
280f0d58ce
fix: rewoo citation (#441) #none 2024-10-30 16:20:21 +07:00
cin-klein
66e565649e
feat: integrate nano-graphrag (#433) 
* add nano graph-rag

* ignore entities for relevant context reference

* refactor and add local model as default nano-graphrag

* feat: add kotaemon llm & embedding integration with nanographrag

* fix: add env var for nano GraphRAG

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-10-30 15:32:30 +07:00
Khoi-Nguyen Nguyen-Ngoc
19b386b51e
fix: pin python-multipart version to avoid yanking issues with micropip (#436) 2024-10-28 15:13:47 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
f2f192ed72
feat: add toggle dark mode button on main Chat UI (#423) 
* feat: add toggle dark mode button on main UI

* docs: update docs
 2024-10-22 18:48:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
764fe595f4
feat: add file grouping feature (#416) bump:patch 2024-10-21 12:47:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
e6fa1af404
feat: add mindmap visualization (#405) bump:minor 2024-10-17 14:35:28 +07:00
a652
4764b0e82a
fix: update adobe_loader (#399) bump:patch 
* Update adobe_loader.py

fix:When initializing the Document, extra_info was not added to the metadata.

* Update adobe_loader.py

Change the method of checking whether extra_info is None.
 2024-10-16 11:01:55 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b113efc855
feat: add web URL loader & refine indexing logics (#397) 
* feat: add web URL loader & refine indexing logics

* fix: comfort mypy
 2024-10-15 22:42:24 +07:00