Commit Graph

20 Commits

Author SHA1 Message Date
Vinod Kiran 40e36d1b39
Feature/DocumentStore (#2106)
* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-06 15:23:27 +01:00
abhishekshankr 6e68df0d27 Update icons 2023-12-18 03:51:21 -05:00
Henry 039d8d26be expand text file supported file types 2023-10-31 16:32:33 +00:00
vinodkiran cd6538c5f2 Spelling Corrections. 2023-10-26 11:11:10 +05:30
Henry 57bfd5f1b1 add json parse fix 2023-10-25 13:53:33 +01:00
Henry 2f021b4837 add custom separators 2023-10-17 23:43:22 +01:00
Henry 05dd23b01d - update marketplaces
- add version to nodes and credentials
- hover over node actions
2023-07-28 15:56:40 +01:00
Rafael Reis b4b7ccdbd7 clean code 2023-07-16 01:34:18 -03:00
Rafael Kvitko Reis 1f8fcb3983 HtmlToMarkdownTextSplitter 2023-07-16 01:05:26 -03:00
Henry 1c4880f665 change latext splitter to code splitter 2023-06-16 15:39:49 +01:00
Pravesh-mansharamani 17318ad7bb Added the LatexTextSplitter 2023-06-15 07:27:07 +05:30
Ong Chung Yau 6001ed6ecf
Merge pull request #64 from FlowiseAI/feature/MarkdownTextSplitter
add markdown text splitter
2023-05-08 19:29:19 +07:00
Ong Chung Yau 5e25d419a4
Merge pull request #65 from FlowiseAI/feature/CharacterTextSplitter
add character text splitter
2023-05-08 19:29:09 +07:00
Ong Chung Yau c0cf8f3309
Merge pull request #66 from FlowiseAI/bugfix/RecursiveCharacterTextSplitter
fix typo in description of recursive character text splitter
2023-05-08 19:28:59 +07:00
chungyau97 61a0cee551 add token text splitter 2023-05-06 11:46:50 +07:00
chungyau97 3db4639d4e fix typo in description of recursive character text splitter 2023-05-06 10:58:27 +07:00
chungyau97 f75d6d3791 add character text splitter 2023-05-06 10:46:37 +07:00
chungyau97 9682f62b2c add markdown text splitter 2023-05-06 09:54:35 +07:00
Henry 9281b57ef1 - update LangchainJS version
- add types & interfaces

- small ui bug fix

- update marketplace files
2023-04-13 18:32:00 +01:00
Henry 58e06718d1 Add more nodes for agents, loaders 2023-04-10 13:56:44 +01:00