* add separate by JSON object
* add file check for Unstructured
* Enhance JSON DocumentLoader: Update label and description for 'Separate by JSON Object' option, and add type check for JSON objects in array processing.
* Make Unstructured API URL optional when environment variable is present
* Fix empty apiUrl option in Unsctructured flowise loader
* Add focumentation for env vars
* Unstructured Upsert bug
When upserting with the API, the uploaded files are of type pdfFile, txtFile, etc.
but the code reads only fileObject which is the uploaded file using the button
* Update UnstructuredFile.ts
fixed linting error
---------
Co-authored-by: Mohamed Akram <makram@ntgclarity.com>
* datasource: initial commit
* datasource: datasource details and chunks
* datasource: Document Store Node
* more changes
* Document Store - Base functionality
* Document Store Loader Component
* Document Store Loader Component
* before merging the modularity PR
* after merging the modularity PR
* preview mode
* initial draft PR
* fixes
* minor updates and fixes
* preview with loader and splitter
* preview with credential
* show stored chunks
* preview update...
* edit config
* save, preview and other changes
* save, preview and other changes
* save, process and other changes
* save, process and other changes
* alpha1 - for internal testing
* rerouting urls
* bug fix on new leader create
* pagination support for chunks
* delete document store
* Update pnpm-lock.yaml
* doc store card view
* Update store files to use updated storage functions, Document Store Table View and other changes
* ui changes
* add expanded chunk dialog, improve ui
* change throw Error to InternalError
* Bug Fixes and removal of subFolder, adding of view chunks for store
* lint fixes
* merge changes
* DocumentStoreStatus component
* ui changes for doc store
* add remove metadata key field, add custom document loader
* add chatflows used doc store chips
* add types/interfaces to DocumentStore Services
* document loader list dialog title bar color change
* update interfaces
* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.
* use typeorm order chunkNo, ui changes
---------
Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
* initial commit
* updates to loader to support file upload
* updates to loader to support file upload
* update unstructured file
---------
Co-authored-by: Henry <hzj94@hotmail.com>
* Update UnstructuredFile with missing values. Removed deprecated values.
* Update UnstructuredFolder with missing values. Removed deprecated values.
* Added suport for sourceIdKey to unstructured loaders
* Update unstructured hi_res model names
* Update S3File document loader with latest unstructured and model changes
* Update credential method for S3File document loader
* moved pnpm req to engines to avoid minor version changes
* Change unstructured skipInferTableTypes parse to JSON
* Update unstructured with new params. Also fixed list order, missing values, and support for null on multiOptions.
Henry Heng
Jérémy JOURDIN
cragwolfe
Mohamed Akram
Vinod Kiran
Quinn
abhishekshankr
Henry