Commit Graph

16 Commits

Author SHA1 Message Date
Henry Heng a2a475ba7a
Feature/Add bullmq redis for message queue processing (#3568)
* add bullmq redis for message queue processing

* Update pnpm-lock.yaml

* update queue manager

* remove singleton patterns, add redis to cache pool

* add bull board ui

* update rate limit handler

* update redis configuration

* Merge add rate limit redis prefix

* update rate limit queue events

* update preview loader to queue

* refractor namings to constants

* update env variable for queue

* update worker shutdown gracefully
2025-01-23 14:08:02 +00:00
Vinod Kiran c0bae635b0
Document Store - Phase 2 (#2912)
* Document Store - Phase 2

* Adding additional columns for vector store config, document store phase 2

* Adding additional columns for vector store config, document store phase 2

* Document Store - Phase 2 - Upsert and Query

* ux cleanup

* retrieval settings and more ux changes

* adding MMR params to execution

* Making the upsert process async.

* add upsert history changes

* making the searchParams dynamic

* removing unnecessary params

* add ability to delete data from vector store

* update margin for vector store query

* adding option to save config in the retrieval playground

* adding chunk number for query return chunks

* Adding a Document Store node in the VectorStore category

* update doc store status, ui touchup

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-08-07 18:59:52 +01:00
Henry Heng 363d1bfc44
Chore/update deprecating nodes (#2540)
* update deprecating nodes

* add filters use cases to marketplace

* update log level
2024-07-12 18:37:57 +01:00
Henry Heng e422ce287b
Feature/Indexing (#1802)
* indexing

* fix for multiple files upsert

* fix default Postgres port

* fix SQLite node description

* add MySQLRecordManager node

* fix MySQL unique index

* add upsert history

* update jsx ui

* lint-fix

* update dialog details

* update llamaindex pinecone

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2024-04-02 23:47:19 +01:00
Henry 0606d2c6dd upgrade langchain version 0.1.0 2024-01-26 23:41:55 +00:00
tirongi 8f4dd8b509 Fix wrong elasti client setup when use custom URL 2023-12-13 10:47:39 +01:00
Henry 3638485d1b Merge branch 'main' into feature/VectorStoreRevamp 2023-11-22 19:49:55 +00:00
Henry 7d13b6323f fix namings, update description, show badge and node info 2023-11-22 19:48:01 +00:00
tirongi 88c9514cca changes based on suggestions 2023-11-21 21:45:51 +01:00
tirongi 681890a600 Enable inserting custom URL using basic auth 2023-11-21 19:13:19 +01:00
Henry f8c4ec28b4 fix mongodb vector database where no documents are returned 2023-11-17 13:52:41 +00:00
Henry 44cadc1cc3 add vector upsert ability 2023-11-16 18:34:17 +00:00
Henry 6cc0811085 add check before adding new document 2023-11-01 16:20:13 +00:00
Henry db06f85c2a add multi options 2023-10-13 01:28:48 +01:00
vinodkiran 57760dc633 Updates to Elasticsearch VectoreStore Functionality. 2023-10-10 20:03:21 +05:30
vinodkiran f108c62acf Support for ElasticSearch as a vector store 2023-09-28 10:31:40 +05:30