Commit Graph

176 Commits

Author SHA1 Message Date
RABBAH Mahmoud c4eb75ddde
Add batchSize parameter to Qdrant_VectorStores and QdrantUpsert_Vecto… (#2215)
* Add batchSize parameter to Qdrant_VectorStores and QdrantUpsert_VectorStores

* Add optional parameter 'optional' to batchSize in Qdrant_VectorStores and QdrantUpsert_VectorStores also try calling normal mode if it fail failback to batch mode

* Update default values for batchSize in Qdrant_VectorStores and QdrantUpsert_VectorStores

* Update PNPM version to v9.0.2 in Dockerfile

* Update Qdrant.ts

* Update Dockerfile

* Update Qdrant_Upsert.ts

* Update Qdrant.ts

* lint fix Qdrant_Upsert.ts

* increment qdrant node version

* increment qdrant upsert node version

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-04-29 22:20:32 +01:00
Vinod Kiran 7006d64de0
Feature/s3 storage (#2226)
* centralizing file writing....

* allowing s3 as storage option

* allowing s3 as storage option

* update s3 storage

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-23 11:35:38 +01:00
Henry Heng d1c8f7eb96
Bugfix/Supabase Upserting (#2210)
* fix supabase upserting error

* fix supabase upserting error

* update pnpm to 9.0.3
2024-04-19 00:52:28 +01:00
Vinod Kiran 1129782758
Code Cleanup - unnecessary document creation in Pinecone and Astra Vector Stores (#2124)
code cleanup
2024-04-09 15:34:29 +01:00
Vinod Kiran 658fa3984e
Feature/externalize files from chatflow - do not save as base64 (#1976)
* initial commit. Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* DocX - docloader - Externalizing the file base64 string from flowData

* Json - docloader - Externalizing the file base64 string from flowData

* Jsonlines - docloader - Externalizing the file base64 string from flowData

* PDF - docloader - Externalizing the file base64 string from flowData

* Vectara - vector store - Externalizing the file base64 string from flowData

* OpenAPIToolkit - tools - Externalizing the file base64 string from flowData

* OpenAPIChain - chain - Externalizing the file base64 string from flowData

* lint fixes

* datasource enabled - initial commit

* CSVAgent - agents - Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* add pnpm-lock.yaml

* update filerepository to add try catch

* Rename FileRepository.ts to fileRepository.ts

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-04-04 21:41:06 +05:30
Henry Heng e422ce287b
Feature/Indexing (#1802)
* indexing

* fix for multiple files upsert

* fix default Postgres port

* fix SQLite node description

* add MySQLRecordManager node

* fix MySQL unique index

* add upsert history

* update jsx ui

* lint-fix

* update dialog details

* update llamaindex pinecone

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2024-04-02 23:47:19 +01:00
Octavian FlowiseAI ea255db15d
Bugfix/closing mongodb connections (#2085)
* mongodb connection issue

* updating and pinning mongodb version

* removing pnpm-lock.yaml

* converting to a singleton

* Update pnpm lock file

* Downgrade mongodb

---------

Co-authored-by: vinodkiran <vinodkiran@usa.net>
Co-authored-by: Vinod Paidimarry <vinodkiran@outlook.in>
2024-04-02 14:57:20 +02:00
Henry Heng 70706a7183
Bugfix/Add astradb collection name and namespace (#2071)
add astradb collection name and namespace
2024-03-31 00:07:59 +08:00
paulpaliychuk 6819d5f66b chore: Revert node names changes + update new node names to correct format 2024-02-24 13:47:53 -05:00
paulpaliychuk 7728178253 fix: Linter errors 2024-02-22 09:43:57 -08:00
paulpaliychuk aec0645fba chore: Update labels + get rid of dev urls 2024-02-20 00:45:35 -05:00
paulpaliychuk 9da7a1b4de feat: Finalize zep-cloud integration, update naming 2024-02-20 00:31:35 -05:00
paulpaliychuk 76ac97fa50 wip 2024-02-19 22:11:07 -05:00
Henry 4773a13042 update lc version 2024-02-19 18:49:35 +08:00
Henry 5a45a99620 Merge branch 'main' into chore/Upgrade-LC-version 2024-02-19 17:39:32 +08:00
Darien Kindlund 907d5c7ef7 Bumping version since this will change might break legacy Postgres chatflows that used TLS/SSL. This will help users remind them to upgrade their corresponding nodes. 2024-02-08 12:09:26 -05:00
Darien Kindlund 4a75396325 So apparently TypeORMVectorStore requires the field 'username' while Pool expects it to be 'user'. Need to populate both to avoid error messages. 2024-02-08 12:09:26 -05:00
Darien Kindlund 9af4eaaa8c Fixing linting issues. 2024-02-08 12:09:26 -05:00
Darien Kindlund e110a49a32 Migrating all TLS/SSL settings into additionalConfig so that there is consistency in how every function connects with Postgres in the same manner. 2024-02-08 12:09:26 -05:00
Henry 73112ad122 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/package.json
2024-02-07 02:01:32 +08:00
Darien Kindlund 5da3e3cc3e Adding proper TLS/SSL support to poolOptions so that the similaritySearchVectorWithScore function actually connects to Postgres via TLS/SSL when specified in the additionalConfig. 2024-02-04 12:27:18 -05:00
Henry 02fe500f21 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/nodes/cache/RedisCache/RedisCache.ts
#	packages/components/nodes/cache/RedisCache/RedisEmbeddingsCache.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/tools/RetrieverTool/RetrieverTool.ts
#	packages/components/nodes/vectorstores/Qdrant/Qdrant.ts
#	packages/components/nodes/vectorstores/Redis/Redis.ts
#	packages/components/nodes/vectorstores/Redis/RedisSearchBase.ts
#	packages/components/nodes/vectorstores/Redis/Redis_Existing.ts
#	packages/components/nodes/vectorstores/Redis/Redis_Upsert.ts
#	packages/components/src/agents.ts
2024-01-31 00:25:37 +00:00
Henry 21c47d8049 add subquery engine 2024-01-28 23:46:55 +00:00
Henry 3e59b9b658 Merge branch 'main' into feature/LlamaIndex 2024-01-28 20:39:08 +00:00
Henry 393f9b57c6 use singleton redis connection 2024-01-28 17:18:18 +00:00
Henry b636b4384c Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	packages/server/src/index.ts
2024-01-27 23:22:05 +00:00
Henry 7b0416b680 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/nodes/vectorstores/Qdrant/Qdrant.ts
2024-01-27 00:59:15 +00:00
Henry 0606d2c6dd upgrade langchain version 0.1.0 2024-01-26 23:41:55 +00:00
Henry b050920a77 filter fix 2024-01-26 20:10:43 +00:00
Henry 049a35968a remove pinecone env linting issue 2024-01-25 18:30:27 +00:00
Henry 8189f945cc Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/ConversationalRetrievalAgent/ConversationalRetrievalAgent.ts
#	packages/components/nodes/agents/OpenAIAssistant/OpenAIAssistant.ts
#	packages/components/nodes/agents/OpenAIFunctionAgent/OpenAIFunctionAgent.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/ConversationalRetrievalQAChain/ConversationalRetrievalQAChain.ts
#	packages/components/nodes/memory/BufferMemory/BufferMemory.ts
#	packages/components/nodes/memory/BufferWindowMemory/BufferWindowMemory.ts
#	packages/components/nodes/memory/ConversationSummaryMemory/ConversationSummaryMemory.ts
#	packages/components/nodes/memory/DynamoDb/DynamoDb.ts
#	packages/components/nodes/memory/MongoDBMemory/MongoDBMemory.ts
#	packages/components/nodes/memory/MotorheadMemory/MotorheadMemory.ts
#	packages/components/nodes/memory/RedisBackedChatMemory/RedisBackedChatMemory.ts
#	packages/components/nodes/memory/UpstashRedisBackedChatMemory/UpstashRedisBackedChatMemory.ts
#	packages/components/nodes/memory/ZepMemory/ZepMemory.ts
#	packages/components/src/utils.ts
#	packages/server/marketplaces/chatflows/Long Term Memory.json
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-01-24 03:00:31 +00:00
niztal 0214ed1a73 support pinecone serverless indexes 2024-01-18 19:28:38 +02:00
Henry 1bf7944776 update retrievers and add mmr to other vector stores 2024-01-17 15:55:56 +00:00
vinodkiran 0d19dc5be4 Merge branch 'main' into FEATURE/RAG-VectorStores-Updates
# Conflicts:
#	packages/components/package.json
2024-01-16 11:12:52 +05:30
Henry Heng 733f1ec484
Merge pull request #1462 from vectara/add_mmr_vectara
added support for MMR
2024-01-14 00:18:29 +00:00
hakeemsyd 9aaa4313cb svg added and refactored again 2024-01-12 02:43:43 +05:00
hakeemsyd 8a470a85b7 chore: refactoring (naming convention) 2024-01-12 01:36:57 +05:00
hakeemsyd e634a6b584 feature: Integrate Astra Vectorstore 2024-01-12 00:31:21 +05:00
YISH 1dc9690696
Add milvusTextField configuration for Milvus
langchain python use `text` 
https://github.com/langchain-ai/langchain/blob/master/libs/community/langchain_community/vectorstores/milvus.py#L119

while langchian js use `langchain` 
https://github.com/langchain-ai/langchainjs/blob/main/libs/langchain-community/src/vectorstores/milvus.ts#L61

so it is necessary to add milvusTextField configuration for Milvus.
2024-01-10 17:32:46 +08:00
Ofer Mendelevitch a26167ac5a updated component to V2.0
Updated marketplace  "Chain Upload" JSON file
2024-01-08 16:09:50 -08:00
Ofer Mendelevitch 78a6926ca3 added step to diversityBias 2024-01-08 10:26:17 -08:00
Ofer Mendelevitch 244093923d updates per PR comments 2024-01-08 07:25:54 -08:00
Ofer Mendelevitch dd07c3d778 Merge branch 'main' into add_mmr_vectara 2024-01-05 11:14:22 -08:00
tuxBurner d8a778e4d9 Bumped version from 1.0 to 2.0 2024-01-05 12:46:47 +01:00
tuxBurner c2735b190c Merge branch 'main' into feature/postgres-ssl-flag-option 2024-01-05 12:45:05 +01:00
tuxBurner e35faa57af One last linting 2024-01-04 16:27:53 +01:00
tuxBurner a046d52961 Make the linter happy 2024-01-04 16:23:08 +01:00
tuxBurner 2355cb2ec5 Fixed port handling so it returns the correct port and not only 6663 2024-01-04 16:07:54 +01:00
tuxBurner 609ae8703d Added a function which cheks which port to use when port is 443 or 80 2024-01-04 15:58:18 +01:00
tuxBurner b833cb80d4 Added ssl flag 2024-01-04 14:51:41 +01:00