Commit Graph

894 Commits

Author SHA1 Message Date
Ilyes Tascou 2bb2a7588a add recursive option for folder-loader 2024-02-06 14:25:40 +01:00
Ilyes Tascou 011a0a75c3 add kotlin files to folder-loader 2024-02-05 17:20:05 +01:00
Henry Heng 340e85da91
Merge pull request #1611 from FlowiseAI/feature/LlamaIndex
Feature/llama index
2024-02-02 20:00:21 +00:00
Henry Heng 37828de664
Merge pull request #1659 from FlowiseAI/feature/Vec2Doc
chore/update vec 2 doc node
2024-02-01 19:38:27 +00:00
Rafael Reis 1522acbf5a
Add gpt-3.5-turbo-0125 to ChatOpenAI.ts 2024-02-01 16:19:30 -03:00
Henry 7881f295ab update vec 2 doc node 2024-02-01 19:18:14 +00:00
Henry 5c6b5b233c fix top K 2024-02-01 13:14:02 +00:00
Henry 214b312fe5 add input moderation to conversation chain 2024-01-30 17:57:11 +00:00
Henry 4d6881b506 add return source documens to retriever tool 2024-01-30 14:12:55 +00:00
Henry Heng 18c9c1cc51
Merge pull request #1632 from fletch-ai/bugfix/AzureOpenAIEmbedding-Batch-Size
Bugfix/AzureOpenAIEmbedding - Updated Default Batch Size from 1 to 100
2024-01-29 10:12:22 +00:00
Henry Heng 985e454a7f
Merge pull request #1631 from fletch-ai/feature/airtable-include-fields
Feature/airtable include fields
2024-01-29 10:11:31 +00:00
Darien Kindlund 63665b37ce Switching Redis TTL from EX to PX to match TTL in milliseconds (as specified in the input param). 2024-01-28 21:58:04 -08:00
Darien Kindlund 9f4619e408 Switching default batch size from 1 to 100 in order to support higher volume of document loading into vector stores before timing out. 2024-01-28 21:52:40 -08:00
Darien Kindlund 905c9fc2be Reverting version bump 2024-01-28 20:49:21 -08:00
Darien Kindlund b960f061eb Clarifying that the Limit value is ignored when Return All is set to true. 2024-01-28 20:42:19 -08:00
Darien Kindlund 66eef84633 Forgot to make maxRecords optional now 2024-01-28 20:42:19 -08:00
Darien Kindlund 37945fc998 The loadAll() function should ignore any maxRecords specified, because the intention is the load *all* of the records. Also, marking both the Return All and Limit params as optional, so as to not confuse the user. Making them both required adds a lot of confusion that doesn't make sense. Ideally, the user either specifies Return All OR specifies the Limit value but not BOTH. It seems there's no way to define "conditional requirements" in Flowise params, so it's better to make both params optional. 2024-01-28 20:42:19 -08:00
Darien Kindlund dc39d7e2be So Airtable API expects a maxRecords value to be the total set of records you want across multiple API calls. If the maxRecords is greater than 100, then it will provide pagination hints accordingly. 2024-01-28 20:42:19 -08:00
Darien Kindlund 9b71f683ff Support pagination even in loadLimit(), so that if a user wants to load more than 100 records but not all of them, they can. Currently, there's a bug where the document loader doesn't work on loading more than 100 records because of internal Airtable API limitations. The Airtable API can only fetch up to 100 records per call - anything more than that requires pagination. 2024-01-28 20:42:19 -08:00
Darien Kindlund 2237b1ab16 Fix worked, removing debug logging, and bumped node version. 2024-01-28 20:42:19 -08:00
Darien Kindlund 3b788e42e1 When you switch from GET to POST, you're supposed to adjust the Airtable URL to use the /listRecords endpoint. I didn't RTFM clearly. This is currently documented here: https://support.airtable.com/docs/enforcement-of-url-length-limit-for-web-api-requests 2024-01-28 20:42:19 -08:00
Darien Kindlund 456dfabc6f For some reason, Airtable doesn't like the POST operations, so I need to add logging to figure out why this happens 2024-01-28 20:42:18 -08:00
Darien Kindlund 8ae848110e Clarifying the description for the optional fields param 2024-01-28 20:42:18 -08:00
Darien Kindlund 72ec7878b6 Added more error checking and also fixed yet more build errors 2024-01-28 20:42:18 -08:00
Darien Kindlund 1a7cb5a010 Fixing more build errors 2024-01-28 20:42:18 -08:00
Darien Kindlund ae64854bae Fixing a bunch of build errors 2024-01-28 20:42:18 -08:00
Darien Kindlund 71f456af90 Switched to specifying Airtable fields to include rather than exclude - this helps reduce the amount of data fetched by the DocumentLoader when there are massive numbers of fields in an Airtable table. 2024-01-28 20:42:18 -08:00
Darien Kindlund 6f7b7408e1
Merge branch 'FlowiseAI:main' into main 2024-01-28 20:34:00 -08:00
Henry 21c47d8049 add subquery engine 2024-01-28 23:46:55 +00:00
Henry 3e59b9b658 Merge branch 'main' into feature/LlamaIndex 2024-01-28 20:39:08 +00:00
Henry Heng aeb036bb47
Merge pull request #1628 from FlowiseAI/bugfix/Redis-Connection-Max-Client
Feature/Singleton Redis Connection
2024-01-28 20:34:50 +00:00
Henry 393f9b57c6 use singleton redis connection 2024-01-28 17:18:18 +00:00
Ashes47 1c108f3599 update 2024-01-28 21:51:27 +05:30
Ashes47 51388d5057 update 2024-01-28 21:48:15 +05:30
Ashes47 36ab1681ac lint 2024-01-28 21:39:22 +05:30
Anuj Verma e154461f1d
Update MongoDBMemory.ts 2024-01-28 21:33:09 +05:30
Anuj Verma e8deeb25cf
Update MongoDBMemory.ts 2024-01-28 19:45:19 +05:30
Henry b636b4384c Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	packages/server/src/index.ts
2024-01-27 23:22:05 +00:00
Henry a711e21ac7 update embeddings and marketplace templates 2024-01-27 00:52:23 +00:00
Henry Heng c1767f302d
Merge pull request #1610 from raffareis/feat/new-gpt-4-models
Update ChatOpenAI.ts to include new openai's Chat models
2024-01-27 00:14:58 +00:00
Henry b050920a77 filter fix 2024-01-26 20:10:43 +00:00
YISH 50cef64193 Allows CustomFunction to be set as an Ending Node 2024-01-26 09:17:33 +08:00
Henry 3d670fec81 update query engine 2024-01-26 00:22:24 +00:00
Ilango 94d8e003e7 Merge branch 'main' of github.com:0xi4o/Flowise into feature/scrapped-links 2024-01-26 03:57:21 +05:30
Henry 1fb3e25f53 update linting issues 2024-01-25 21:57:56 +00:00
Rafael Reis 274125a289
Update ChatOpenAI.ts 2024-01-25 16:38:15 -03:00
Henry 2d6dcb3e82 Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	.github/workflows/autoSyncMergedPullRequest.yml
2024-01-25 19:16:20 +00:00
Henry 049a35968a remove pinecone env linting issue 2024-01-25 18:30:27 +00:00
Henry 2279ffd57d update conversational retrieval agent 2024-01-24 14:13:44 +00:00
Henry 8189f945cc Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/ConversationalRetrievalAgent/ConversationalRetrievalAgent.ts
#	packages/components/nodes/agents/OpenAIAssistant/OpenAIAssistant.ts
#	packages/components/nodes/agents/OpenAIFunctionAgent/OpenAIFunctionAgent.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/ConversationalRetrievalQAChain/ConversationalRetrievalQAChain.ts
#	packages/components/nodes/memory/BufferMemory/BufferMemory.ts
#	packages/components/nodes/memory/BufferWindowMemory/BufferWindowMemory.ts
#	packages/components/nodes/memory/ConversationSummaryMemory/ConversationSummaryMemory.ts
#	packages/components/nodes/memory/DynamoDb/DynamoDb.ts
#	packages/components/nodes/memory/MongoDBMemory/MongoDBMemory.ts
#	packages/components/nodes/memory/MotorheadMemory/MotorheadMemory.ts
#	packages/components/nodes/memory/RedisBackedChatMemory/RedisBackedChatMemory.ts
#	packages/components/nodes/memory/UpstashRedisBackedChatMemory/UpstashRedisBackedChatMemory.ts
#	packages/components/nodes/memory/ZepMemory/ZepMemory.ts
#	packages/components/src/utils.ts
#	packages/server/marketplaces/chatflows/Long Term Memory.json
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-01-24 03:00:31 +00:00