43f11f21f8
Enhance Airtable Document Loader with Filter and Text Output ( #3074 )
2024-08-25 13:26:39 +01:00
bca4de0c63
Feature/seq agents ( #2798 )
...
* update build functions
* sequential agents
* update langchain to 0.2, added sequential agent nodes
* add marketplace templates
* update howto wordings
* Merge branch 'main' into feature/Seq-Agents
# Conflicts:
# pnpm-lock.yaml
* update deprecated functions and add new sequential nodes
* add marketplace templates
* update marketplace templates, add structured output to llm node
* add multi agents template
* update llm node with bindmodels
* update cypress version
* update templates sticky note wordings
* update tool node to include human in loop action
* update structured outputs error from models
* update cohere package to resolve google genai pipeThrough bug
* update mistral package version, added message reconstruction before invoke seq agent
* add HITL to agent
* update state messages restructuring
* update load and split methods for s3 directory
2024-07-22 17:46:14 +01:00
b50103021c
Feature/Ability to omit all metadata keys using asterisk ( #2401 )
...
add ability to omit all metadata keys using asterisk
2024-05-13 16:30:57 +01:00
40e36d1b39
Feature/DocumentStore ( #2106 )
...
* datasource: initial commit
* datasource: datasource details and chunks
* datasource: Document Store Node
* more changes
* Document Store - Base functionality
* Document Store Loader Component
* Document Store Loader Component
* before merging the modularity PR
* after merging the modularity PR
* preview mode
* initial draft PR
* fixes
* minor updates and fixes
* preview with loader and splitter
* preview with credential
* show stored chunks
* preview update...
* edit config
* save, preview and other changes
* save, preview and other changes
* save, process and other changes
* save, process and other changes
* alpha1 - for internal testing
* rerouting urls
* bug fix on new leader create
* pagination support for chunks
* delete document store
* Update pnpm-lock.yaml
* doc store card view
* Update store files to use updated storage functions, Document Store Table View and other changes
* ui changes
* add expanded chunk dialog, improve ui
* change throw Error to InternalError
* Bug Fixes and removal of subFolder, adding of view chunks for store
* lint fixes
* merge changes
* DocumentStoreStatus component
* ui changes for doc store
* add remove metadata key field, add custom document loader
* add chatflows used doc store chips
* add types/interfaces to DocumentStore Services
* document loader list dialog title bar color change
* update interfaces
* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.
* use typeorm order chunkNo, ui changes
---------
Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-06 15:23:27 +01:00
02fe500f21
Merge branch 'main' into chore/Upgrade-LC-version
...
# Conflicts:
# packages/components/nodes/cache/RedisCache/RedisCache.ts
# packages/components/nodes/cache/RedisCache/RedisEmbeddingsCache.ts
# packages/components/nodes/chains/ConversationChain/ConversationChain.ts
# packages/components/nodes/tools/RetrieverTool/RetrieverTool.ts
# packages/components/nodes/vectorstores/Qdrant/Qdrant.ts
# packages/components/nodes/vectorstores/Redis/Redis.ts
# packages/components/nodes/vectorstores/Redis/RedisSearchBase.ts
# packages/components/nodes/vectorstores/Redis/Redis_Existing.ts
# packages/components/nodes/vectorstores/Redis/Redis_Upsert.ts
# packages/components/src/agents.ts
2024-01-31 00:25:37 +00:00
b960f061eb
Clarifying that the Limit value is ignored when Return All is set to true.
2024-01-28 20:42:19 -08:00
66eef84633
Forgot to make maxRecords optional now
2024-01-28 20:42:19 -08:00
37945fc998
The loadAll() function should ignore any maxRecords specified, because the intention is the load *all* of the records. Also, marking both the Return All and Limit params as optional, so as to not confuse the user. Making them both required adds a lot of confusion that doesn't make sense. Ideally, the user either specifies Return All OR specifies the Limit value but not BOTH. It seems there's no way to define "conditional requirements" in Flowise params, so it's better to make both params optional.
2024-01-28 20:42:19 -08:00
dc39d7e2be
So Airtable API expects a maxRecords value to be the total set of records you want across multiple API calls. If the maxRecords is greater than 100, then it will provide pagination hints accordingly.
2024-01-28 20:42:19 -08:00
9b71f683ff
Support pagination even in loadLimit(), so that if a user wants to load more than 100 records but not all of them, they can. Currently, there's a bug where the document loader doesn't work on loading more than 100 records because of internal Airtable API limitations. The Airtable API can only fetch up to 100 records per call - anything more than that requires pagination.
2024-01-28 20:42:19 -08:00
2237b1ab16
Fix worked, removing debug logging, and bumped node version.
2024-01-28 20:42:19 -08:00
3b788e42e1
When you switch from GET to POST, you're supposed to adjust the Airtable URL to use the /listRecords endpoint. I didn't RTFM clearly. This is currently documented here: https://support.airtable.com/docs/enforcement-of-url-length-limit-for-web-api-requests
2024-01-28 20:42:19 -08:00
456dfabc6f
For some reason, Airtable doesn't like the POST operations, so I need to add logging to figure out why this happens
2024-01-28 20:42:18 -08:00
8ae848110e
Clarifying the description for the optional fields param
2024-01-28 20:42:18 -08:00
72ec7878b6
Added more error checking and also fixed yet more build errors
2024-01-28 20:42:18 -08:00
1a7cb5a010
Fixing more build errors
2024-01-28 20:42:18 -08:00
ae64854bae
Fixing a bunch of build errors
2024-01-28 20:42:18 -08:00
71f456af90
Switched to specifying Airtable fields to include rather than exclude - this helps reduce the amount of data fetched by the DocumentLoader when there are massive numbers of fields in an Airtable table.
2024-01-28 20:42:18 -08:00
0606d2c6dd
upgrade langchain version 0.1.0
2024-01-26 23:41:55 +00:00
e3982476b0
Bumping version
2024-01-04 12:07:25 -05:00
53bfd07694
Bumping version to reflect new feature
2024-01-03 21:23:43 -05:00
66701cec8a
Fixing linting issues using 'yarn lint-fix'
2024-01-03 13:35:25 -05:00
c035363d6f
Fixing linting issues using 'yarn lint-fix'
2024-01-03 13:20:39 -05:00
6006157958
Updated Airtable field exclusion support to use field names instead of field ids
2023-12-30 15:17:33 -05:00
3fb8001907
Added support to exclude specific Airtable Field Ids
2023-12-30 14:13:39 -05:00
28e32f0ae6
Initial support for Airtable views
2023-12-30 09:46:44 -05:00
886e0af59b
Updated document loader icons
2023-12-18 04:22:10 -05:00
05dd23b01d
- update marketplaces
...
- add version to nodes and credentials
- hover over node actions
2023-07-28 15:56:40 +01:00
61dabbb7da
Merge branch 'main' into feature/Credential
...
# Conflicts:
# README.md
# docker/.env.example
# packages/components/nodes/documentloaders/Notion/NotionDB.ts
# packages/components/nodes/memory/DynamoDb/DynamoDb.ts
# packages/components/nodes/memory/MotorheadMemory/MotorheadMemory.ts
# packages/components/nodes/memory/ZepMemory/ZepMemory.ts
# packages/components/package.json
# packages/components/src/utils.ts
# packages/server/.env.example
# packages/server/README.md
# packages/server/marketplaces/chatflows/Conversational Retrieval QA Chain.json
# packages/server/src/ChildProcess.ts
# packages/server/src/DataSource.ts
# packages/server/src/commands/start.ts
# packages/server/src/index.ts
# packages/server/src/utils/index.ts
# packages/server/src/utils/logger.ts
2023-07-27 11:26:34 +01:00
1da012305a
add airtable loader
2023-07-21 11:48:21 +01:00
Rafael Reis
Henry Heng
Vinod Kiran
Henry
Darien Kindlund
Darien Kindlund
abhishekshankr