Commit Graph

1047 Commits

Author SHA1 Message Date
Henry Heng 2b1273ca31
Bugfix/Missing Filter for VectorStore to Document (#2285)
add filter for vector store to document
2024-04-29 22:25:40 +01:00
RABBAH Mahmoud c4eb75ddde
Add batchSize parameter to Qdrant_VectorStores and QdrantUpsert_Vecto… (#2215)
* Add batchSize parameter to Qdrant_VectorStores and QdrantUpsert_VectorStores

* Add optional parameter 'optional' to batchSize in Qdrant_VectorStores and QdrantUpsert_VectorStores also try calling normal mode if it fail failback to batch mode

* Update default values for batchSize in Qdrant_VectorStores and QdrantUpsert_VectorStores

* Update PNPM version to v9.0.2 in Dockerfile

* Update Qdrant.ts

* Update Dockerfile

* Update Qdrant_Upsert.ts

* Update Qdrant.ts

* lint fix Qdrant_Upsert.ts

* increment qdrant node version

* increment qdrant upsert node version

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-04-29 22:20:32 +01:00
Henry Heng a295573f82
Bugfix/Openai Assistant download path (#2272)
fix openai assistant download path
2024-04-26 18:49:33 +01:00
Henry Heng 7360d1d9a6
Feature/OpenAI Assistant V2 (#2258)
* add gpt4 turbo to assistant

* OpenAI Assistant V2

* update langfuse handler
2024-04-25 20:14:04 +01:00
Nikolay Stankov f378dcc332
Add Custom Dimensionality Support for OpenAI Embedding Components (#2249)
* Add Dimentions Feature to the OpenAIEmbeddings, based on https://js.langchain.com/docs/integrations/text_embedding/openai

* Fixing typos and pushing it under Additional Data

* peer-review comments, incremented version with a major and linted
2024-04-25 18:33:57 +01:00
Vinod Kiran 7006d64de0
Feature/s3 storage (#2226)
* centralizing file writing....

* allowing s3 as storage option

* allowing s3 as storage option

* update s3 storage

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-23 11:35:38 +01:00
Quinn 4c2ba109fd
Update unstructured document loaders (#2213)
* Update UnstructuredFile with missing values. Removed deprecated values.

* Update UnstructuredFolder with missing values. Removed deprecated values.

* Added suport for sourceIdKey to unstructured loaders

* Update unstructured hi_res model names

* Update S3File document loader with latest unstructured and model changes

* Update credential method for S3File document loader

* moved pnpm req to engines to avoid minor version changes

* Change unstructured skipInferTableTypes parse to JSON

* Update unstructured with new params. Also fixed list order, missing values, and support for null on multiOptions.
2024-04-21 19:42:28 +01:00
Henry Heng 95beaba9d9
Chore/Update langchain version, openai, mistral, vertex, anthropic (#2180)
* update langchain version, openai, mistral, vertex, anthropic, introduced toolagent

* upgrade @google/generative-ai 0.7.0, replicate and faiss-node

* update cohere ver

* adding chatCohere to streaming

* update gemini to have image upload

* update google genai, remove aiplugin
2024-04-20 02:20:30 +01:00
louyongjiu f5be889ea8
Feature: Add pdfUsage parameter setting support to folderFiles (#2211)
* Add pdfUsage parameter setting support to folderFiles

* Add pdfUsage parameter setting additionalParams: true
2024-04-19 11:43:22 +01:00
Henry Heng d1c8f7eb96
Bugfix/Supabase Upserting (#2210)
* fix supabase upserting error

* fix supabase upserting error

* update pnpm to 9.0.3
2024-04-19 00:52:28 +01:00
Quinn e4ab2a9e33
Added bedrock cohere embed model requirements (#2207) 2024-04-18 11:51:48 +01:00
Henry Heng fec087c54d
Bugfix/MySQL RecordManager Varchar Size (#2192)
change varchar size to 255
2024-04-16 00:31:57 +01:00
Vinod Kiran 788d40f26b
Feature/externalize model list (#2113)
* fixes

* test json

* test json

* externalize model list

* externalize model list

* correcting awsChatBedRock Name

* lint fixes

* externalize models

* externalize chat models

* externalize chat models

* externalize llm models

* externalize llm models

* lint fixes

* addition of models for ChatMistral

* updating version numbers for all imapacted nodes.

* marketplace template updates

* update embeddings, marketplaces, add chatCohere

* config changes for new env variable

* removal of local models.json

* update models json file

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-12 12:46:10 +01:00
Henry Heng a82dd93c6c
Feature/add max iterations to agents (#2161)
add max iterations to agents
2024-04-12 00:04:19 +01:00
Henry Heng e7a58fc700
Feature/Add topP to Azure (#2160)
add topP to Azure
2024-04-11 22:54:51 +01:00
Henry Heng c33642cdf9
Feature/Buffer Memory SessionId (#2111)
* add sessionId to buffer memory, add conversation summary buffer memory

* add fix for conv retrieval qa chain
2024-04-11 11:18:39 +01:00
Henry Heng 024b2ad22e
Feature/Update csv agent (#2143)
update csv agent
2024-04-09 21:22:00 +01:00
Vinod Kiran 1129782758
Code Cleanup - unnecessary document creation in Pinecone and Astra Vector Stores (#2124)
code cleanup
2024-04-09 15:34:29 +01:00
Henry Heng 057e056257
Bugfix/Add missing TTL implementation for Redis (#2131)
add missing TTL implementation
2024-04-09 14:36:24 +01:00
louyongjiu 827de07e94
Feature: Add BasePath parameter setting support to ChatOpenAI LlamaIndex (#2132)
* ChatOpenAI LlamaIndex support BasePath Param

* Add BasePath parameter setting support to ChatOpenAI LlamaIndex

* Add BasePath parameter setting support to ChatOpenAI LlamaIndex
2024-04-09 14:35:23 +01:00
Vinod Kiran 658fa3984e
Feature/externalize files from chatflow - do not save as base64 (#1976)
* initial commit. Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* DocX - docloader - Externalizing the file base64 string from flowData

* Json - docloader - Externalizing the file base64 string from flowData

* Jsonlines - docloader - Externalizing the file base64 string from flowData

* PDF - docloader - Externalizing the file base64 string from flowData

* Vectara - vector store - Externalizing the file base64 string from flowData

* OpenAPIToolkit - tools - Externalizing the file base64 string from flowData

* OpenAPIChain - chain - Externalizing the file base64 string from flowData

* lint fixes

* datasource enabled - initial commit

* CSVAgent - agents - Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* add pnpm-lock.yaml

* update filerepository to add try catch

* Rename FileRepository.ts to fileRepository.ts

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-04-04 21:41:06 +05:30
Henry Heng e422ce287b
Feature/Indexing (#1802)
* indexing

* fix for multiple files upsert

* fix default Postgres port

* fix SQLite node description

* add MySQLRecordManager node

* fix MySQL unique index

* add upsert history

* update jsx ui

* lint-fix

* update dialog details

* update llamaindex pinecone

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2024-04-02 23:47:19 +01:00
Octavian FlowiseAI ea255db15d
Bugfix/closing mongodb connections (#2085)
* mongodb connection issue

* updating and pinning mongodb version

* removing pnpm-lock.yaml

* converting to a singleton

* Update pnpm lock file

* Downgrade mongodb

---------

Co-authored-by: vinodkiran <vinodkiran@usa.net>
Co-authored-by: Vinod Paidimarry <vinodkiran@outlook.in>
2024-04-02 14:57:20 +02:00
Henry Heng b9b0c9d227
Bugfix/Web Scraper Limit (#2083)
fix when limit set to 0, selectedLinks sliced to become empty
2024-04-02 11:14:04 +01:00
Henry Heng 70706a7183
Bugfix/Add astradb collection name and namespace (#2071)
add astradb collection name and namespace
2024-03-31 00:07:59 +08:00
Asharib Ali aa6aa2e461
bugfix: depreciating chatgpt plugin (#2070) 2024-03-30 23:54:22 +08:00
Vinod Paidimarry f116dba84e
Chore/cohere embed models (#2035)
* Update of Cohere embedding models

* Update of Cohere embedding models

* adding official docs link to inputType
2024-03-26 11:50:50 +05:30
Vinod Paidimarry 794818b434
Voyage AI - Credentials, Embeddings and Rerank (#2015)
* Voyage AI - Credentials and Embeddings

* reranker and fixes for embeddings
2024-03-26 11:50:16 +05:30
falkor b177644354
feature/fetch openaiKey via overrideConfig (vars) (#2018)
* fetch openaiKey via overrideConfig (vars)

* support dynamic openai credentialId via chatflowConfig

* fix lint
2024-03-26 12:05:39 +08:00
Henry Heng 3a7c2fd4db
Chore/Upgrade llamaindex (#2017)
upgrade llamaindex
2024-03-25 16:10:28 +08:00
Henry Heng 414b9f125c
Bugfix/Avoid hardcoded max tokens (#2003)
remove hard-coded max tokens
2024-03-25 12:10:31 +08:00
Mr Khachaturov 4ca82ee733
Extend Confluence Document Loader to Support Server/Data Center with PAT (#1998)
* Extend Confluence Document Loader to Support Server/Data Center with PAT

- Update authentication to use Personal Access Token (PAT)
- Expand compatibility to include both Confluence Cloud and Server/Data Center

* Update ConfluenceServerDCApi.credential.ts

* use the same confluence loader with different connection logic

* use the same confluence loader with different connection logic

* Apply Prettier formatting
2024-03-25 01:37:55 +08:00
Vinod Paidimarry 509b2dd36d
bugfix: Dynamo Memory - messageAttributeName (#2011)
* bugfix: Dynamo Memory - messageAttributeName

* bugfix: Dynamo Memory - messageAttributeName
2024-03-23 13:18:15 +05:30
Vinod Paidimarry 0267005225
bugfix: CSV Agent was overwriting contents when multiple files were u… (#2002)
bugfix: CSV Agent was overwriting contents when multiple files were uploaded
2024-03-21 22:08:03 +05:30
Ikko Eltociear Ashimine dee681b63e
Update SqlDatabaseChain.ts (#2004)
seperated -> separated
2024-03-21 16:58:59 +08:00
Henry Heng c11c43cf0d
Feature/OpenAI Tool Agent (#1991)
add openai tool agent
2024-03-19 19:07:13 +08:00
Henry Heng bb7373ee62
Feature/Custom Tool OverrideConfig (#1979)
add ability to override custom tool
2024-03-18 15:22:36 +08:00
Henry Heng cd4c659009
Feature/Mistral FunctionAgent (#1912)
* add mistral ai agent, add used tools streaming

* fix AWS Bedrock imports

* update pnpm lock
2024-03-18 13:17:00 +08:00
vinodkiran 0c649c9ce3 update the version number for AzureChatOpenAI 2024-03-16 10:03:55 +05:30
vinodkiran 01559d4da3 Adding support for AzureChatOpenAI 2024-03-16 09:39:09 +05:30
Henry fa081acea0 Merge branch 'main' into feature/Indexing
# Conflicts:
#	pnpm-lock.yaml
2024-03-15 15:30:37 +08:00
Henry 5f69a0652e update xml output parser 2024-03-13 15:11:22 +08:00
Henry 25000305ee fix missing human message 2024-03-12 17:10:15 +08:00
Henry c557d8d19c update pnpm wordings 2024-03-12 16:53:20 +08:00
Ilango 63d9c94048
Merge pull request #1272 from use-the-fork/maintenance/pnpm-vite-jsx
Maintenance/pnpm vite jsx (Enhancements to the Project Infrastructure)
2024-03-12 12:59:04 +05:30
Ilango 7313891ea1 Fix merge conflict 2024-03-12 12:46:25 +05:30
Henry 99eaa22af5 add fix for set variable 2024-03-12 14:07:53 +08:00
Henry Heng 5a8848daa2
Merge pull request #1915 from sirsimonson/bugfix/handle-escape-characters-in-ifelse
fix(utilities): Handle escape characters in ifelse-function node's return value, resolves #1887
2024-03-11 15:48:01 +08:00
vinodkiran 2d208e1f99 Merge branch 'main' into FEATURE/Claude_vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
2024-03-11 09:50:33 +05:30
Christoph Simon | dotSource SE 8a0af7b446 fix(utilities): Handle escape characters in ifelse-function node's return value, resolves #1887 2024-03-10 18:35:50 +01:00