Commit Graph

150 Commits

Author SHA1 Message Date
Henry Heng 5a37227d14
Chore/refractor (#4454)
* markdown files and env examples cleanup

* components update

* update jsonlines description

* server refractor

* update telemetry

* add execute custom node

* add ui refractor

* add username and password authenticate

* correctly retrieve past images in agentflowv2

* disable e2e temporarily

* add existing username and password authenticate

* update migration to default workspace

* update todo

* blob storage migrating

* throw error on agent tool call error

* add missing execution import

* add referral

* chore: add error message when importData is undefined

* migrate api keys to db

* fix: data too long for column executionData

* migrate api keys from json to db at init

* add info on account setup

* update docstore missing fields

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-27 07:29:42 +01:00
Henry Heng c5455137f9
Bugfix/Validate URL for postCore (#4172)
validare url for postCore
2025-03-13 20:00:32 +00:00
Henry Heng a0b4abdd13
Feature/update openai version, add reasoning effort param, add o3 mini (#3973)
* update openai version, add reasoning effort param

* update azure

* add filter for pinecone llamaindex

* update graph cypher qa chain
2025-02-04 08:43:27 +00:00
Henry Heng a2a475ba7a
Feature/Add bullmq redis for message queue processing (#3568)
* add bullmq redis for message queue processing

* Update pnpm-lock.yaml

* update queue manager

* remove singleton patterns, add redis to cache pool

* add bull board ui

* update rate limit handler

* update redis configuration

* Merge add rate limit redis prefix

* update rate limit queue events

* update preview loader to queue

* refractor namings to constants

* update env variable for queue

* update worker shutdown gracefully
2025-01-23 14:08:02 +00:00
Henry Heng 4aa97b0c9a
Bugfix/Escape JSON in Prompt Message (#3901)
add fix to only get variables when there is no colon
2025-01-20 19:18:28 +00:00
supraface 5c9f17814b
Bugfix/Handling empty strings when resolving variables (#3864)
Bugfix for how to handle empty strings when resolving variables
2025-01-16 15:14:06 +00:00
Ahmed Rowaihi e22c60115e
clean(components): is debug boolean syntax shorthand (#3770)
🧹 CLEAN(components): is debug boolean syntax shorthand
2025-01-03 14:20:59 +00:00
Anthony Bryan Gavilan Vinces a7c1ab881c
Feature/Add Neo4j GraphRag support (#3686)
* added: Neo4j database connectivity, Neo4j credentials, supports the usage of the GraphCypherQaChain node and modifies the FewShotPromptTemplate node to handle variables from the prefix field.

* Merge branch 'main' of github.com:FlowiseAI/Flowise into feature/graphragsupport

* revert pnpm-lock.yaml

* add: neo4j package

* Refactor GraphCypherQAChain: Update version to 1.0, remove memory input, and enhance prompt handling

- Changed version from 2.0 to 1.0.
- Removed the 'Memory' input parameter from the GraphCypherQAChain.
- Made 'cypherPrompt' optional and improved error handling for prompt validation.
- Updated the 'init' and 'run' methods to streamline input processing and response handling.
- Enhanced streaming response logic based on the 'returnDirect' flag.

* Refactor GraphCypherQAChain: Simplify imports and update init method signature

- Consolidated import statements for better readability.
- Removed the 'input' and 'options' parameters from the 'init' method, streamlining its signature to only accept 'nodeData'.

* add output, format final response, fix optional inputs

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-12-23 01:35:53 +00:00
Vinod Kiran 26444ac3ae
Feature/sse (#3125)
* Base changes for ServerSide Events (instead of socket.io)

* lint fixes

* adding of interface and separate methods for streaming events

* lint

* first draft, handles both internal and external prediction end points.

* lint fixes

* additional internal end point for streaming and associated changes

* return streamresponse as true to build agent flow

* 1) JSON formatting for internal events
2) other fixes

* 1) convert internal event to metadata to maintain consistency with external response

* fix action and metadata streaming

* fix for error when agent flow is aborted

* prevent subflows from streaming and other code cleanup

* prevent streaming from enclosed tools

* add fix for preventing chaintool streaming

* update lock file

* add open when hidden to sse

* Streaming errors

* Streaming errors

* add fix for showing error message

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-09-17 08:01:25 +01:00
Henry Heng 4c1378c670
Feature/Append uploaded images to message history (#3105)
append uploaded images to message history
2024-09-02 11:27:45 +01:00
Alex Linder 2e689f2cff
bugfix: update placeholder for SQL database connection string (#3034)
chore: update placeholder for SQL database connection string
2024-08-18 21:02:16 +01:00
Henry Heng bca4de0c63
Feature/seq agents (#2798)
* update build functions

* sequential agents

* update langchain to 0.2, added sequential agent nodes

* add marketplace templates

* update howto wordings

* Merge branch 'main' into feature/Seq-Agents

# Conflicts:
#	pnpm-lock.yaml

* update deprecated functions and add new sequential nodes

* add marketplace templates

* update marketplace templates, add structured output to llm node

* add multi agents template

* update llm node with bindmodels

* update cypress version

* update templates sticky note wordings

* update tool node to include human in loop action

* update structured outputs error from models

* update cohere package to resolve google genai pipeThrough bug

* update mistral package version, added message reconstruction before invoke seq agent

* add HITL to agent

* update state messages restructuring

* update load and split methods for s3 directory
2024-07-22 17:46:14 +01:00
Henry Heng e15e6fafdc
Bugfix/Disable output prediction from llmchain streaming (#2543)
disable output prediction from llmchain streaming
2024-06-01 12:37:00 +01:00
Henry Heng 8caca472ba
Feature/Add prepend messages to memory (#2410)
add prepend messages to memory
2024-05-20 17:08:34 +01:00
Vinod Kiran 7006d64de0
Feature/s3 storage (#2226)
* centralizing file writing....

* allowing s3 as storage option

* allowing s3 as storage option

* update s3 storage

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-23 11:35:38 +01:00
Henry Heng c33642cdf9
Feature/Buffer Memory SessionId (#2111)
* add sessionId to buffer memory, add conversation summary buffer memory

* add fix for conv retrieval qa chain
2024-04-11 11:18:39 +01:00
Vinod Kiran 658fa3984e
Feature/externalize files from chatflow - do not save as base64 (#1976)
* initial commit. Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* csv - docloader - Externalizing the file base64 string from flowData

* DocX - docloader - Externalizing the file base64 string from flowData

* Json - docloader - Externalizing the file base64 string from flowData

* Jsonlines - docloader - Externalizing the file base64 string from flowData

* PDF - docloader - Externalizing the file base64 string from flowData

* Vectara - vector store - Externalizing the file base64 string from flowData

* OpenAPIToolkit - tools - Externalizing the file base64 string from flowData

* OpenAPIChain - chain - Externalizing the file base64 string from flowData

* lint fixes

* datasource enabled - initial commit

* CSVAgent - agents - Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* Externalizing the file base64 string from flowData

* add pnpm-lock.yaml

* update filerepository to add try catch

* Rename FileRepository.ts to fileRepository.ts

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-04-04 21:41:06 +05:30
Ikko Eltociear Ashimine dee681b63e
Update SqlDatabaseChain.ts (#2004)
seperated -> separated
2024-03-21 16:58:59 +08:00
Henry 25000305ee fix missing human message 2024-03-12 17:10:15 +08:00
vinodkiran 2d208e1f99 Merge branch 'main' into FEATURE/Claude_vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
2024-03-11 09:50:33 +05:30
Octavian FlowiseAI 69e082e29f Add input moderation for all chains and agents 2024-03-09 23:19:39 +01:00
Henry 66a83f886a update model typecast 2024-03-09 17:25:56 +08:00
Henry c35eb0b7e5 add separate logic for conversation chain for openai vision 2024-03-09 17:01:22 +08:00
vinodkiran bce7ff9ada refactoring of interface into the common interface.ts file and misc changes 2024-03-08 17:59:54 +05:30
vinodkiran 2b0ca60686 lint fixes 2024-03-07 20:09:05 +05:30
vinodkiran 63b8c23072 Addition of Claude for Image uploads 2024-03-07 18:55:24 +05:30
Henry 02735a1f1e add image upload bugfix and import deps 2024-03-03 00:42:04 +08:00
Henry a48edcd3a8 touchup fixes 2024-02-21 18:39:24 +08:00
vinodkiran b31e8715f4 reverting all image upload logic to individual chains/agents 2024-02-19 15:27:19 -08:00
Henry 46c47017bd Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/LLMChain/LLMChain.ts
#	packages/components/nodes/chatmodels/ChatOpenAI/ChatOpenAI.ts
2024-02-19 20:38:34 +08:00
vinodkiran 52ffa1772b Multimodal Fixes...removing all static methods/variables. 2024-02-15 18:18:36 -05:00
Henry 85809a9ecc fix for concurrency 2024-02-15 04:03:10 +08:00
Henry 9cd0362f24 Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-02-02 02:54:06 +00:00
Henry 02fe500f21 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/nodes/cache/RedisCache/RedisCache.ts
#	packages/components/nodes/cache/RedisCache/RedisEmbeddingsCache.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/tools/RetrieverTool/RetrieverTool.ts
#	packages/components/nodes/vectorstores/Qdrant/Qdrant.ts
#	packages/components/nodes/vectorstores/Redis/Redis.ts
#	packages/components/nodes/vectorstores/Redis/RedisSearchBase.ts
#	packages/components/nodes/vectorstores/Redis/Redis_Existing.ts
#	packages/components/nodes/vectorstores/Redis/Redis_Upsert.ts
#	packages/components/src/agents.ts
2024-01-31 00:25:37 +00:00
Henry 214b312fe5 add input moderation to conversation chain 2024-01-30 17:57:11 +00:00
Henry 0606d2c6dd upgrade langchain version 0.1.0 2024-01-26 23:41:55 +00:00
vinodkiran 3ce22d0dde MultiModal : Adding functionality to base OpenAI Chat Model 2024-01-24 18:25:22 +05:30
Henry 2b2a5b9028 add console call back to chains 2024-01-19 18:36:49 +00:00
Henry 31a4769079 fix output prediction output parser 2024-01-19 14:27:40 +00:00
vinodkiran e774bd3c12 GPT Vision: Added multi model capabilities to ChatOpenAI and ConversationChain. 2024-01-19 18:02:05 +05:30
vinodkiran 9222aafc6f GPT Vision: Updated behaviour to submit voice recording directly without the need to do another submit. 2024-01-18 17:04:49 +05:30
vinodkiran 8a14a52d90 GPT Vision: Renaming to OpenAIMultiModalChain and merging the functionality of Wisper. 2024-01-18 13:03:27 +05:30
Henry 7ba4a063fb Merge branch 'main' into bugfix/Concurrent-Chat-Session
# Conflicts:
#	packages/components/nodes/agents/OpenAIFunctionAgent/OpenAIFunctionAgent.ts
2024-01-15 13:22:59 +00:00
Ofer Mendelevitch 244093923d updates per PR comments 2024-01-08 07:25:54 -08:00
Henry 02482f1b38 change agent/chain with memory to use runnable 2024-01-08 13:02:56 +00:00
Ofer Mendelevitch b44a0f1d39 bugfix 2023-12-31 21:53:48 -08:00
Ofer Mendelevitch e5f0ca0c0a bug fix 2023-12-31 18:59:49 -08:00
Ofer Mendelevitch 467e71ba1f added support for MMR 2023-12-31 18:36:23 -08:00
abhishekshankr 4b8ebd494a Updated chain icons 2023-12-18 03:27:10 -05:00
abhishekshankr ffa964df16 Removed existing icons 2023-12-18 03:20:01 -05:00