Commit Graph

3069 Commits

Author SHA1 Message Date
Henry 3daa6736c4 Merge branch 'main' into feature/Allow-ExecuteFlow-Variables 2025-07-25 15:34:50 +01:00
Henry 1457a896a0 add chatflowId to config 2025-07-25 15:33:16 +01:00
Henry Heng 221ac9b25d
Feature/Allow overrideconfig from executeflow node to take in variables (#4947)
* allow overrideconfig from executeflow node to take in variables

* update array object schema
2025-07-25 13:37:33 +01:00
Henry 23ca23bd1e update array object schema 2025-07-25 13:25:57 +01:00
Ong Chung Yau caffad0fb0
chore:variable (#4946) 2025-07-25 19:51:14 +08:00
Henry 1be809c55c allow overrideconfig from executeflow node to take in variables 2025-07-25 12:45:07 +01:00
Philip I. Thomas 8562d4a563
Fix Chroma authentication (#4936)
Fix chroma authentication
2025-07-24 20:15:03 +01:00
Vinod Kiran d272683a98
SSO token caching and retrieval in CachePool (#4931)
* feat: Implement SSO token caching and retrieval in CachePool

This implementation improves the authentication process by securely caching SSO tokens and managing user sessions.

* Removed commented code

* feat: add deleteSSOTokenCache in ssoSuccess

---------

Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-07-24 20:14:46 +01:00
Karl Stoney 00342bde88
Refactor google credentials into a shared function (#4893) 2025-07-24 20:06:30 +01:00
Henry Heng a3f47af027
Chore/deny list urls (#4938)
* Refactor URL filtering logic in App class

- Introduced a denylist for URLs using the DENYLIST_URLS environment variable.
- Updated the whitelist logic to filter out denylisted URLs, ensuring improved request validation.

* revery whitelist url changes

* revert whitelist url changes
2025-07-24 00:57:45 +01:00
Henry Heng d081221a97
Chore/Add Deny List URLs (#4933)
Refactor URL filtering logic in App class

- Introduced a denylist for URLs using the DENYLIST_URLS environment variable.
- Updated the whitelist logic to filter out denylisted URLs, ensuring improved request validation.
2025-07-23 14:33:06 +01:00
Henry Heng f2bd83252d
Chore/Update GET to POST requests (#4924)
Refactor account and evaluations routes to use POST for billing and run-again endpoints

- Changed the billing route from GET to POST in account.route.ts and account.api.js for consistency with other account actions.
- Updated the run-again route from GET to POST in evaluations/index.ts and evaluations.js to align with the API design for creating actions.
2025-07-22 16:20:38 +01:00
Ong Chung Yau 910a3c5229
Fix import chatMessageFeedback messageIDs unique violation (#4919)
* fix: chatMessageFeedback unique violation

* fix: sync chatMessage IDs and chatMessageFeedback messageIDs

* feat: optimize chatMessageFeedback IDs replacement
2025-07-22 18:40:14 +08:00
Karl Stoney d77919ba50
Improve infra as code support (#4867)
* Fix: enable creating of documentstores with the loaders

* Feature: Support posting credentials with a specific id to enabled infrastructure as code
2025-07-21 15:49:21 +01:00
Henry Heng e8c36b6894
Chore/add session regeneration when login (#4912)
add session regeneration when login
2025-07-21 14:19:51 +01:00
Ong Chung Yau efc9ac222f
Feature add http deny list
* feat: add http deny list env variable

* feat: add http deny list in HTTP node

* feat: use generic error message for denied hosts in HTTP node
2025-07-21 20:30:42 +08:00
Henry Heng dca91b979b
Refactor/Update code execution sandbox implementation across components (#4904)
refactor: Update code execution sandbox implementation across components

- Replaced NodeVM usage with a new createCodeExecutionSandbox function for improved sandbox management.
- Enhanced JavaScript code execution with executeJavaScriptCode function, allowing for better handling of libraries and output streaming.
- Updated multiple components to utilize the new sandboxing approach, ensuring consistent execution environment.
- Added validation for UUIDs and URLs in various tools to enhance input safety.
- Refactored input handling in CustomFunction and IfElseFunction to streamline variable management.
2025-07-21 00:09:01 +01:00
Henry Heng 9a06a85a8d
Chore/Safe Parse HTML (#4905)
Refactor: Update pnpm-lock.yaml and enhance UI components for safe HTML rendering

- Updated pnpm-lock.yaml to improve dependency management and ensure consistency.
- Refactored the JSONViewer component to utilize a new JsonToken for syntax highlighting.
- Introduced SafeHTML component to sanitize and safely render HTML content in ViewMessagesDialog and NodeExecutionDetails.
- Replaced direct HTML rendering with SafeHTML in ChatMessage component for enhanced security.
2025-07-20 10:59:44 +01:00
Henry Heng 96a57a58e7
Refractor/SecureZodSchemaParser (#4898)
* refactor: Implement SecureZodSchemaParser for safe Zod schema handling and add FilterParser for Supabase filters

* Replaced direct Zod schema evaluation with SecureZodSchemaParser in StructuredOutputParserAdvanced and CustomTool.
* Introduced FilterParser to safely handle Supabase filter strings, preventing arbitrary code execution.
* Added new filterParser.ts file to encapsulate filter parsing logic.
* Updated Supabase vector store to utilize the new FilterParser for RPC filters.
* Created secureZodParser.ts for secure parsing of Zod schemas.

* remove console log
2025-07-19 01:11:31 +01:00
Henry Heng fbe9f34a60
Feature/Excel and PPT File Uploads (#4896)
Enhance file upload capabilities by adding support for additional file types (html, css, js, xml, md, excel, powerpoint) and updating related MIME type mappings. Improve user interface for file type selection in FileUpload component.
2025-07-18 19:08:02 +01:00
Henry Heng 2b7a074c8b
Feat/Implement caching for MCP toolkit in CachePool (#4897)
feat: Implement caching for MCP toolkit in CachePool

- Added methods to CachePool for managing MCP toolkit cache.
- Integrated caching logic in CustomMCP to store and retrieve toolkit data based on workspaceId and configuration.
- Updated node service to pass cachePool to CustomMCP for enhanced performance.
2025-07-18 19:07:48 +01:00
Karl Stoney cc4a773010
Added yaml as a file upload option (#4872) 2025-07-18 14:59:30 +01:00
Amr Aly d584c0b700
feat: Add header-based splitting to MarkdownTextSplitter (#4861)
* feat: Add header-based splitting to MarkdownTextSplitter

  - Add dropdown for header level selection (H1-H6)
  - Implement hierarchical splitting (H2 includes H1 headers)
  - Headers preserved with content sections
  - Prioritize semantic boundaries over chunk size

* Update MarkdownTextSplitter.ts

* Update MarkdownTextSplitter.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-18 12:45:41 +01:00
Krishna Somani ebf222731e
Update README.md (#4870)
* Update README.md

Enhanced the readability of file file and fixed minor grammatical errors

* Update README.md

Added proper spacing and fixed few minor erros
2025-07-18 12:45:29 +01:00
Kang Nahoon 2605a1f74e
fix: normalize Milvus similarity scores for threshold filtering (#4880)
* fix: normalize Milvus similarity scores for threshold filtering

* refactor: refact Milvus similarity score normalization #4879

---------

Co-authored-by: 강나훈 <nahoon.kang@mnc.ai>
2025-07-18 12:35:19 +01:00
Karl Stoney 2e1999e6f1
Init the storagepath (#4844) 2025-07-18 11:32:27 +01:00
Karl Stoney 5e5b2a18e2
Added region support to chatGoogleVertexAi (#4839)
* Added region support to chatGoogleVertexAi

* Added region to the vertex ai embeddings loader too

* Updated the available vertex text embedding models to be valid

* Update ChatGoogleVertexAI.ts

* Update GoogleVertexAIEmbedding.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-18 11:28:23 +01:00
Karl Stoney cf965f3d8e
Refactor the modelLoader and fix a small bug (#4838)
Refactor the modelLoader to remove duplicate code.

Also fix an issue where if MODEL_LIST_CONFIG_JSON is set, but does not exist, fallback did not work
2025-07-18 11:25:27 +01:00
Karl Stoney 0ac01d3cbb
Added latest vertex models to models.json (#4837) 2025-07-18 11:11:19 +01:00
Henry Heng 1bed5a264e
Bugfix/empty vars (#4892)
* update workspaceId to vars

* fix vars and duplicated response
2025-07-17 18:32:09 +01:00
Henry Heng 8a6b95ef0e
Bugfix/update workspaceId to vars (#4891)
update workspaceId to vars
2025-07-17 15:43:13 +01:00
Henry Heng 9839009823
Chore/Update s3 version (#4883)
update s3 version
2025-07-16 11:55:52 +01:00
Henry Heng 791c1e3274
Feat/support image for grok 4 (#4869)
support image for grok 4
2025-07-14 15:14:47 +01:00
Henry Heng e3eeb5d8a8
Bugfix/Remove Redundant Distinct (#4865)
remove redundant distinct
2025-07-14 12:35:50 +01:00
Anoop P 9d438529a6
Marketplace page UI/ UX enhancements (#4819)
* style enhancements

* Introduce autocomplete to select usecases

* add grid gap property

* add tooltip to display remaining selected items on hover

* use ordered list to show more items
2025-07-14 10:17:40 +01:00
Henry Heng ee5ab1bd6d
Chore/patch dependencies (#4858)
patch dependencies
2025-07-13 20:56:29 +01:00
Henry Heng 849b94b049
Release/3.0.4 (#4845)
flowise@3.0.4
2025-07-11 12:26:10 +01:00
Junhui Huang 14fc1b4d20
Fix table in CONTRIBUTING-ZH.md (#4829) 2025-07-11 10:54:47 +01:00
Vinod Kiran bf05f25f7e
New Feature Pagination (#4704)
* common pagination component

* Pagination for Doc Store Dashboard

* Pagination for Executions Dashboard

* Pagination Support for Tables

* lint fixes

* update view message dialog UI

* initial loading was ignoring the pagination counts

* 1) default page size change
2) ensure page limits are passed on load
3) co-pilot review comments (n+1 query)
4)

* 1) default page size change
2) ensure page limits are passed on load
3) co-pilot review comments (n+1 query)
4) refresh lists after insert/delete.

* Enhancement: Improve handling of empty responses in DocumentStore and API key services

- Added check for empty entities in DocumentStoreDTO.fromEntities to return an empty array.
- Updated condition in getAllDocumentStores to handle total count correctly, allowing for zero total.
- Refined logic in getAllApiKeys to check for empty keys and ensure correct API key retrieval.
- Adjusted UI components to safely handle potential undefined apiKeys array.

* Refresh API key list on pagination change

* Enhancement: Update pagination and filter handling across components
- Increased default items per page in AgentExecutions from 10 to 12.
- Improved JSON parsing for chat type and feedback type filters in ViewMessagesDialog.
- Enhanced execution filtering logic in AgentExecutions to ensure proper pagination and state management.
- Refactored filter section in AgentExecutions for better readability and functionality.
- Updated refresh logic in Agentflows to use the correct agentflow version.

* add workspaceId to removeAllChatMessages

* Refactor chat message retrieval logic for improved efficiency and maintainability

- Introduced a new `handleFeedbackQuery` function to streamline feedback-related queries.
- Enhanced pagination handling for session-based queries in `getMessagesWithFeedback`.
- Updated `ViewMessagesDialog` to sort messages in descending order by default.
- Simplified image rendering logic in `DocumentStoreTable` for better readability.

* - Update  `validateChatflowAPIKey` and `validateAPIKey` functions to get the correct keys array
- Enhanced error handling in the `sanitizeExecution` function to ensure safe access to nested properties

* Refactor API key validation logic for improved accuracy and error handling

- Consolidated API key validation in `validateAPIKey` to return detailed validation results.
- Updated `validateFlowAPIKey` to streamline flow API key validation.
- Introduced `getApiKeyById` function in the API key service for better key retrieval.
- Removed unused function `getAllChatSessionsFromChatflow` from the chat message API.

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-07-10 15:59:24 +01:00
Ong Chung Yau 6baec93860
Optimize export import (#4795)
* feat: add saveBatch and optimize duplication id handling

* feat: improve lookup performance by using Set
2025-07-09 18:36:47 +08:00
Kang Nahoon 30e8317327
Bugfix: add missing getLabel prop to AgentReasoningCard (#4822)
Bugfix: add missing getLabel prop to AgentReasoningCard #4821

Co-authored-by: 강나훈 <nahoon.kang@mnc.ai>
2025-07-09 10:23:47 +01:00
Rick Ryan aea2801b8c
fix(components): promise.all failed silently when loading MCP tools (#4750)
* fix(components): promise.all failed silently when loading MCP tools

* fix: satisfy linter format

* fix(packages): pnpm lint-fix

* Update core.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-09 10:18:18 +01:00
Rostyslav Borovyk a25c5c4514
Add Oxylabs Document Loader (#4625)
* Add Oxylabs Document Loader

* Update Oxylabs.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-08 16:04:46 +01:00
Yuki 768de6140c
feat: add thinking budget parameter support for ChatGoogleVertexAI (#4557)
* chore: update @langchain/google-vertexai add thinkingBudget parameter support

* Update pnpm-lock.yaml

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-02 20:53:06 +01:00
Abdullatif 0627693133
adding performance config option to the AWS ChatBedrock component (#4777)
* adding performance config option to the AWS ChatBedrock component

* Update AWSChatBedrock.ts

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-02 19:15:39 +01:00
Henry Heng bbf6970600
Bugfix/Add proper parsing for tool input args (#4780)
add proper parsing for tool input args
2025-07-02 17:28:10 +01:00
Henry Heng 9b60cf1234
Bugfix/Remove Markdown in Condition (#4761)
Feature/Add remove-markdown dependency and integrate into Condition node for text processing

- Added `remove-markdown` package to `packages/components/package.json`.
- Integrated `removeMarkdown` function in `Condition.ts` to sanitize string inputs by removing markdown formatting.
2025-06-30 12:06:23 +01:00
Henry Heng be7599542b
Release/3.0.3 (#4746)
flowise@3.0.3
2025-06-27 09:58:49 +01:00
Henry Heng 4c3b729b79
Chore/Google GenAI (#4742)
* update @langchain/core, custom google genai implementation

* update @langchain/core, custom google genai implementation
2025-06-27 00:44:11 +01:00
Henry Heng e326bc8f49
Bugfix/Refactor createFileAttachment to streamline chatId validation (#4740)
Removed redundant chatId validation and path traversal checks, improving code clarity and maintainability. The chatId is now validated after the chatflowid check, ensuring proper error handling for invalid inputs.
2025-06-26 16:14:04 +01:00