Commit Graph

1375 Commits

Author SHA1 Message Date
Henry Heng 4987a2880d
Bugfix/Array Input Variables (#5196)
- Replace manual template variable processing in multiple components with a new utility function `processTemplateVariables`.
2025-09-12 14:42:34 +01:00
anatolii burtsev 736c2b11a1
feat: Add AWS DynamoDB KV Storage tool (#5111)
* feat: Add AWS DynamoDB KV Storage tool

- Add AWS DynamoDB key-value storage tool for persistent data storage
- Add utility functions for AWS tools configuration

* update SNS tool

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-09-11 22:34:12 +01:00
Henry Heng 6fb9bb559f
Bugfix/Gsuite tool params (#5189)
* fix gsuite tool params

* custom assistant only check for mandatory fields for visible params

* azure chat openai fix for gpt5

* return raw from executeJavaScriptCode

* add json5 for parsing

* azure chatopenai use maxCompletionTokens
2025-09-11 19:33:52 +01:00
TensorNull 099cf481b4
feat: add CometAPI integration with ChatCometAPI node (#5160)
* feat: add CometAPI integration with ChatCometAPI node and credential support

* feat: remove timeout and stop sequence parameters from ChatCometAPI node
2025-09-10 12:50:53 +08:00
Rostyslav Borovyk 2ab20f71d9
Fix Oxylabs documentloader API calls (#5162) 2025-09-04 10:48:25 +01:00
anatolii burtsev af1464f7c2
Feat/aws kendra vector search (#5088)
* Add AWS Kendra vector store integration

* Fix import paths in Kendra vector store

* Add AWS Kendra dependencies to package.json

* Update pnpm-lock.yaml with AWS Kendra dependencies

* Fix linter warnings in Kendra vector store

* Fix code formatting in Kendra vector store

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
Co-authored-by: Henry <hzj94@hotmail.com>
2025-08-20 00:38:59 +08:00
Luis Felipe Salazar Ucros bf1ddc3be5
Feature: Add SambaNova (#4961)
* add sambanova

* add sambanova credential

* fix samba nova chat node

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-08-18 22:09:39 +08:00
Henry Heng ad0679801a
Bugfix/Upsert API for file loader (#5096)
* fix upser api for file loader

* - Introduced loaderName property in IDocumentStoreUpsertData interface.
- Updated upsertDocStore function to utilize loaderName if provided.
- Enhanced DocStoreAPIDialog to allow loaderName customization in API requests.
- Modified DocumentStoreDetail to display file names when available, improving source formatting logic.
2025-08-18 18:35:50 +08:00
anatolii burtsev b126472816
feat: add JSONPathExtractor tool (#5052)
* feat: add JSONPathExtractor tool with lodash-based path extraction

  - Implement JSONPathExtractor tool for extracting values from JSON using path notation
  - Use lodash.get for robust path extraction supporting edge cases (numeric string keys, array indexing)
  - Add configurable error handling with returnNullOnError parameter
  - Include comprehensive test suite with 34 tests covering all scenarios
  - Support JSON strings, objects, and arrays as input

* fix lint

* Update pnpm-lock.yaml

* fix: exclude test files from TypeScript compilation

Prevents test files from being included in the dist folder which was causing
"jest is not defined" errors during server startup.

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-08-18 17:55:58 +08:00
Purshotam Bohra 44087bc706
Fixes problematic json parsing in Iteration.ts (#5077)
Resolves the json parsing issue in Iteration.ts gracefully
2025-08-15 19:04:11 +08:00
Henry Heng 55f8f69060
Bugfix/unshift system message (#5080)
unshift system message
2025-08-15 17:08:41 +08:00
Henry Heng 68dc041d02
Bugfix/Agent and llm nodes when chat models streaming is off (#5053)
fix agent and llm nodes when chat models streaming is off
2025-08-11 19:15:07 +08:00
anatolii burtsev 32e5b13c46
feat: add AWS SNS tool for publishing messages to SNS topics (#5049) 2025-08-09 19:05:26 +01:00
Mewyii 9c070c7205
Puppeteer / Playwright web crawler bug fixes/improvements (#4998)
* feature/bugfix: added otpional css selector to puppeteer web scraper, fixed error when puppeteerLoader does not work.

* feature: added button to add empty link in web scraper tools

* feature: added custom executable file path as an input to puppeteer to fix issues when puppeteer can not find/launch the browser.

* feature: added new puppeteer features to playwright aswell.

* fixed review comments
2025-08-08 19:46:59 +01:00
corentin-hoareau bbcfb5ab63
Fixes state interpolation when using {{ output }} (#5039)
* Fixes the lossy-replace when a new state assignment contains the {{ output }} variable

* Replaces replace with replaceAll

---------

Co-authored-by: Corentin <corentin.hoareau@sogeti.com>
2025-08-08 15:08:59 +01:00
Henry fa15b6873d delete stop when model is gpt 5 2025-08-08 12:51:48 +01:00
Ilango 9181ae2879
Fix output type for request tools - get, put, post, and delete (#5044) 2025-08-08 10:46:49 +01:00
Henry 3b1b4dc5f9 add gpt 5 2025-08-07 22:31:21 +01:00
Henry Heng b608219642
Feature/OpenAI Response API (#5014)
* - Added support for built-in OpenAI tools including web search, code interpreter, and image generation.
- Enhanced file handling by extracting artifacts and file annotations from response metadata.
- Implemented download functionality for file annotations in the UI.
- Updated chat history management to include additional kwargs for artifacts, file annotations, and used tools.
- Improved UI components to display used tools and file annotations effectively.

* remove redundant currentContainerId

* update comment
2025-08-07 17:59:05 +01:00
kpj2006 feb899ab19
Enhance: Improve 'Strip New Lines' for Gemini/Vertex embedding effici… (#5010)
* Enhance: Improve 'Strip New Lines' for Gemini/Vertex embedding efficiency

* Run lint-fix

---------

Co-authored-by: Ilango Rajagopal <rajagopalilango@gmail.com>
2025-08-07 16:58:52 +01:00
Henry Heng 5930f1119c
Chore/Add CUSTOM_MCP_PROTOCOL (#5003)
add CUSTOM_MCP_PROTOCOL
2025-08-01 23:48:21 +01:00
Henry Heng d29db16bfc
Chore/Custom MCP Validation (#4996)
- Updated `validateMCPServerSecurity` to only allow whitelisted commands, removing the extensive list of dangerous commands.
- Introduced `validateArgsForLocalFileAccess` to check for potential local file access patterns and null byte injections.
- Updated `Supergateway_MCP` to utilize the new argument validation function.
- Added a warning in `CustomMCP` regarding upcoming changes to Remote MCP support.
2025-07-31 23:15:11 +01:00
Henry Heng 89a806f722
Chore/Prevent invalid http redirect (#4990)
prevent invalid http redirect
2025-07-31 12:24:08 +01:00
Henry Heng 9b54aa8879
Bugfix/nvidia node name (#4986)
fix nvidia node name
2025-07-30 17:50:55 +01:00
Henry Heng 0998bf4327
Chore/add http denylist checks (#4985)
add http denylist checks
2025-07-30 17:16:40 +01:00
Henry Heng e8dac2048f
Bugfix/Custom MCP Security (#4963)
* - Implemented a validation function to check for banned commands and dangerous patterns.
- Added checks for potential shell injection attempts in command and arguments.
- Security validation is conditionally enabled based on environment variable CUSTOM_MCP_SECURITY_CHECK.

* Enhance security by implementing command and argument validation in SupergatewayMCP. Added checks for banned commands, dangerous patterns, and potential shell injection attempts. Security validation is conditionally enabled based on the CUSTOM_MCP_SECURITY_CHECK environment variable.

* add validateMCPServerSecurity
2025-07-30 16:44:20 +01:00
russelj1 498129e9d2
Fix: ignored agentflow LLM structuredOutput keys (#4982)
Fix: ignored structuredOutput keys
2025-07-30 15:28:33 +01:00
Henry Heng bbb03b7b3b
Bugfix/Add filePath sanitization (#4960)
add filePath sanitization
2025-07-28 18:37:12 +01:00
Henry Heng aea2b184da
Chore/Patch OpenAI Nodes (#4958)
- update lc community and openai version
- fix chatfireworks
- update reasonings for openai models
- update openai apikey param
2025-07-28 01:17:47 +01:00
Henry Heng 9a6fd97f2c
Feature/Add chatflowId To Config (#4950)
* allow overrideconfig from executeflow node to take in variables

* update array object schema

* add chatflowId to config
2025-07-25 15:35:34 +01:00
Henry Heng 221ac9b25d
Feature/Allow overrideconfig from executeflow node to take in variables (#4947)
* allow overrideconfig from executeflow node to take in variables

* update array object schema
2025-07-25 13:37:33 +01:00
Philip I. Thomas 8562d4a563
Fix Chroma authentication (#4936)
Fix chroma authentication
2025-07-24 20:15:03 +01:00
Karl Stoney 00342bde88
Refactor google credentials into a shared function (#4893) 2025-07-24 20:06:30 +01:00
Ong Chung Yau efc9ac222f
Feature add http deny list
* feat: add http deny list env variable

* feat: add http deny list in HTTP node

* feat: use generic error message for denied hosts in HTTP node
2025-07-21 20:30:42 +08:00
Henry Heng dca91b979b
Refactor/Update code execution sandbox implementation across components (#4904)
refactor: Update code execution sandbox implementation across components

- Replaced NodeVM usage with a new createCodeExecutionSandbox function for improved sandbox management.
- Enhanced JavaScript code execution with executeJavaScriptCode function, allowing for better handling of libraries and output streaming.
- Updated multiple components to utilize the new sandboxing approach, ensuring consistent execution environment.
- Added validation for UUIDs and URLs in various tools to enhance input safety.
- Refactored input handling in CustomFunction and IfElseFunction to streamline variable management.
2025-07-21 00:09:01 +01:00
Henry Heng 96a57a58e7
Refractor/SecureZodSchemaParser (#4898)
* refactor: Implement SecureZodSchemaParser for safe Zod schema handling and add FilterParser for Supabase filters

* Replaced direct Zod schema evaluation with SecureZodSchemaParser in StructuredOutputParserAdvanced and CustomTool.
* Introduced FilterParser to safely handle Supabase filter strings, preventing arbitrary code execution.
* Added new filterParser.ts file to encapsulate filter parsing logic.
* Updated Supabase vector store to utilize the new FilterParser for RPC filters.
* Created secureZodParser.ts for secure parsing of Zod schemas.

* remove console log
2025-07-19 01:11:31 +01:00
Henry Heng fbe9f34a60
Feature/Excel and PPT File Uploads (#4896)
Enhance file upload capabilities by adding support for additional file types (html, css, js, xml, md, excel, powerpoint) and updating related MIME type mappings. Improve user interface for file type selection in FileUpload component.
2025-07-18 19:08:02 +01:00
Henry Heng 2b7a074c8b
Feat/Implement caching for MCP toolkit in CachePool (#4897)
feat: Implement caching for MCP toolkit in CachePool

- Added methods to CachePool for managing MCP toolkit cache.
- Integrated caching logic in CustomMCP to store and retrieve toolkit data based on workspaceId and configuration.
- Updated node service to pass cachePool to CustomMCP for enhanced performance.
2025-07-18 19:07:48 +01:00
Amr Aly d584c0b700
feat: Add header-based splitting to MarkdownTextSplitter (#4861)
* feat: Add header-based splitting to MarkdownTextSplitter

  - Add dropdown for header level selection (H1-H6)
  - Implement hierarchical splitting (H2 includes H1 headers)
  - Headers preserved with content sections
  - Prioritize semantic boundaries over chunk size

* Update MarkdownTextSplitter.ts

* Update MarkdownTextSplitter.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-18 12:45:41 +01:00
Kang Nahoon 2605a1f74e
fix: normalize Milvus similarity scores for threshold filtering (#4880)
* fix: normalize Milvus similarity scores for threshold filtering

* refactor: refact Milvus similarity score normalization #4879

---------

Co-authored-by: 강나훈 <nahoon.kang@mnc.ai>
2025-07-18 12:35:19 +01:00
Karl Stoney 5e5b2a18e2
Added region support to chatGoogleVertexAi (#4839)
* Added region support to chatGoogleVertexAi

* Added region to the vertex ai embeddings loader too

* Updated the available vertex text embedding models to be valid

* Update ChatGoogleVertexAI.ts

* Update GoogleVertexAIEmbedding.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-18 11:28:23 +01:00
Henry Heng 1bed5a264e
Bugfix/empty vars (#4892)
* update workspaceId to vars

* fix vars and duplicated response
2025-07-17 18:32:09 +01:00
Henry Heng 791c1e3274
Feat/support image for grok 4 (#4869)
support image for grok 4
2025-07-14 15:14:47 +01:00
Rick Ryan aea2801b8c
fix(components): promise.all failed silently when loading MCP tools (#4750)
* fix(components): promise.all failed silently when loading MCP tools

* fix: satisfy linter format

* fix(packages): pnpm lint-fix

* Update core.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-09 10:18:18 +01:00
Rostyslav Borovyk a25c5c4514
Add Oxylabs Document Loader (#4625)
* Add Oxylabs Document Loader

* Update Oxylabs.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-08 16:04:46 +01:00
Yuki 768de6140c
feat: add thinking budget parameter support for ChatGoogleVertexAI (#4557)
* chore: update @langchain/google-vertexai add thinkingBudget parameter support

* Update pnpm-lock.yaml

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-02 20:53:06 +01:00
Abdullatif 0627693133
adding performance config option to the AWS ChatBedrock component (#4777)
* adding performance config option to the AWS ChatBedrock component

* Update AWSChatBedrock.ts

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-07-02 19:15:39 +01:00
Henry Heng bbf6970600
Bugfix/Add proper parsing for tool input args (#4780)
add proper parsing for tool input args
2025-07-02 17:28:10 +01:00
Henry Heng 9b60cf1234
Bugfix/Remove Markdown in Condition (#4761)
Feature/Add remove-markdown dependency and integrate into Condition node for text processing

- Added `remove-markdown` package to `packages/components/package.json`.
- Integrated `removeMarkdown` function in `Condition.ts` to sanitize string inputs by removing markdown formatting.
2025-06-30 12:06:23 +01:00
Henry Heng 4c3b729b79
Chore/Google GenAI (#4742)
* update @langchain/core, custom google genai implementation

* update @langchain/core, custom google genai implementation
2025-06-27 00:44:11 +01:00