Commit Graph

289 Commits

Author SHA1 Message Date
Henry Heng eb69b23d73
Chore/add loggers (#4541)
add loggers
2025-05-29 22:36:48 +01:00
Henry 66bf0749af removed hardcoded default host 2025-05-27 07:51:20 +01:00
Henry Heng 5a37227d14
Chore/refractor (#4454)
* markdown files and env examples cleanup

* components update

* update jsonlines description

* server refractor

* update telemetry

* add execute custom node

* add ui refractor

* add username and password authenticate

* correctly retrieve past images in agentflowv2

* disable e2e temporarily

* add existing username and password authenticate

* update migration to default workspace

* update todo

* blob storage migrating

* throw error on agent tool call error

* add missing execution import

* add referral

* chore: add error message when importData is undefined

* migrate api keys to db

* fix: data too long for column executionData

* migrate api keys from json to db at init

* add info on account setup

* update docstore missing fields

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-27 07:29:42 +01:00
Henry Heng b55fe07511
Feature/add enable bull dashboard env var (#4373)
add enable bull dashboard env var
2025-05-04 21:55:16 +08:00
Henry Heng a2a475ba7a
Feature/Add bullmq redis for message queue processing (#3568)
* add bullmq redis for message queue processing

* Update pnpm-lock.yaml

* update queue manager

* remove singleton patterns, add redis to cache pool

* add bull board ui

* update rate limit handler

* update redis configuration

* Merge add rate limit redis prefix

* update rate limit queue events

* update preview loader to queue

* refractor namings to constants

* update env variable for queue

* update worker shutdown gracefully
2025-01-23 14:08:02 +00:00
Henry Heng d60242c224
Feat/add multer s3 (#3854)
* add multer s3

* add types multer s3

* update multer s3 implementation

* Revert "update multer s3 implementation"

This reverts commit 9a25bf57a9.

* update storage utils

* update multer storage type on routes

* revert getMulterStorage

* revert getMulterStorage

* update getmulterstorage

* update getmulterstorage

* update getmulterstorage
2025-01-12 23:00:34 +00:00
Henry Heng 8d266052ae
Feature/update upsert API (#3836)
* update upsert API

* add fix for override files in upsert vector
2025-01-09 13:22:35 +00:00
Vinod Kiran fe03683f0c
FEATURE:: Support for metrics collection - Prometheus and Open Telemetry (#3420)
* adding support for prometheus and grafana

* open telemetry

* lint fixes

* missing counter and telemetry standardization

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-11-08 00:00:43 +00:00
akoo24 d9bf612448
Support global-agent for central proxy configuration (#3423)
* * Added global-agent as central Global HTTP/HTTPS proxy configurable using environment variable
**  https://www.npmjs.com/package/global-agent
* Server-Bootstrap on index.js
** import 'global-agent/bootstrap'
* added dep in package.json
** global-agent: "^3.0.0

* * Added global-agent as central Global HTTP/HTTPS proxy configurable using environment variable
**  Added env variables

* update env example

* update env and lock file

* update env and lock file

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-11-01 18:05:04 +00:00
Henry Heng 53e504c32f
Feature/Full File Uploads & Message Delete API (#3314)
* add functionality for full file uploads, add remove messages from view dialog and API

* add attachments swagger

* update question to include uploadedFilesContent

* make config dialog modal lg size
2024-10-23 11:00:46 +01:00
Henry Heng 8c1f0bdbe9
Bugfix/Add version API as public (#3297)
add version API as public
2024-10-02 19:34:42 +01:00
Vinod Kiran 26444ac3ae
Feature/sse (#3125)
* Base changes for ServerSide Events (instead of socket.io)

* lint fixes

* adding of interface and separate methods for streaming events

* lint

* first draft, handles both internal and external prediction end points.

* lint fixes

* additional internal end point for streaming and associated changes

* return streamresponse as true to build agent flow

* 1) JSON formatting for internal events
2) other fixes

* 1) convert internal event to metadata to maintain consistency with external response

* fix action and metadata streaming

* fix for error when agent flow is aborted

* prevent subflows from streaming and other code cleanup

* prevent streaming from enclosed tools

* add fix for preventing chaintool streaming

* update lock file

* add open when hidden to sse

* Streaming errors

* Streaming errors

* add fix for showing error message

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-09-17 08:01:25 +01:00
Henry Heng 286121e4e3
Bugfix/Auth URL Bypass (#3095)
add fixes to prevent bypassing api url
2024-08-27 16:35:52 +01:00
Henry Heng 75f779f861
Bugfix/whitelist urls for non password protected instance (#3085)
whitelist urls for non password protected instance
2024-08-26 11:29:46 +01:00
Octavian FlowiseAI e8f5f07735
Feature: interactive swagger-ui auto-generated API docs from express (#1812)
* Add interactive swagger-ui auto-generated API docs from express

* Update README.md

* Update index.ts //@ts-ignore

* Fix eslint no-console error

* Add swagger paths

* Add all end  points

* Update swagger.yml

* update swagger yml file

* update swagger config

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-08-25 13:22:07 +01:00
YISH 83ecc88b35
feat (server): add support for setting listening host (#2604) 2024-06-21 14:51:03 +01:00
Henry Heng 582dcc8508
Feature/add status check ping (#2579)
add status check ping
2024-06-04 18:45:45 +01:00
Henry Heng e32b643445
Bugfix/Regex check for auth middleware (#2469)
add regex check for auth middleware
2024-05-23 15:46:11 +01:00
Saurabh Gupta 823cefb5c5
fix initDatabase function by proper use of await in try catch (#2360)
* fix initDatabase function by proper use of await in try catch

* lint-fix

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-13 12:15:22 +01:00
Henry Heng 80f24ac30c
Bugfix/Default file size limit (#2334)
update default flowise file size limit
2024-05-06 17:21:22 +01:00
Vinod Kiran 40e36d1b39
Feature/DocumentStore (#2106)
* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-06 15:23:27 +01:00
Ilango db452cd74d
Feature: Collect contact information from users inside the chatbot (#1948)
* Add leads settings to chatflow configuration

* Add leads tab to chatflow configuration with options for lead capture

* Add database entity and migrations for leads

* Add endpoint for adding and fetching leads

* Show lead capture form in UI chat window when enabled

* Add view leads dialog

* Make export leads functional

* Add input for configuring message on successful lead capture

* Add migrations for adding lead email in chat message if available

* show lead email in view messages

* ui touch up

* Remove unused code and update how lead email is shown in view messages dialog

* Fix lead not getting saved

* Disable input when lead form is shown and save lead info to localstorage

* Fix lead capture form not working

* disabled lead save button until at least one form field is turned on, get rid of local storage _LEAD

* add leads API to as whitelist public endpoint

* Send leadEmail in internal chat inputs

* Fix condition for disabling input field and related buttons when lead is enabled/disabled and when lead is saved

* update leads ui

* update error message and alter table add column sqlite migration

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-05-02 01:54:59 +01:00
Henry Heng 5775947586
Bugfix/IP API (#2283)
fix ip API
2024-04-29 22:19:31 +01:00
Henry Heng 7360d1d9a6
Feature/OpenAI Assistant V2 (#2258)
* add gpt4 turbo to assistant

* OpenAI Assistant V2

* update langfuse handler
2024-04-25 20:14:04 +01:00
automaton82 2cadd68a43
Changing 'Output Schema' to 'Input Schema' (#2199) 2024-04-17 10:30:41 +01:00
Octavian FlowiseAI 957694a912
feature: modularized express routes for reusability, testability, composability and performance (#2030)
* transition GET /api/v1/apikey

* transition POST /api/v1/apikey

* transition PUT /api/v1/apikey/:id

* transition DELETE /api/v1/apikey/:id

* Enable e2e tests for api/v1/apikey routes

* remove unused addChatflowsCount

* Enable e2e tests for api/v1/variables routes

* Enable Cypress in GitHub Action

* Update main.yml

* Update main.yml

* Transition GET /api/v1/variables

* Enable cypress on github workflow

* Transition POST /api/v1/variables

* Transition PUT /api/v1/variables

* Transition DELETE /api/v1/variables

* Transition GET /api/v1/variables

* Transition GET /api/v1/chatflows

* Transition GET /api/v1/chatflows/:id

* Transition POST /api/v1/chatflows

* Transition DELETE /api/v1/chatflows/:id

* Transition PUT /api/v1/chatflows/:id

* Transition GET /api/v1/chatflows/apikey/:apiKey

* Transition GET /api/v1/credentials

* Transition POST /api/v1/credentials

* Transition GET /api/v1/credentials/:id

* Transition PUT /api/v1/credentials/:id

* Transition DELETE /api/v1/credentials/:id

* Transition GET /api/v1/tools

* Transition GET /api/v1/tools/:id

* Transition POST /api/v1/tools

* Transition PUT & DELETE /api/v1/tools/:id

* Transition /api/v1/assistants routes

* Transition /api/v1/nodes routes

* Transition GET /api/v1/chatflows-streaming/:id & GET /api/v1/chatflows-uploads/:id

* wip-all-routes

* Transition GET /api/v1/public-chatflows/:id & /api/v1/public-chatbotConfig/:id

* Remove ts-ignore annotations

* Transition GET /api/v1/chatmessage/:id

* Transition POST /api/v1/chatmessage/:id

* delete /api/v1/chatmessage/:id

* transition /api/v1/feedback/:id routes

* transition /api/v1/stats/:id

* Transition GET /api/v1/openai-assistants/:id

* Transition GET /api/v1/openai-assistants

* Transition POST /api/v1/openai-assistants-file

* transition GET /api/v1/get-upload-path

* transition GET /api/v1/get-upload-file

* transition GET /api/v1/flow-config/:id

* transition POST /api/v1/node-config

* transition GET /api/v1/version

* transition GET /api/v1/fetch-links

* transition POST /api/v1/vector/upsert/:id

* transition POST /api/v1/vector/internal-upsert/:id

* transition POST /api/v1/load-prompt

* Update index.ts

* transition POST /api/v1/prompts-list

* transition predictions

* Update index.ts

* transition GET /api/v1/marketplaces/templates

* Router update modularity cleanup

* extend request interface - express namespace

* Update index.ts

* add errorMiddleware

* Add custom application error handler

* Fix pnpm lock file

* prediction return and vector upsert

* Move the getUploadsConfig into its own file

* Remove lint warnings

* fix undefined variable value

* Fix node-load-method api call

* standardize the error message display

* Apply review comment bugfixes

* Update index.ts

* standardize error message display  in snack notifications

* Error message standard in the UI

* Rename flowXpressApp to appServer

* Upload middleware fix and axios update

* fix async await

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-02 16:44:04 +01:00
Vinod Paidimarry 0c0308b9c4
BugFix/Spelling correction in telemetry payload (#2001)
spelling correction
2024-03-21 01:51:50 +08:00
Emrah TOY ec1bbc84bc
Fix#1947 (#1960)
* Fixes #1947

* Lint fix

* fallback from timestamp with timezone to timestamp

---------

Co-authored-by: Emrah TOY <emrah.toy@mtekbilisim.com>
2024-03-19 17:57:45 +08:00
vinodkiran 01559d4da3 Adding support for AzureChatOpenAI 2024-03-16 09:39:09 +05:30
Henry fa081acea0 Merge branch 'main' into feature/Indexing
# Conflicts:
#	pnpm-lock.yaml
2024-03-15 15:30:37 +08:00
Ilango 02963ce0d5 Fix warnings 2024-03-13 05:57:10 +05:30
Ilango b6e0b08f92 Fix merge conflicts 2024-03-12 13:29:30 +05:30
Ilango 7313891ea1 Fix merge conflict 2024-03-12 12:46:25 +05:30
Ilango 150da68dc8 Fix merge conflicts 2024-03-11 22:21:25 +05:30
Ilango 2a30dbfd4c Fix issue in total feedback received stat 2024-03-11 22:00:43 +05:30
Ilango ed6b3b2a6d Update stats API - date and source filters apply to stats 2024-03-11 21:54:42 +05:30
Ilango 131eccef45 Implement chat message feedback for UI chat window 2024-03-11 21:07:20 +05:30
Ilango 13ee0d0c7b
Merge pull request #1765 from 0xi4o/feature/allowed-domains
Feature: Allowed domains for chatflows
2024-03-11 16:16:53 +05:30
Ilango ac35d5f667 Merge branch 'main' of github.com:0xi4o/Flowise into feature/chat-message-feedback 2024-03-11 16:04:47 +05:30
Henry Heng 33eb72f58a
Merge pull request #1910 from JoeABCDEF/main
Fixed a bug about conversation dates
2024-03-11 15:47:45 +08:00
vinodkiran 2d208e1f99 Merge branch 'main' into FEATURE/Claude_vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
2024-03-11 09:50:33 +05:30
Joe d98ac8236a Fixed the issue of inconsistent date creation, if the running server and the database are in different regions, the generated date will be inconsistent, and the generated date will be inconsistent 2024-03-09 18:39:56 +08:00
automaton82 3fda7973bb Removing semicolons 2024-03-07 09:45:28 -05:00
automaton82 8c1a68a37e Fix for 1881 sorting for Flowise QnA 2024-03-07 09:15:13 -05:00
vinodkiran 63b8c23072 Addition of Claude for Image uploads 2024-03-07 18:55:24 +05:30
Henry 3b84e718a2 fix isValidAllowedOrigins check and invalid URL 2024-03-07 19:22:33 +08:00
Ilango b804ceaa47 Add type annotation for datasource 2024-03-06 16:55:09 +05:30
vinodkiran da43fb7f44 Base changes to enable AzureChatOpenAI for image upload 2024-03-06 12:30:39 +05:30
Ilango d706ca389f Detect host from list of allowed urls even if they have http/https 2024-03-05 17:23:49 +05:30
Ilango d0ddf018c7 Update access denied error message 2024-02-28 18:45:34 +05:30