* refactor: Implement SecureZodSchemaParser for safe Zod schema handling and add FilterParser for Supabase filters
* Replaced direct Zod schema evaluation with SecureZodSchemaParser in StructuredOutputParserAdvanced and CustomTool.
* Introduced FilterParser to safely handle Supabase filter strings, preventing arbitrary code execution.
* Added new filterParser.ts file to encapsulate filter parsing logic.
* Updated Supabase vector store to utilize the new FilterParser for RPC filters.
* Created secureZodParser.ts for secure parsing of Zod schemas.
* remove console log
* Enhancement: Add recursive key normalization for metadata in Weaviate vector store
- Introduced `normalizeKeysRecursively` utility to standardize metadata keys.
- Updated Weaviate vector store to apply normalization on document metadata before processing.
* format(compnonents/utils): format for ci
* Update utils.ts
---------
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
Update README files for Postgres Record Manager and Vector Store to include a new SSL environment variable, allowing optional SSL configuration for database connections
* adding support for prometheus and grafana
* open telemetry
* lint fixes
* missing counter and telemetry standardization
---------
Co-authored-by: Henry <hzj94@hotmail.com>
* added tls support
* forgot to add tls to init function as well, it works now.
* added partition support for Milvus
* updated to 2.0.6 , pnpm lint fix aswell
* ensure it points to _default partition if none provided
* update milvus versioning
---------
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
* added meilisearch retriever and credentials.ts
* added semantic ratio
* removed a TODO implementatio
* meilisearch component implemented with searching and upsert functionality (#3)
meilisearch retriever component created , searching for an existing index and upserting a new or existing index has been implemented , component utilizes langchain and meilisearch vector search
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/3
Reviewed-by: mohamed1999akram <mohamed1999akram@gmail.com>
* added CI/CD for ntg branch, added proper dockerfile for flowise-ntg (#4)
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/4
Reviewed-by: mohammad <mohammad@noreply.git.beyond.cc>
* modified os version , removed linting errors , removed cypress github actions (#5)
added --no-lock-file flag to pass CICD , made the runner run on debian and not ubuntu , removed code that caused warnings to pass linting
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/5
Reviewed-by: omaryassery <omarryassser@gmail.com>
* removed unnecessary QEMU install action (#6)
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/6
Reviewed-by: omaryassery <omarryassser@gmail.com>
* removed cypress installation and linting from dockerfile (#7)
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/7
Reviewed-by: isameh <isameh@ntgclarity.com>
* dockerfile-ntg-modification (#9)
dockerfile-ntg modified to copy all working directory before calling pnpm install
Reviewed-on: https://git.beyond.cc/ntg/flowise/pulls/9
Reviewed-by: isameh <isameh@ntgclarity.com>
* resolved comments, reverted CI/CD
* add test docker build yml back
* moved meilisearch to vector store folder
* Update Meilisearch.ts
---------
Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
* Document Store - Phase 2
* Adding additional columns for vector store config, document store phase 2
* Adding additional columns for vector store config, document store phase 2
* Document Store - Phase 2 - Upsert and Query
* ux cleanup
* retrieval settings and more ux changes
* adding MMR params to execution
* Making the upsert process async.
* add upsert history changes
* making the searchParams dynamic
* removing unnecessary params
* add ability to delete data from vector store
* update margin for vector store query
* adding option to save config in the retrieval playground
* adding chunk number for query return chunks
* Adding a Document Store node in the VectorStore category
* update doc store status, ui touchup
---------
Co-authored-by: Henry <hzj94@hotmail.com>