Commit Graph

611 Commits

Author SHA1 Message Date
Henry Heng eb69b23d73 Chore/add loggers (#4541)
add loggers
2025-05-29 22:36:48 +01:00
Henry Heng 979920ff7f Bugfix/Update import api keys (#4536)
update import api keys, remove redundant functions
2025-05-29 17:40:27 +01:00
eriksonssilva 6f8079f6ee fix: allow non-UUID sessionId by changing column type to varchar (#4457)
* fix: allow non-UUID sessionId by changing column type to varchar

* update postgres migration

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-28 18:05:24 +01:00
russelj1 27bc47ed57 Feature: Add dot notation support for nested output variable resolution (#4506)
Add dot notation support for nested output variable resolution
2025-05-28 15:24:43 +01:00
Henry Heng 2baa43d66f Bugfix/Resolve variable from http node (#4518)
resolve variable from http node
2025-05-28 01:47:04 +01:00
nikitas-novatix 4326cbe6b5 Fix: Patching redis socket crash fix (#4431)
* redis keepalive mechanism for all redis

* removed offline queue commands

* Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable.

* update redis socket alive env variable

* lint fix

* put pingInterval back again because it's needed

* removed comment

* linting

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-27 19:54:17 +01:00
Henry Heng 01dab4365a Bugfix/AgentflowV2 State (#4512)
* add persistence state, http node variables, custom function flow state

* update marketplace templates
2025-05-27 18:01:39 +01:00
Henry 66bf0749af removed hardcoded default host 2025-05-27 07:51:20 +01:00
Henry Heng 5a37227d14 Chore/refractor (#4454)
* markdown files and env examples cleanup

* components update

* update jsonlines description

* server refractor

* update telemetry

* add execute custom node

* add ui refractor

* add username and password authenticate

* correctly retrieve past images in agentflowv2

* disable e2e temporarily

* add existing username and password authenticate

* update migration to default workspace

* update todo

* blob storage migrating

* throw error on agent tool call error

* add missing execution import

* add referral

* chore: add error message when importData is undefined

* migrate api keys to db

* fix: data too long for column executionData

* migrate api keys from json to db at init

* add info on account setup

* update docstore missing fields

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-27 07:29:42 +01:00
Henry Heng cf67afb078 Bugfix/add missing imports (#4476)
add missing imports
2025-05-21 15:06:30 +08:00
Henry Heng 4786aafddc Bugfix/execute custom function to worker (#4440)
* pass execute custom function to worker

* update execute function
2025-05-16 15:32:21 +08:00
Henry Heng 0a4570ecda Bugfix/pass execute custom function to worker (#4432)
pass execute custom function to worker
2025-05-16 01:13:25 +08:00
Henry Heng 624143ad15 Chore/disable telemetry by default (#4427)
disable telemetry by default
2025-05-15 00:19:05 +08:00
k-santos 761a6416ab bugfix: fix the presentation of the source (#4400)
fix: add case to source handler
2025-05-14 10:30:56 +08:00
Henry Heng 82d16458e4 Bugfix/Update file loader (#4420)
* update file loader

* delete temp for o1

* fix tavily
2025-05-14 10:30:33 +08:00
nikitas-novatix eadf1b11b3 Fix: Add keep-alive options to Redis clients to prevent idle timeouts and socket closing. (#4377)
* redis keepalive mechanism for all redis

* removed offline queue commands

* Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable.

* update redis socket alive env variable

* lint fix

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-14 10:29:32 +08:00
Henry Heng 10f85ef47e Bugfix/Update agentflow v2 events to redis subscriber (#4415)
update agentflow v2 events to redis subscriber
2025-05-11 18:43:28 +08:00
Henry Heng 7924fbce0d Feature/agentflow v2 (#4298)
* agent flow v2

* chat message background

* conditon agent flow

* add sticky note

* update human input dynamic prompt

* add HTTP node

* add default tool icon

* fix export duplicate agentflow v2

* add agentflow v2 marketplaces

* refractor memoization, add iteration nodes

* add agentflow v2 templates

* add agentflow generator

* add migration scripts for mysql, mariadb, posrgres and fix date filters for executions

* update agentflow chat history config

* fix get all flows error after deletion and rename

* add previous nodes from parent node

* update generator prompt

* update run time state when using iteration nodes

* prevent looping connection, prevent duplication of start node, add executeflow node, add nodes agentflow, chat history variable

* update embed

* convert form input to string

* bump openai version

* add react rewards

* add prompt generator to prediction queue

* add array schema to overrideconfig

* UI touchup

* update embedded chat version

* fix node info dialog

* update start node and loop default iteration

* update UI fixes for agentflow v2

* fix async drop down

* add export import to agentflowsv2, executions, fix UI bugs

* add default empty object to flowlisttable

* add ability to share trace link publicly, allow MCP tool use for Agent and Assistant

* add runtime message length to variable, display conditions on UI

* fix array validation

* add ability to add knowledge from vector store and embeddings for agent

* add agent tool require human input

* add ephemeral memory to start node

* update agent flow node to show vs and embeddings icons

* feat: add import chat data functionality for AgentFlowV2

* feat: set chatMessage.executionId to null if not found in import JSON file or database

* fix: MariaDB execution migration script to utf8mb4_unicode_520_ci

---------

Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-10 10:21:26 +08:00
Ong Chung Yau 82e6f43b5c fix/import-missing-chat-data (#4401)
fix: add missing imports for messages and feedbacks in AgentFlow and AssistantFlow
2025-05-08 18:43:28 +08:00
Henry Heng b55fe07511 Feature/add enable bull dashboard env var (#4373)
add enable bull dashboard env var
2025-05-04 21:55:16 +08:00
Vinod Kiran 68d3c83980 changes & fixes for various issues in chatflow config (#4314)
* Chatflow config - rate limit and override config were overwriting changes.

* prevent post processing JS function from escaping as JSON...

* non-streaming follow up prompts need to be escaped twice

* prevent post processing JS function from escaping as JSON...

* Adding file mimetypes for full file upload...

* lint..

* fixing the issue with storing only filtered nodes..

* return doc store processing response without await when queue mode and request is from UI

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-04-23 22:58:37 +08:00
Mehdi 54d1b5e3bb feat(feedback): add validation for feedback creation and update (#4260)
* feat(feedback): add validation for feedback creation and update

Introduced validation functions for feedback creation and update in the new validation service.
Updated feedback controller to utilize these validation functions before processing requests.

* refactor(feedback): update validation to return feedback object

- Modified validateFeedbackExists to return the ChatMessageFeedback object instead of a boolean.
- Updated validateFeedbackForUpdate to utilize the returned feedback object for setting default values.
2025-04-15 02:38:02 +08:00
Henry Heng a6506b3bf7 Bugfix/vector store config not saving (#4299)
fix vector store config not saving
2025-04-15 01:30:51 +08:00
allen c318fc57e9 Feat: Support Google Cloud Storage (#4061)
* support google cloud storage

* update example and docs for supporting google cloud storage

* recover the indent of pnpm-lock-yaml

* populate the logs to google logging

* normalize gcs storage paths

---------

Co-authored-by: Ilango <rajagopalilango@gmail.com>
Co-authored-by: Henry <hzj94@hotmail.com>
2025-04-14 22:52:54 +08:00
Henry Heng d53b1b657f Bugfix/Prevent empty user message when using STT (#4280)
prevent empty user message when using STT
2025-04-11 13:15:17 +08:00
Ilango 36870e94d4 Update how credential data is saved in db when using aws secrets manager (#4271)
* Update how credential data is saved in db when using aws secrets manager

* Run lint-fix and update env example
2025-04-09 14:07:18 +05:30
Ong Chung Yau 4277819c5f feature/export-import-4 (#4272)
* feat: seperate assistant export-import into custom, openai and azure

* chore: update assistant names in export data to maintain consistency
2025-04-09 16:28:51 +08:00
Henry Heng 3098c8e75f Bugfix/Prevent duplicated metrics on prometheus and opentel (#4269)
prevent duplicated metrics on prometheus and opentel
2025-04-08 17:01:26 +08:00
Vinod Kiran f963e5aa48 Bugfix - Validating IDs for all imports (#4226) 2025-04-07 11:47:17 +08:00
Henry Heng 8e63b999b8 Feature/Add remove on age and count to bullmq (#4249)
add remove on age and count to bullmq
2025-04-03 16:07:10 +08:00
Ong Chung Yau a07546145d feature/export-import-3 (#4234)
* fix: add ASSISTANT chatflow

* feat: add mvp export import for chatMessage, chatFeedback, customTemplate, documentStore

* feat: add function to handle duplicate ids during import

* chore: typo 'orginalData' to 'originalData'

* feat: add import conditions for chatMessage and chatMessageFeedback

* feat: reduce spacing before saving chatflows
2025-04-03 12:48:57 +08:00
Ilango 4fa2672c9d NVIDIA NIM fixes (#4215)
* fix: udpate label to "NVIDIA NIM API Key"

* test: update tag from ":latest" to ":1.8.0-rtx"

* test: add image URL path "nvcr.io/nim/"

* fix/nvidia-nim-2 (#4208)

* fix: update nim-container-manager

* feat: add "DeepSeek R1 Distill Llama 8B"

* fix/nidia-nim-3 (#4209)

* chore: add error message NVIDIA NIM is not installed.

* chore: standardize NVIDIA NGC API Key

* chore: capitalize Nvidia to NVIDIA

* chore: generalize error message for chat models

* fix/nvidia-nim-4-yau (#4212)

* test: nimRelaxMemConstraints and hostPort

* test: add logger for hostPort and nimRelaxMemConstraints

* test: nim-container-manager version 1.0.9

* test: parseInt nimRelaxMemConstraints

* test: update nim-container-manager version to 1.0.10

* chore: update nim-container-manager version to 1.0.11

* Update start container behaviour - show existing containers and give users the choice

* Go back to previous step when clicking start new so user can change port number

* Update condition for showing existing container dialog

* Fix start new in different port not working

* Update get container controller

* Update again

* fix: generalize error message for chat models

* Update getContainer controller

* Fix incorrect image check in getContainer controller

* Update existing container dialog text

* Fix styles in container exists dialog for nvidia nim

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
2025-03-24 15:20:09 +05:30
Saqib Ahmed 7867489727 Add curl in docker image for native healthchecks (#4170)
* Add curl in docker image for native healthchecks

Fixes this issue: https://github.com/FlowiseAI/Flowise/issues/4126

* fix: add container-native healthcheck

- Added curl utility in dockerfile
- Added healthcheck configuration in docker compose

* fix: exclude ping endpoint from logging
2025-03-14 15:24:17 +00:00
Henry Heng c2b830f279 Bugfix/arbitrary create attachemnt file upload (#4171)
fix arbitrary create attachemnt file upload
2025-03-13 19:46:27 +00:00
Egor Kopylov c6968ff385 Fix Agent Chat History Retrieval (#4163)
fixed agents history from api
2025-03-13 13:39:37 +00:00
Henry Heng 9d9aaaa886 Bugfix/S3 Credentials (#4166)
only set s3 credentials when access key and secret key exist
2025-03-12 22:21:05 +00:00
Daniel D'Abate 641df313d4 [Fix] Change S3 logger to accept more authorization methods for AWS (#4114)
* Change S3 logger to accept more authorization methods for AWS

* Lint fix
2025-03-11 17:29:34 +00:00
Henry Heng 9c22bee991 Feature/Add multi select option to composio (#4122)
* add multi select option to composio

* Update pnpm-lock.yaml
2025-03-06 09:59:33 +00:00
Rafael Reis fc9740af16 Fix for node-crashing "undefined (reading 'streaming')" error (#4104)
* check for undefined variables in buildChatflow to avoid node crashing exceptions

* Add null check on error Middleware as well
2025-02-28 22:20:48 +00:00
Henry Heng 1678815540 Feature/nim container (#3966)
* add nim container setup

* check if image or container exist before pulling

* update NIM dialog

* update chat nvidia api key

* update nim container version

* update nim container version
2025-02-27 09:14:01 +00:00
Sunny Modi 7d8541a44b Fix: ignore skipInferTableTypes on document storage process (#4068)
* Fix: ignore skipInferTableTypes on document storage process

* Update index.ts

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-02-27 09:13:32 +00:00
Vinod Kiran 9a92aa12f9 New Feature: Add post postprocessing of response from LLM using custom JS Function (#4079)
* New Feature: Add post postprocessing of response from LLM using custom Javascript functions

* Disable Save when there is no content

* add post processing ui changes, disable streaming

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-02-26 17:40:03 +00:00
Henry Heng 54cdf00e7e Feat/stream flow variables (#4022)
stream flow variables
2025-02-12 10:40:46 +00:00
Henry Heng 01cb3ef20d Bugfix/delete messages via sessionId (#3982)
delete messages via sessionId
2025-02-04 09:50:46 +00:00
Henry Heng 20a797d2e0 Feature/Add ability to create new doc store on upsert (#3965)
add ability to create new doc store on upsert, update firecrawl properties
2025-02-01 14:28:50 +00:00
Henry Heng 6e95989647 Bugfix/Overrideconfig for form data body (#3932)
fix overrideconfig for form data body
2025-01-27 11:19:26 +00:00
Henry Heng a2a475ba7a Feature/Add bullmq redis for message queue processing (#3568)
* add bullmq redis for message queue processing

* Update pnpm-lock.yaml

* update queue manager

* remove singleton patterns, add redis to cache pool

* add bull board ui

* update rate limit handler

* update redis configuration

* Merge add rate limit redis prefix

* update rate limit queue events

* update preview loader to queue

* refractor namings to constants

* update env variable for queue

* update worker shutdown gracefully
2025-01-23 14:08:02 +00:00
Henry Heng e26fc63be0 Feature/Custom Function to Seq Agent (#3612)
* add custom function to seq agent

* add seqExecuteFlow node
2025-01-23 13:04:40 +00:00
Henry Heng 1baa4f8e4f Bugfix/Allow files uploads without enabling overrideconfig (#3915)
allow files uploads without enabling overrideconfig
2025-01-22 18:20:57 +00:00
Henry Heng 5cc0e98604 Bugfix/Allow prefix vars when executing custom function (#3902)
allow prefix vars when executing custom function
2025-01-21 00:34:17 +00:00