Commit Graph

939 Commits

Author SHA1 Message Date
Henry Heng e3eeb5d8a8 Bugfix/Remove Redundant Distinct (#4865)
remove redundant distinct
2025-07-14 12:35:50 +01:00
Henry Heng ee5ab1bd6d Chore/patch dependencies (#4858)
patch dependencies
2025-07-13 20:56:29 +01:00
Henry Heng 849b94b049 Release/3.0.4 (#4845)
flowise@3.0.4
2025-07-11 12:26:10 +01:00
Vinod Kiran bf05f25f7e New Feature Pagination (#4704)
* common pagination component

* Pagination for Doc Store Dashboard

* Pagination for Executions Dashboard

* Pagination Support for Tables

* lint fixes

* update view message dialog UI

* initial loading was ignoring the pagination counts

* 1) default page size change
2) ensure page limits are passed on load
3) co-pilot review comments (n+1 query)
4)

* 1) default page size change
2) ensure page limits are passed on load
3) co-pilot review comments (n+1 query)
4) refresh lists after insert/delete.

* Enhancement: Improve handling of empty responses in DocumentStore and API key services

- Added check for empty entities in DocumentStoreDTO.fromEntities to return an empty array.
- Updated condition in getAllDocumentStores to handle total count correctly, allowing for zero total.
- Refined logic in getAllApiKeys to check for empty keys and ensure correct API key retrieval.
- Adjusted UI components to safely handle potential undefined apiKeys array.

* Refresh API key list on pagination change

* Enhancement: Update pagination and filter handling across components
- Increased default items per page in AgentExecutions from 10 to 12.
- Improved JSON parsing for chat type and feedback type filters in ViewMessagesDialog.
- Enhanced execution filtering logic in AgentExecutions to ensure proper pagination and state management.
- Refactored filter section in AgentExecutions for better readability and functionality.
- Updated refresh logic in Agentflows to use the correct agentflow version.

* add workspaceId to removeAllChatMessages

* Refactor chat message retrieval logic for improved efficiency and maintainability

- Introduced a new `handleFeedbackQuery` function to streamline feedback-related queries.
- Enhanced pagination handling for session-based queries in `getMessagesWithFeedback`.
- Updated `ViewMessagesDialog` to sort messages in descending order by default.
- Simplified image rendering logic in `DocumentStoreTable` for better readability.

* - Update  `validateChatflowAPIKey` and `validateAPIKey` functions to get the correct keys array
- Enhanced error handling in the `sanitizeExecution` function to ensure safe access to nested properties

* Refactor API key validation logic for improved accuracy and error handling

- Consolidated API key validation in `validateAPIKey` to return detailed validation results.
- Updated `validateFlowAPIKey` to streamline flow API key validation.
- Introduced `getApiKeyById` function in the API key service for better key retrieval.
- Removed unused function `getAllChatSessionsFromChatflow` from the chat message API.

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-07-10 15:59:24 +01:00
Ong Chung Yau 6baec93860 Optimize export import (#4795)
* feat: add saveBatch and optimize duplication id handling

* feat: improve lookup performance by using Set
2025-07-09 18:36:47 +08:00
Henry Heng be7599542b Release/3.0.3 (#4746)
flowise@3.0.3
2025-06-27 09:58:49 +01:00
Henry Heng e326bc8f49 Bugfix/Refactor createFileAttachment to streamline chatId validation (#4740)
Removed redundant chatId validation and path traversal checks, improving code clarity and maintainability. The chatId is now validated after the chatflowid check, ensuring proper error handling for invalid inputs.
2025-06-26 16:14:04 +01:00
Henry Heng e7553a1c4e Bugfix/Allow OverrideConfig For Multiple Nodes In AgentflowV2 (#4734)
Bugfix/Enhance input configuration merging logic in replaceInputsWithConfig

Improve the handling of input configurations by merging existing values with overrides instead of complete replacement. This includes support for merging objects and parsing JSON strings when necessary.
2025-06-26 14:55:26 +01:00
Henry Heng c78b5326b6 Bugfix/Add orgId for file fetching from messages (#4732)
add orgId for file fetching from messages
2025-06-25 17:28:14 +01:00
Henry Heng d5bc718246 Bugfix/Concatenate overrideconfig array (#4720)
concatenate overrideconfig array
2025-06-24 21:59:56 +01:00
Henry Heng 3f26569e6e Bugfix/Multiple Human Input Nodes (#4718)
Refactor: Remove humanInput parameter from determineNodesToIgnore function

- Updated the determineNodesToIgnore function to eliminate the humanInput parameter, simplifying the logic for decision nodes.
- Adjusted related function calls to ensure compatibility with the new signature.
- Enhanced handling of humanInput within the executeNode function, ensuring it is cleared after consumption to prevent unintended behavior in subsequent nodes.
2025-06-24 19:30:50 +01:00
Henry Heng 397ba63d60 Bugfix/Circular Dependency of updateStorageUsage and checkStorage in utils (#4717)
fix circular dependency of updateStorageUsage and checkStorage in utils
2025-06-24 17:24:45 +01:00
Henry Heng 543800562e Chore/API for AgentflowV2 (#4696)
* Enhancement: Introduce prepended chat history handling in Agent and LLM nodes.

- Added support for `prependedChatHistory` in both `Agent` and `LLM` classes to allow for initial message context.
- Implemented validation for history schema in execution flow to ensure proper format.
- Refactored utility functions to include JSON sanitization and validation methods for improved data handling.

* update prediction swagger
2025-06-22 13:16:35 +01:00
Vinod Kiran 9a60b7b223 New Feature: Ability to change role for a workspace user. (#4616)
* New Feature: Ability to change role for a workspace user.

* reverting some of the changes in workspace-user.service.ts and minor code cleanup in the ui components.

* chore: refactor updateWorkspaceUser function queryRunner handling

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-06-19 18:37:29 +01:00
Henry Heng a107aa7a77 Chore/Update issue templates and add new tools (#4687)
* Enhancement: Update issue templates and add new tools

- Updated bug report template to include a default label of 'bug'.
- Updated feature request template to include a default label of 'enhancement'.
- Added new credential class for Agentflow API.
- Enhanced Agent and HTTP nodes to improve tool management and error handling.
- Added deprecation badges to several agent and chain classes.
- Introduced new tools for handling requests (GET, POST, DELETE, PUT) with improved error handling.
- Added new chatflows and agentflows for various use cases, including document QnA and translation.
- Updated UI components for better handling of agent flows and marketplace interactions.
- Refactored utility functions for improved functionality and clarity.

* Refactor: Remove beta badge and streamline template title assignment

- Removed the 'BETA' badge from the ExtractMetadataRetriever class.
- Simplified the title assignment in the agentflowv2 generator by using a variable instead of inline string manipulation.
2025-06-19 18:11:24 +01:00
Henry Heng 8ba1a09077 Bugfix/Update worker docker (#4643)
update worker docker
2025-06-12 17:25:43 +01:00
Henry Heng 306b6fbb31 Release/3.0.2 (#4629)
flowise@3.0.2
2025-06-11 14:18:51 +01:00
Ong Chung Yau 21caedde72 feature/single-organization-limit (#4620)
feat: enforce single organization limit during registration
2025-06-10 16:12:09 +01:00
Vinod Kiran e17994d8fe Evaluations for Agentflows v2 & Assistants (#4589)
* New Feature: Evaluations for AgentFlow v2

* New Feature: Evaluations for Assistants and minor tweaks on other evaluations.

* do not store messages during evaluation for agent flows.

* common cost formatting

* moving the category names to description (in create dialog) and adjusting the side drawer label

* lint fixes

* Enhancement: Add auto-refresh toggle for evaluations with 5-second interval and adjust grid item size for metrics display.

* 1) chatflow types are stored in additional config
2) messages are now stored with type "Evaluations"
3) Message Dialog has a new Type in the ChatType Filter Dropdown
4) Chatflow badges on the view page, have the right canvas URL
5) outdated API returns chatflow type along with the stale indicator.
6) UI - Flow Indicator Icons are shown in the Chatflows Used chips & side drawer

* Refactor JWT error handling to return 401 status for expired refresh tokens. Update chat message ID assignment to remove UUID fallback. Enhance ViewMessagesDialog to set default chat type filters and implement a new method for determining chat type sources. Modify EvalsResultDialog to open links in a new tab and adjust icon sizes for better consistency. Clean up unused imports in EvaluationResultSideDrawer.

* handling on Click for deleted flows and minor code cleanup

* evals ui fix

* Refactor evaluation service to improve error handling and data parsing. Update additionalConfig handling to default to an empty object if not present. Enhance type definitions for better clarity. Adjust MetricsItemCard to prevent overflow and improve layout consistency.

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-06-10 16:11:22 +01:00
Sai Shreya Kumar f644c47251 fix(docker): uncomment required env variables (#4606)
* fix(docker): uncomment required env variables

* fix(env): uncomment required JWT variables in Server .env.example
2025-06-09 13:19:02 +01:00
Henry Heng f45ca72df2 Bugfix/Default jwt vars (#4614)
fix default jwt vars
2025-06-09 00:49:50 +01:00
Henry Heng 02a6753498 Bugfix/Overrideconfig Analytics in AgentflowV2 (#4599)
* fix(utils/buildAgentflow): enhance analytic handler configuration to support overrides

* fix(agentflow): integrate analytic handlers for tool execution tracking
2025-06-07 01:53:31 +01:00
Henry Heng 30c4180d97 Feature/Add teams, gmail, outlook tools (#4577)
* add teams, gmail, outlook tools

* update docs link

* update credentials for oauth2

* add jira tool

* add google drive, google calendar, google sheets tools, powerpoint, excel, word doc loader

* update jira logo

* Refactor Gmail and Outlook tools to remove maxOutputLength parameter and enhance request handling. Update response formatting to include parameters in the output. Adjust Google Drive tools to simplify success messages by removing unnecessary parameter details.
2025-06-06 19:52:04 +01:00
Ong Chung Yau 6dcb65cedb feature/cli-reset-password (#4585)
* feat: add cli to reset password

* chore: add information for password reset command

* fix: add information for password reset command
2025-06-06 19:16:16 +01:00
Kang Nahoon 8793ed628c bugfix/Fix SQL syntax error when reverting migration in MariaDB (#4565)
* Bugfix/Use backticks when dropping `errors` column for MariaDB compatibility (#4564)

* Bugfix/Use backticks when dropping `sequence_no` column for MariaDB compatibility (#4564)

* Bugfix/Use backticks when dropping sso columns for MariaDB compatibility (#4564)
2025-06-05 19:31:16 +01:00
Henry Heng 63ff703e7a Chore/standardize password criteria (#4550)
standardize password criteria
2025-06-01 10:41:47 +01:00
Henry Heng a88337cc83 Bugfix/config input for multiple same fields (#4548)
* fix config input for multiple same fields

* fix custom tool not selected
2025-05-31 17:03:03 +01:00
Henry Heng eb69b23d73 Chore/add loggers (#4541)
add loggers
2025-05-29 22:36:48 +01:00
Henry Heng 7c803f4e0b Release/3.0.1 (#4537)
flowise@3.0.1
2025-05-29 17:49:17 +01:00
Henry Heng 979920ff7f Bugfix/Update import api keys (#4536)
update import api keys, remove redundant functions
2025-05-29 17:40:27 +01:00
eriksonssilva 6f8079f6ee fix: allow non-UUID sessionId by changing column type to varchar (#4457)
* fix: allow non-UUID sessionId by changing column type to varchar

* update postgres migration

* Update pnpm-lock.yaml

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-28 18:05:24 +01:00
russelj1 27bc47ed57 Feature: Add dot notation support for nested output variable resolution (#4506)
Add dot notation support for nested output variable resolution
2025-05-28 15:24:43 +01:00
Henry Heng 2baa43d66f Bugfix/Resolve variable from http node (#4518)
resolve variable from http node
2025-05-28 01:47:04 +01:00
nikitas-novatix 4326cbe6b5 Fix: Patching redis socket crash fix (#4431)
* redis keepalive mechanism for all redis

* removed offline queue commands

* Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable.

* update redis socket alive env variable

* lint fix

* put pingInterval back again because it's needed

* removed comment

* linting

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-27 19:54:17 +01:00
Henry Heng 01dab4365a Bugfix/AgentflowV2 State (#4512)
* add persistence state, http node variables, custom function flow state

* update marketplace templates
2025-05-27 18:01:39 +01:00
Henry 66bf0749af removed hardcoded default host 2025-05-27 07:51:20 +01:00
Henry Heng 5a37227d14 Chore/refractor (#4454)
* markdown files and env examples cleanup

* components update

* update jsonlines description

* server refractor

* update telemetry

* add execute custom node

* add ui refractor

* add username and password authenticate

* correctly retrieve past images in agentflowv2

* disable e2e temporarily

* add existing username and password authenticate

* update migration to default workspace

* update todo

* blob storage migrating

* throw error on agent tool call error

* add missing execution import

* add referral

* chore: add error message when importData is undefined

* migrate api keys to db

* fix: data too long for column executionData

* migrate api keys from json to db at init

* add info on account setup

* update docstore missing fields

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-27 07:29:42 +01:00
Henry Heng cf67afb078 Bugfix/add missing imports (#4476)
add missing imports
2025-05-21 15:06:30 +08:00
Henry Heng 4786aafddc Bugfix/execute custom function to worker (#4440)
* pass execute custom function to worker

* update execute function
2025-05-16 15:32:21 +08:00
Henry Heng 0a4570ecda Bugfix/pass execute custom function to worker (#4432)
pass execute custom function to worker
2025-05-16 01:13:25 +08:00
Henry Heng a6e64230b4 Release/3.0.0 (#4425)
release@3.0.0
2025-05-15 09:30:18 +08:00
Henry Heng 624143ad15 Chore/disable telemetry by default (#4427)
disable telemetry by default
2025-05-15 00:19:05 +08:00
k-santos 761a6416ab bugfix: fix the presentation of the source (#4400)
fix: add case to source handler
2025-05-14 10:30:56 +08:00
Henry Heng 82d16458e4 Bugfix/Update file loader (#4420)
* update file loader

* delete temp for o1

* fix tavily
2025-05-14 10:30:33 +08:00
nikitas-novatix eadf1b11b3 Fix: Add keep-alive options to Redis clients to prevent idle timeouts and socket closing. (#4377)
* redis keepalive mechanism for all redis

* removed offline queue commands

* Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable.

* update redis socket alive env variable

* lint fix

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-14 10:29:32 +08:00
toi500 a8f990c242 Feature/add Deep Research V2 Template (#4422)
add new V2 template
2025-05-13 11:05:03 +08:00
Henry Heng 4a0e86b30f Chore/update i18n readme (#4418)
* update i18n readme

* update server README
2025-05-11 20:42:28 +08:00
Henry Heng 10f85ef47e Bugfix/Update agentflow v2 events to redis subscriber (#4415)
update agentflow v2 events to redis subscriber
2025-05-11 18:43:28 +08:00
Henry Heng 7924fbce0d Feature/agentflow v2 (#4298)
* agent flow v2

* chat message background

* conditon agent flow

* add sticky note

* update human input dynamic prompt

* add HTTP node

* add default tool icon

* fix export duplicate agentflow v2

* add agentflow v2 marketplaces

* refractor memoization, add iteration nodes

* add agentflow v2 templates

* add agentflow generator

* add migration scripts for mysql, mariadb, posrgres and fix date filters for executions

* update agentflow chat history config

* fix get all flows error after deletion and rename

* add previous nodes from parent node

* update generator prompt

* update run time state when using iteration nodes

* prevent looping connection, prevent duplication of start node, add executeflow node, add nodes agentflow, chat history variable

* update embed

* convert form input to string

* bump openai version

* add react rewards

* add prompt generator to prediction queue

* add array schema to overrideconfig

* UI touchup

* update embedded chat version

* fix node info dialog

* update start node and loop default iteration

* update UI fixes for agentflow v2

* fix async drop down

* add export import to agentflowsv2, executions, fix UI bugs

* add default empty object to flowlisttable

* add ability to share trace link publicly, allow MCP tool use for Agent and Assistant

* add runtime message length to variable, display conditions on UI

* fix array validation

* add ability to add knowledge from vector store and embeddings for agent

* add agent tool require human input

* add ephemeral memory to start node

* update agent flow node to show vs and embeddings icons

* feat: add import chat data functionality for AgentFlowV2

* feat: set chatMessage.executionId to null if not found in import JSON file or database

* fix: MariaDB execution migration script to utf8mb4_unicode_520_ci

---------

Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-10 10:21:26 +08:00
Ong Chung Yau 82e6f43b5c fix/import-missing-chat-data (#4401)
fix: add missing imports for messages and feedbacks in AgentFlow and AssistantFlow
2025-05-08 18:43:28 +08:00