Commit Graph

269 Commits

Author SHA1 Message Date
Henry Heng 4786aafddc Bugfix/execute custom function to worker (#4440)
* pass execute custom function to worker

* update execute function
2025-05-16 15:32:21 +08:00
Henry Heng 0a4570ecda Bugfix/pass execute custom function to worker (#4432)
pass execute custom function to worker
2025-05-16 01:13:25 +08:00
Henry Heng 624143ad15 Chore/disable telemetry by default (#4427)
disable telemetry by default
2025-05-15 00:19:05 +08:00
Henry Heng 82d16458e4 Bugfix/Update file loader (#4420)
* update file loader

* delete temp for o1

* fix tavily
2025-05-14 10:30:33 +08:00
nikitas-novatix eadf1b11b3 Fix: Add keep-alive options to Redis clients to prevent idle timeouts and socket closing. (#4377)
* redis keepalive mechanism for all redis

* removed offline queue commands

* Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable.

* update redis socket alive env variable

* lint fix

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-05-14 10:29:32 +08:00
Henry Heng 7924fbce0d Feature/agentflow v2 (#4298)
* agent flow v2

* chat message background

* conditon agent flow

* add sticky note

* update human input dynamic prompt

* add HTTP node

* add default tool icon

* fix export duplicate agentflow v2

* add agentflow v2 marketplaces

* refractor memoization, add iteration nodes

* add agentflow v2 templates

* add agentflow generator

* add migration scripts for mysql, mariadb, posrgres and fix date filters for executions

* update agentflow chat history config

* fix get all flows error after deletion and rename

* add previous nodes from parent node

* update generator prompt

* update run time state when using iteration nodes

* prevent looping connection, prevent duplication of start node, add executeflow node, add nodes agentflow, chat history variable

* update embed

* convert form input to string

* bump openai version

* add react rewards

* add prompt generator to prediction queue

* add array schema to overrideconfig

* UI touchup

* update embedded chat version

* fix node info dialog

* update start node and loop default iteration

* update UI fixes for agentflow v2

* fix async drop down

* add export import to agentflowsv2, executions, fix UI bugs

* add default empty object to flowlisttable

* add ability to share trace link publicly, allow MCP tool use for Agent and Assistant

* add runtime message length to variable, display conditions on UI

* fix array validation

* add ability to add knowledge from vector store and embeddings for agent

* add agent tool require human input

* add ephemeral memory to start node

* update agent flow node to show vs and embeddings icons

* feat: add import chat data functionality for AgentFlowV2

* feat: set chatMessage.executionId to null if not found in import JSON file or database

* fix: MariaDB execution migration script to utf8mb4_unicode_520_ci

---------

Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
Co-authored-by: chungyau97 <chungyau97@gmail.com>
2025-05-10 10:21:26 +08:00
Vinod Kiran 68d3c83980 changes & fixes for various issues in chatflow config (#4314)
* Chatflow config - rate limit and override config were overwriting changes.

* prevent post processing JS function from escaping as JSON...

* non-streaming follow up prompts need to be escaped twice

* prevent post processing JS function from escaping as JSON...

* Adding file mimetypes for full file upload...

* lint..

* fixing the issue with storing only filtered nodes..

* return doc store processing response without await when queue mode and request is from UI

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-04-23 22:58:37 +08:00
allen c318fc57e9 Feat: Support Google Cloud Storage (#4061)
* support google cloud storage

* update example and docs for supporting google cloud storage

* recover the indent of pnpm-lock-yaml

* populate the logs to google logging

* normalize gcs storage paths

---------

Co-authored-by: Ilango <rajagopalilango@gmail.com>
Co-authored-by: Henry <hzj94@hotmail.com>
2025-04-14 22:52:54 +08:00
Henry Heng d53b1b657f Bugfix/Prevent empty user message when using STT (#4280)
prevent empty user message when using STT
2025-04-11 13:15:17 +08:00
Ilango 36870e94d4 Update how credential data is saved in db when using aws secrets manager (#4271)
* Update how credential data is saved in db when using aws secrets manager

* Run lint-fix and update env example
2025-04-09 14:07:18 +05:30
Ilango 4fa2672c9d NVIDIA NIM fixes (#4215)
* fix: udpate label to "NVIDIA NIM API Key"

* test: update tag from ":latest" to ":1.8.0-rtx"

* test: add image URL path "nvcr.io/nim/"

* fix/nvidia-nim-2 (#4208)

* fix: update nim-container-manager

* feat: add "DeepSeek R1 Distill Llama 8B"

* fix/nidia-nim-3 (#4209)

* chore: add error message NVIDIA NIM is not installed.

* chore: standardize NVIDIA NGC API Key

* chore: capitalize Nvidia to NVIDIA

* chore: generalize error message for chat models

* fix/nvidia-nim-4-yau (#4212)

* test: nimRelaxMemConstraints and hostPort

* test: add logger for hostPort and nimRelaxMemConstraints

* test: nim-container-manager version 1.0.9

* test: parseInt nimRelaxMemConstraints

* test: update nim-container-manager version to 1.0.10

* chore: update nim-container-manager version to 1.0.11

* Update start container behaviour - show existing containers and give users the choice

* Go back to previous step when clicking start new so user can change port number

* Update condition for showing existing container dialog

* Fix start new in different port not working

* Update get container controller

* Update again

* fix: generalize error message for chat models

* Update getContainer controller

* Fix incorrect image check in getContainer controller

* Update existing container dialog text

* Fix styles in container exists dialog for nvidia nim

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
2025-03-24 15:20:09 +05:30
Saqib Ahmed 7867489727 Add curl in docker image for native healthchecks (#4170)
* Add curl in docker image for native healthchecks

Fixes this issue: https://github.com/FlowiseAI/Flowise/issues/4126

* fix: add container-native healthcheck

- Added curl utility in dockerfile
- Added healthcheck configuration in docker compose

* fix: exclude ping endpoint from logging
2025-03-14 15:24:17 +00:00
Henry Heng c2b830f279 Bugfix/arbitrary create attachemnt file upload (#4171)
fix arbitrary create attachemnt file upload
2025-03-13 19:46:27 +00:00
Egor Kopylov c6968ff385 Fix Agent Chat History Retrieval (#4163)
fixed agents history from api
2025-03-13 13:39:37 +00:00
Henry Heng 9d9aaaa886 Bugfix/S3 Credentials (#4166)
only set s3 credentials when access key and secret key exist
2025-03-12 22:21:05 +00:00
Daniel D'Abate 641df313d4 [Fix] Change S3 logger to accept more authorization methods for AWS (#4114)
* Change S3 logger to accept more authorization methods for AWS

* Lint fix
2025-03-11 17:29:34 +00:00
Henry Heng 9c22bee991 Feature/Add multi select option to composio (#4122)
* add multi select option to composio

* Update pnpm-lock.yaml
2025-03-06 09:59:33 +00:00
Rafael Reis fc9740af16 Fix for node-crashing "undefined (reading 'streaming')" error (#4104)
* check for undefined variables in buildChatflow to avoid node crashing exceptions

* Add null check on error Middleware as well
2025-02-28 22:20:48 +00:00
Henry Heng 1678815540 Feature/nim container (#3966)
* add nim container setup

* check if image or container exist before pulling

* update NIM dialog

* update chat nvidia api key

* update nim container version

* update nim container version
2025-02-27 09:14:01 +00:00
Vinod Kiran 9a92aa12f9 New Feature: Add post postprocessing of response from LLM using custom JS Function (#4079)
* New Feature: Add post postprocessing of response from LLM using custom Javascript functions

* Disable Save when there is no content

* add post processing ui changes, disable streaming

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-02-26 17:40:03 +00:00
Henry Heng 54cdf00e7e Feat/stream flow variables (#4022)
stream flow variables
2025-02-12 10:40:46 +00:00
Henry Heng 6e95989647 Bugfix/Overrideconfig for form data body (#3932)
fix overrideconfig for form data body
2025-01-27 11:19:26 +00:00
Henry Heng a2a475ba7a Feature/Add bullmq redis for message queue processing (#3568)
* add bullmq redis for message queue processing

* Update pnpm-lock.yaml

* update queue manager

* remove singleton patterns, add redis to cache pool

* add bull board ui

* update rate limit handler

* update redis configuration

* Merge add rate limit redis prefix

* update rate limit queue events

* update preview loader to queue

* refractor namings to constants

* update env variable for queue

* update worker shutdown gracefully
2025-01-23 14:08:02 +00:00
Henry Heng e26fc63be0 Feature/Custom Function to Seq Agent (#3612)
* add custom function to seq agent

* add seqExecuteFlow node
2025-01-23 13:04:40 +00:00
Henry Heng 1baa4f8e4f Bugfix/Allow files uploads without enabling overrideconfig (#3915)
allow files uploads without enabling overrideconfig
2025-01-22 18:20:57 +00:00
Osema Touati 4c9d46d7e5 fix: Fixing logger for custom S3 stream (#3900)
* fix: Fixing logger for custom S3 stream

* fix: adjusting s3 stream folder

* fix: fixing forcedPathStyle variable name.

* Update logger.ts

* add S3ClientConfig types

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2025-01-20 19:15:31 +00:00
supraface 5c9f17814b Bugfix/Handling empty strings when resolving variables (#3864)
Bugfix for how to handle empty strings when resolving variables
2025-01-16 15:14:06 +00:00
Henry Heng c89be26024 Bugfix/update get chat messages chattype (#3881)
update get chat messages chattype
2025-01-16 14:53:36 +00:00
Henry Heng 62d5d1e8ef Bugfix/add hidden properties to custom tool (#3875)
add hidden properties to custom tool
2025-01-15 13:43:58 +00:00
Ryan Halliday 16aa3a0d29 Get/Delete ChatMessage based on startDateTime / endDateTime (#3867)
* Get ChatMessage based on startDateTime / endDateTime - supplements existing startDate / endDate fields

* Proper query handling for between case

* Return 0 result rather than error

* lint fix

* update start date and end date query

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-01-14 14:06:42 +00:00
Henry Heng d60242c224 Feat/add multer s3 (#3854)
* add multer s3

* add types multer s3

* update multer s3 implementation

* Revert "update multer s3 implementation"

This reverts commit 9a25bf57a93f77074bdb084921f0591dbe0b44e1.

* update storage utils

* update multer storage type on routes

* revert getMulterStorage

* revert getMulterStorage

* update getmulterstorage

* update getmulterstorage

* update getmulterstorage
2025-01-12 23:00:34 +00:00
Henry Heng 15d06ec4b3 Feature/Allow winston to stream to s3 (#3848)
allow winston to stream to s3
2025-01-11 17:01:10 +00:00
Henry Heng 8d266052ae Feature/update upsert API (#3836)
* update upsert API

* add fix for override files in upsert vector
2025-01-09 13:22:35 +00:00
Lucas Mohallem Ferraz 1ae78c2739 [Feat] Allow AWS SECRETS MANAGER instead of storing AES Encrypted in db (#3616)
* AWS Secrets

* AWS Secrets support

* add examples

* remove test compose

* fix lint

* update aws secret manager implementation

* update secret manager client

* update comments

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2025-01-08 20:24:57 +00:00
Karlo Benčić e8a33e4d4d fix: Error Cannot read properties of undefined (reading 'sendTelemetry') (#3734)
fix Error: Cannot read properties of undefined (reading 'sendTelemetry')
2024-12-21 01:09:45 +00:00
Henry Heng 5c5416240b Chore/remove app server functions from utils file (#3671)
* remove app server functions from utils file

* hide override config variables if its empty
2024-12-10 14:11:29 +00:00
Henry Heng cadc3b8fb3 Feature/Add dedicated agent memory nodes (#3649)
add dedicated agent memory nodes
2024-12-06 22:16:01 +00:00
Henry Heng fe2ed26999 Feature/Custom Assistant Builder (#3631)
* add custom assistant builder

* add tools to custom assistant

* add save assistant button
2024-12-06 22:11:17 +00:00
Henry Heng 7482e7fff6 Chore/Update multer path if blob storage path is set (#3609)
update multer path if blob storage path is set
2024-12-03 23:34:27 +00:00
Ong Chung Yau 56c00ebf38 fix/unable-to-upload-documents (#3606)
fix: unable to upload documents
2024-11-29 13:07:22 +00:00
Henry Heng 940c8fd3b0 Chore/LC v0.3 (#3517)
* bump langchain version to 0.3, upgrades on all chat models

* update all docs loader to have documents and text output options

* fix pnpm lock file
2024-11-28 11:06:12 +00:00
Aaron McIntyre 126808b62a Fix 'label' undefined errors for sequential agents (#3585)
Fix 'label' undefined errors

Commit adds some optional chaining around 2 reads of 'label'
property.
2024-11-27 23:27:49 +00:00
Henry Heng 76ae921240 Feature/add ability to show variable output (#3580)
add ability to show variable output
2024-11-26 21:06:03 +00:00
Henry Heng 7d9e1514b1 Bugfix/Upsert files override (#3569)
add fix for upsert files
2024-11-25 17:26:32 +00:00
Henry Heng a2c36b4447 Feature/Add new doc store upsert and refresh API (#3556)
add new doc store upsert and refresh API
2024-11-25 15:47:13 +00:00
Henry Heng bc77e400ed Bugfix/OverrideConfig for Upsert Vector (#3527)
* update bugfix for override config vars

* add overrideConfig to upsert vector
2024-11-16 18:11:30 +00:00
Henry Heng 1ccd97685c Bugfix/Override config vars (#3524)
update bugfix for override config vars
2024-11-16 14:03:29 +00:00
Henry Heng eaec34f0bc Bugfix/Allow analytics override config (#3520)
allow analytics override config
2024-11-15 16:05:57 +00:00
Ilango 537aa51ef8 Enable/disable variables in override configuration (#3467)
* Add ability to enable/disable which variables can be overriden during external predictions

* Remove duplicated code

* Remove rate limit and allowed domains tab from chatflow configuration

* Show tooltip in api code dialog for override config properties

* Fix server crash when override config is not available

* update UI for chatflow config security, file upload

* Fix UI issues in security tab of chatflow configuration dialog

* Fix override config options not updating when nodes change

* Fix crash in api code dialog when overrideConfig is not available for a chatflow/agentflow. Also fix input config in api code dialog not updating when nodes change.

* Refactor override config and add override config for variables

* Update api code dialog - update how override config is read and show variable overrides

* Update how node and variable overrides are read and resolved

* Prevent api code dialog mounting on page load and only mount when api code dialog button is clicked. this should fix loading incorrect data.

* Fix variables list not showing when overrideConfig is not available

* add overrideconfig to agentflow and upsert vector

* temporarily removed enable overrideconfig on upsert, fix linting issues

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-11-13 18:21:59 +00:00
Henry Heng 51e5591bbb Feature/Add multi modal to chat ollama (#3499)
* add multi modal to chat ollama

* update JSON mode description
2024-11-10 20:45:46 +00:00