Feature/agentflow v2 (#4298)

* agent flow v2

* chat message background

* conditon agent flow

* add sticky note

* update human input dynamic prompt

* add HTTP node

* add default tool icon

* fix export duplicate agentflow v2

* add agentflow v2 marketplaces

* refractor memoization, add iteration nodes

* add agentflow v2 templates

* add agentflow generator

* add migration scripts for mysql, mariadb, posrgres and fix date filters for executions

* update agentflow chat history config

* fix get all flows error after deletion and rename

* add previous nodes from parent node

* update generator prompt

* update run time state when using iteration nodes

* prevent looping connection, prevent duplication of start node, add executeflow node, add nodes agentflow, chat history variable

* update embed

* convert form input to string

* bump openai version

* add react rewards

* add prompt generator to prediction queue

* add array schema to overrideconfig

* UI touchup

* update embedded chat version

* fix node info dialog

* update start node and loop default iteration

* update UI fixes for agentflow v2

* fix async drop down

* add export import to agentflowsv2, executions, fix UI bugs

* add default empty object to flowlisttable

* add ability to share trace link publicly, allow MCP tool use for Agent and Assistant

* add runtime message length to variable, display conditions on UI

* fix array validation

* add ability to add knowledge from vector store and embeddings for agent

* add agent tool require human input

* add ephemeral memory to start node

* update agent flow node to show vs and embeddings icons

* feat: add import chat data functionality for AgentFlowV2

* feat: set chatMessage.executionId to null if not found in import JSON file or database

* fix: MariaDB execution migration script to utf8mb4_unicode_520_ci

---------

Co-authored-by: Ong Chung Yau <33013947+chungyau97@users.noreply.github.com>
Co-authored-by: chungyau97 <chungyau97@gmail.com>

packages/server/package.json

@@ -100,7 +100,7 @@
         "multer-s3": "^3.0.1",
         "mysql2": "^3.11.3",
         "flowise-nim-container-manager": "^1.0.11",
-        "openai": "^4.82.0",
+        "openai": "^4.96.0",
         "pg": "^8.11.1",
         "posthog-node": "^3.5.0",
         "prom-client": "^15.1.3",
@@ -109,6 +109,7 @@
         "s3-streamlogger": "^1.11.0",
         "sanitize-html": "^2.11.0",
         "sqlite3": "^5.1.6",
+        "turndown": "^7.2.0",
         "typeorm": "^0.3.6",
         "uuid": "^9.0.1",
         "winston": "^3.9.0"
@@ -120,6 +121,7 @@
         "@types/multer": "^1.4.7",
         "@types/multer-s3": "^3.0.3",
         "@types/sanitize-html": "^2.9.5",
+        "@types/turndown": "^5.0.5",
         "concurrently": "^7.1.0",
         "cypress": "^13.13.0",
         "nodemon": "^2.0.22",