Commit Graph

55 Commits

Author SHA1 Message Date
Vinod Kiran c0bae635b0 Document Store - Phase 2 (#2912)
* Document Store - Phase 2

* Adding additional columns for vector store config, document store phase 2

* Adding additional columns for vector store config, document store phase 2

* Document Store - Phase 2 - Upsert and Query

* ux cleanup

* retrieval settings and more ux changes

* adding MMR params to execution

* Making the upsert process async.

* add upsert history changes

* making the searchParams dynamic

* removing unnecessary params

* add ability to delete data from vector store

* update margin for vector store query

* adding option to save config in the retrieval playground

* adding chunk number for query return chunks

* Adding a Document Store node in the VectorStore category

* update doc store status, ui touchup

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-08-07 18:59:52 +01:00
Henry Heng 70d7420d02 Feature/Seq Agent Nodes Update (#2942)
update all seg agent nodes to 2.0 for UI UX improvements
2024-08-06 11:30:08 +01:00
Henry Heng 27cb143fef Feature/Community Node (#2902)
add feature to enable community node
2024-07-29 16:52:47 +01:00
Henry Heng b5d969b2bb Feature/prepend messages to agent graph (#2897)
prepend messages to agent graph
2024-07-29 11:09:38 +01:00
Henry Heng 368c69cbc5 Bugfix/Move summarization as optional for multi agents (#2858)
add summarization as optional for multi agents
2024-07-23 15:15:41 +01:00
Henry Heng bca4de0c63 Feature/seq agents (#2798)
* update build functions

* sequential agents

* update langchain to 0.2, added sequential agent nodes

* add marketplace templates

* update howto wordings

* Merge branch 'main' into feature/Seq-Agents

# Conflicts:
#	pnpm-lock.yaml

* update deprecated functions and add new sequential nodes

* add marketplace templates

* update marketplace templates, add structured output to llm node

* add multi agents template

* update llm node with bindmodels

* update cypress version

* update templates sticky note wordings

* update tool node to include human in loop action

* update structured outputs error from models

* update cohere package to resolve google genai pipeThrough bug

* update mistral package version, added message reconstruction before invoke seq agent

* add HITL to agent

* update state messages restructuring

* update load and split methods for s3 directory
2024-07-22 17:46:14 +01:00
Henry Heng 8ebc4dcfd5 Feature/lang graph (#2319)
* add langgraph

* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

* update tabler icons react

* cleanup agents

* add pysandbox tool

* add abort functionality, loading next agent

* add empty view svg

* update chatflow tool with chatId

* rename to agentflows

* update worker for prompt input values

* update dashboard to agentflows, agentcanvas

* fix marketplace use template

* add agentflow templates

* resolve merge conflict

* update baseURL

---------

Co-authored-by: vinodkiran <vinodkiran@usa.net>
Co-authored-by: Vinod Paidimarry <vinodkiran@outlook.in>
2024-05-21 16:36:42 +01:00
Henry Heng 8caca472ba Feature/Add prepend messages to memory (#2410)
add prepend messages to memory
2024-05-20 17:08:34 +01:00
Vinod Kiran 40e36d1b39 Feature/DocumentStore (#2106)
* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-06 15:23:27 +01:00
Vinod Kiran d5a97060e2 FEATURE: Adding File Upload to Unstructured Loader (#2304)
* initial commit

* updates to loader to support file upload

* updates to loader to support file upload

* update unstructured file

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-05-02 18:34:32 +01:00
Henry Heng c33642cdf9 Feature/Buffer Memory SessionId (#2111)
* add sessionId to buffer memory, add conversation summary buffer memory

* add fix for conv retrieval qa chain
2024-04-11 11:18:39 +01:00
Henry Heng e422ce287b Feature/Indexing (#1802)
* indexing

* fix for multiple files upsert

* fix default Postgres port

* fix SQLite node description

* add MySQLRecordManager node

* fix MySQL unique index

* add upsert history

* update jsx ui

* lint-fix

* update dialog details

* update llamaindex pinecone

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2024-04-02 23:47:19 +01:00
Henry Heng 414b9f125c Bugfix/Avoid hardcoded max tokens (#2003)
remove hard-coded max tokens
2024-03-25 12:10:31 +08:00
vinodkiran bce7ff9ada refactoring of interface into the common interface.ts file and misc changes 2024-03-08 17:59:54 +05:30
Henry 46c47017bd Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/LLMChain/LLMChain.ts
#	packages/components/nodes/chatmodels/ChatOpenAI/ChatOpenAI.ts
2024-02-19 20:38:34 +08:00
Henry 85809a9ecc fix for concurrency 2024-02-15 04:03:10 +08:00
Henry Heng dcb1ad15e7 Merge branch 'main' into FEATURE/Vision 2024-02-14 18:06:33 +08:00
Henry 73112ad122 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/package.json
2024-02-07 02:01:32 +08:00
Henry 9cd0362f24 Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-02-02 02:54:06 +00:00
Henry 0606d2c6dd upgrade langchain version 0.1.0 2024-01-26 23:41:55 +00:00
Henry 8189f945cc Merge branch 'main' into feature/LlamaIndex
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/ConversationalRetrievalAgent/ConversationalRetrievalAgent.ts
#	packages/components/nodes/agents/OpenAIAssistant/OpenAIAssistant.ts
#	packages/components/nodes/agents/OpenAIFunctionAgent/OpenAIFunctionAgent.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/ConversationalRetrievalQAChain/ConversationalRetrievalQAChain.ts
#	packages/components/nodes/memory/BufferMemory/BufferMemory.ts
#	packages/components/nodes/memory/BufferWindowMemory/BufferWindowMemory.ts
#	packages/components/nodes/memory/ConversationSummaryMemory/ConversationSummaryMemory.ts
#	packages/components/nodes/memory/DynamoDb/DynamoDb.ts
#	packages/components/nodes/memory/MongoDBMemory/MongoDBMemory.ts
#	packages/components/nodes/memory/MotorheadMemory/MotorheadMemory.ts
#	packages/components/nodes/memory/RedisBackedChatMemory/RedisBackedChatMemory.ts
#	packages/components/nodes/memory/UpstashRedisBackedChatMemory/UpstashRedisBackedChatMemory.ts
#	packages/components/nodes/memory/ZepMemory/ZepMemory.ts
#	packages/components/src/utils.ts
#	packages/server/marketplaces/chatflows/Long Term Memory.json
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-01-24 03:00:31 +00:00
vinodkiran f87d84997c GPT Vision: lint fixes 2024-01-18 17:11:43 +05:30
vinodkiran 8a14a52d90 GPT Vision: Renaming to OpenAIMultiModalChain and merging the functionality of Wisper. 2024-01-18 13:03:27 +05:30
Henry 4256655c7b add $vars and $flow to custom function 2024-01-17 23:47:11 +00:00
Henry f66c03ab0a change agent/chain with memory to use runnable 2024-01-16 11:12:17 +05:30
Ilango 6462ba0fae Add todo for category type in INode 2024-01-11 21:20:47 +05:30
Henry 02482f1b38 change agent/chain with memory to use runnable 2024-01-08 13:02:56 +00:00
Henry 6306904cfc add missing methods, abstract classes 2023-12-26 15:54:50 +00:00
Henry aac0546a7f update all memory nodes 2023-12-21 00:50:24 +00:00
vinodkiran bfa870e56b Environment Variables: injection of variables ($env) into the custom tool and addition of ($flow) object 2023-12-12 12:19:35 +05:30
Henry 40f8371de9 add llamaindex 2023-12-04 20:04:09 +00:00
Henry 4b5f7028e3 fix chat history 2023-11-30 16:01:16 +00:00
Henry 3638485d1b Merge branch 'main' into feature/VectorStoreRevamp 2023-11-22 19:49:55 +00:00
Henry 44cadc1cc3 add vector upsert ability 2023-11-16 18:34:17 +00:00
automaton82 1f0cc60fcc Adding ability to hide node param from UI 2023-11-10 15:34:38 -05:00
Henry b607c1228f add upload files and tool features 2023-11-09 11:55:30 +00:00
Henry 82074ee7a1 add datagrid field type 2023-10-31 22:12:09 +00:00
Henry db06f85c2a add multi options 2023-10-13 01:28:48 +01:00
Henry 05dd23b01d - update marketplaces
- add version to nodes and credentials
- hover over node actions
2023-07-28 15:56:40 +01:00
Henry 61dabbb7da Merge branch 'main' into feature/Credential
# Conflicts:
#	README.md
#	docker/.env.example
#	packages/components/nodes/documentloaders/Notion/NotionDB.ts
#	packages/components/nodes/memory/DynamoDb/DynamoDb.ts
#	packages/components/nodes/memory/MotorheadMemory/MotorheadMemory.ts
#	packages/components/nodes/memory/ZepMemory/ZepMemory.ts
#	packages/components/package.json
#	packages/components/src/utils.ts
#	packages/server/.env.example
#	packages/server/README.md
#	packages/server/marketplaces/chatflows/Conversational Retrieval QA Chain.json
#	packages/server/src/ChildProcess.ts
#	packages/server/src/DataSource.ts
#	packages/server/src/commands/start.ts
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
#	packages/server/src/utils/logger.ts
2023-07-27 11:26:34 +01:00
Henry 1da012305a add airtable loader 2023-07-21 11:48:21 +01:00
Henry 413d654493 add credentials 2023-07-15 14:25:52 +01:00
Henry 6827a13e37 clear session memory 2023-07-11 16:29:30 +01:00
Henry 7e076028df add warning description 2023-07-08 01:55:44 +01:00
Henry 70da39629c add custom tool 2023-06-21 18:31:53 +01:00
Henry b071790a5a add return source documents functioanality 2023-06-08 23:51:34 +01:00
Henry 769b4ea567 add multi retrieval qa chain 2023-05-25 13:50:11 +01:00
Henry 1d42456ba1 add multi prompt chain 2023-05-25 00:36:09 +01:00
Henry e53651a415 add additional params 2023-04-27 23:14:42 +01:00
Henry 27e026d943 add baseClasses for outputs 2023-04-20 00:46:33 +01:00