Commit Graph

161 Commits

Author SHA1 Message Date
Rogério Chaves 0fc5e3d0c5 Add LangWatch integration (#2677)
Add langwatch integration
2024-06-21 16:26:55 +01:00
Henry Heng 842bfc66fe Feature/Add ability to upload image url when calling API (#2683)
add ability to upload image url when calling API
2024-06-19 23:26:56 +01:00
Rafael Reis eb738a1552 Fix for Whisper Error: 'File is not defined' when using Speech to Text (#2526)
* tested ok

* update localai stt file

* update toFile method for OpenAI Assistant uploads

---------

Co-authored-by: Henry Heng <henryheng@flowiseai.com>
Co-authored-by: Henry <hzj94@hotmail.com>
2024-05-30 12:54:55 +01:00
Henry Heng 059eae4268 Bugfix/model list unreachable (#2522)
* fallback to fetch local models json file

* enable user to specify local path to load models.json

* Update pnpm-lock.yaml
2024-05-30 11:59:19 +01:00
Daniel D'Abate 912c8f3d5b Feature: Support role-based authentication for AWS (#2470)
* Storage, DynamoDBChatMemory - Make AWS credentials optional to support role-based authentication

* Lint fix
2024-05-29 23:40:01 +01:00
patrickreinan 2878af69e4 Added LOG_JSON_SPACES to control json beautify (#2483)
* Added: environment var LOG_JSON_SPACES with default value 2. Used to no beautify JSON on handler.ts
Fix: logger.verbose was not working because default log level was info

* Update handler.ts

---------

Co-authored-by: patrick <patrick.alves@br.experian.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-29 18:25:32 +01:00
Vinod Kiran ff2381741e Chore/upgrade llamaindex version (#2440)
* updates to loader to support file upload

* adding a todo

* upgrade llamaindex

* update groq icon

* update azure models

* update llamaindex version

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-05-22 13:35:08 +01:00
Henry Heng 8ebc4dcfd5 Feature/lang graph (#2319)
* add langgraph

* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

* update tabler icons react

* cleanup agents

* add pysandbox tool

* add abort functionality, loading next agent

* add empty view svg

* update chatflow tool with chatId

* rename to agentflows

* update worker for prompt input values

* update dashboard to agentflows, agentcanvas

* fix marketplace use template

* add agentflow templates

* resolve merge conflict

* update baseURL

---------

Co-authored-by: vinodkiran <vinodkiran@usa.net>
Co-authored-by: Vinod Paidimarry <vinodkiran@outlook.in>
2024-05-21 16:36:42 +01:00
Henry Heng 8caca472ba Feature/Add prepend messages to memory (#2410)
add prepend messages to memory
2024-05-20 17:08:34 +01:00
Henry Heng b5e502f3b6 Feature/Multer to s3 (#2408)
* add ability to store files from multer to s3

* add check to bypass doc loader
2024-05-15 19:41:37 +01:00
Henry Heng c022972cf8 Bugfix/Local Models Json (#2416)
fallback to fetch local models json file
2024-05-15 19:39:05 +01:00
clates d3f03e380e [FEATURE] Added support for LocalAI Speech To Text configuration (#2376)
* Added support for LocalAI to the Speech To Text configuration. Added a few debug statements around speech to text conversion. Finally, refactored the speechToTextProviders a bit to try and remove some magic strings that have undocumented rules around naming.

* LocalAI STT - PR Feedback - Updated LocalAI Image, changed casing, and updated the default model to whisper-1.
2024-05-13 12:21:27 +01:00
Vinod Kiran 40e36d1b39 Feature/DocumentStore (#2106)
* datasource: initial commit

* datasource: datasource details and chunks

* datasource: Document Store Node

* more changes

* Document Store - Base functionality

* Document Store Loader Component

* Document Store Loader Component

* before merging the modularity PR

* after merging the modularity PR

* preview mode

* initial draft PR

* fixes

* minor updates and  fixes

* preview with loader and splitter

* preview with credential

* show stored chunks

* preview update...

* edit config

* save, preview and other changes

* save, preview and other changes

* save, process and other changes

* save, process and other changes

* alpha1 - for internal testing

* rerouting urls

* bug fix on new leader create

* pagination support for chunks

* delete document store

* Update pnpm-lock.yaml

* doc store card view

* Update store files to use updated storage functions, Document Store Table View and other changes

* ui changes

* add expanded chunk dialog, improve ui

* change throw Error to InternalError

* Bug Fixes and removal of subFolder, adding of view chunks for store

* lint fixes

* merge changes

* DocumentStoreStatus component

* ui changes for doc store

* add remove metadata key field, add custom document loader

* add chatflows used doc store chips

* add types/interfaces to DocumentStore Services

* document loader list dialog title bar color change

* update interfaces

* Whereused Chatflow Name and Added chunkNo to retain order of created chunks.

* use typeorm order chunkNo, ui changes

---------

Co-authored-by: Henry <hzj94@hotmail.com>
Co-authored-by: Henry Heng <henryheng@flowiseai.com>
2024-05-06 15:23:27 +01:00
Ahmed Osman 2254d16c3a FIX Web Crawler doesn't include search params in URLs (#2300) 2024-05-02 18:42:00 +01:00
Vinod Kiran d5a97060e2 FEATURE: Adding File Upload to Unstructured Loader (#2304)
* initial commit

* updates to loader to support file upload

* updates to loader to support file upload

* update unstructured file

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-05-02 18:34:32 +01:00
Henry Heng 7360d1d9a6 Feature/OpenAI Assistant V2 (#2258)
* add gpt4 turbo to assistant

* OpenAI Assistant V2

* update langfuse handler
2024-04-25 20:14:04 +01:00
Vinod Kiran 7006d64de0 Feature/s3 storage (#2226)
* centralizing file writing....

* allowing s3 as storage option

* allowing s3 as storage option

* update s3 storage

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-23 11:35:38 +01:00
Henry Heng 95beaba9d9 Chore/Update langchain version, openai, mistral, vertex, anthropic (#2180)
* update langchain version, openai, mistral, vertex, anthropic, introduced toolagent

* upgrade @google/generative-ai 0.7.0, replicate and faiss-node

* update cohere ver

* adding chatCohere to streaming

* update gemini to have image upload

* update google genai, remove aiplugin
2024-04-20 02:20:30 +01:00
Vinod Kiran 6bd8aaefc8 Bugfix/speech input on Safari/iOS (#1971)
* debug to identify

* Safari sends audio file as mp4 and nor webp

* Safari on iOS needs special handling

* lint fixes

* updated condition

* Remove unused import

---------

Co-authored-by: Ilango <rajagopalilango@gmail.com>
2024-04-19 01:28:09 +01:00
Vinod Kiran 788d40f26b Feature/externalize model list (#2113)
* fixes

* test json

* test json

* externalize model list

* externalize model list

* correcting awsChatBedRock Name

* lint fixes

* externalize models

* externalize chat models

* externalize chat models

* externalize llm models

* externalize llm models

* lint fixes

* addition of models for ChatMistral

* updating version numbers for all imapacted nodes.

* marketplace template updates

* update embeddings, marketplaces, add chatCohere

* config changes for new env variable

* removal of local models.json

* update models json file

---------

Co-authored-by: Henry <hzj94@hotmail.com>
2024-04-12 12:46:10 +01:00
Henry Heng c33642cdf9 Feature/Buffer Memory SessionId (#2111)
* add sessionId to buffer memory, add conversation summary buffer memory

* add fix for conv retrieval qa chain
2024-04-11 11:18:39 +01:00
Henry Heng e422ce287b Feature/Indexing (#1802)
* indexing

* fix for multiple files upsert

* fix default Postgres port

* fix SQLite node description

* add MySQLRecordManager node

* fix MySQL unique index

* add upsert history

* update jsx ui

* lint-fix

* update dialog details

* update llamaindex pinecone

---------

Co-authored-by: chungyau97 <chungyau97@gmail.com>
2024-04-02 23:47:19 +01:00
Henry Heng 414b9f125c Bugfix/Avoid hardcoded max tokens (#2003)
remove hard-coded max tokens
2024-03-25 12:10:31 +08:00
Henry Heng cd4c659009 Feature/Mistral FunctionAgent (#1912)
* add mistral ai agent, add used tools streaming

* fix AWS Bedrock imports

* update pnpm lock
2024-03-18 13:17:00 +08:00
Henry 5f69a0652e update xml output parser 2024-03-13 15:11:22 +08:00
vinodkiran 2d208e1f99 Merge branch 'main' into FEATURE/Claude_vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
2024-03-11 09:50:33 +05:30
vinodkiran bce7ff9ada refactoring of interface into the common interface.ts file and misc changes 2024-03-08 17:59:54 +05:30
vinodkiran a2caf3e265 Structural Changes to support expansion to other chat models. 2024-03-07 18:54:36 +05:30
Marc Klingen 214e7c8dc7 upgrade langfuse and add sdkIntegration tag 2024-03-07 02:25:30 +01:00
Henry 2df05b3252 add claude 3 and xml agent 2024-03-06 01:05:43 +08:00
Henry 02735a1f1e add image upload bugfix and import deps 2024-03-03 00:42:04 +08:00
Henry Heng a134ea85eb Merge pull request #1419 from vinodkiran/FEATURE/Vision
FEATURE: Add Multi Modal Capabilities to Flowise
2024-02-27 11:58:47 +08:00
chungyau97 92bdf1cc51 Merge branch 'main' into bugfix/webscrape-relative-links 2024-02-27 11:13:40 +08:00
vinodkiran 0bc85593d5 Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
2024-02-20 13:26:22 -08:00
Henry 15afb8a2dd update mrkl agents 2024-02-20 18:23:39 +08:00
vinodkiran b31e8715f4 reverting all image upload logic to individual chains/agents 2024-02-19 15:27:19 -08:00
Henry 46c47017bd Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/agents/ConversationalAgent/ConversationalAgent.ts
#	packages/components/nodes/agents/MRKLAgentChat/MRKLAgentChat.ts
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/components/nodes/chains/LLMChain/LLMChain.ts
#	packages/components/nodes/chatmodels/ChatOpenAI/ChatOpenAI.ts
2024-02-19 20:38:34 +08:00
vinodkiran 10fc1bf08d Multimodal Fixes for cyclic (circular) dependencies during langsmith analysis... 2024-02-16 08:18:58 -05:00
Andres Pegam d67c265c0a use URL constructor to handle all types of links
This should enable to handle all types of relative URLs defined in RFC: https://www.rfc-editor.org/rfc/rfc3986#section-5.4
2024-02-16 11:43:32 +01:00
vinodkiran 52ffa1772b Multimodal Fixes...removing all static methods/variables. 2024-02-15 18:18:36 -05:00
Henry 85809a9ecc fix for concurrency 2024-02-15 04:03:10 +08:00
vinodkiran a71c5a109d fix for concurrent requests for media handling 2024-02-14 13:16:51 -05:00
Henry Heng dcb1ad15e7 Merge branch 'main' into FEATURE/Vision 2024-02-14 18:06:33 +08:00
Henry 73112ad122 Merge branch 'main' into chore/Upgrade-LC-version
# Conflicts:
#	packages/components/package.json
2024-02-07 02:01:32 +08:00
Henry 041bfea940 add more params 2024-02-02 20:07:50 +00:00
Henry Heng 340e85da91 Merge pull request #1611 from FlowiseAI/feature/LlamaIndex
Feature/llama index
2024-02-02 20:00:21 +00:00
Henry Heng a219efc913 Rename MultiModalUtils.ts to multiModalUtils.ts 2024-02-02 13:37:33 +00:00
Henry 9cd0362f24 Merge branch 'main' into FEATURE/Vision
# Conflicts:
#	packages/components/nodes/chains/ConversationChain/ConversationChain.ts
#	packages/server/src/index.ts
#	packages/server/src/utils/index.ts
2024-02-02 02:54:06 +00:00
vinodkiran e81927ee13 SpeechToText: Adding SpeechToText at the Chatflow level. 2024-01-31 07:48:38 -05:00
vinodkiran 4604594c55 SpeechToText: Adding SpeechToText at the Chatflow level. 2024-01-30 21:48:08 -05:00