Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Add Multi Modal Capabilities #94

Merged
merged 22 commits into from
Feb 27, 2024
Merged

Feature: Add Multi Modal Capabilities #94

merged 22 commits into from
Feb 27, 2024

Conversation

0xi4o
Copy link
Contributor

@0xi4o 0xi4o commented Feb 13, 2024 •
edited
Loading

  • Adds image upload option to chat. OpenAI Vision can then answer questions about the image(s).
  • Adds audio uploads/recording to chat. OpenAI Whisper or Assembly AI can then answer questions to audio inputs.

Related: FlowiseAI/Flowise#1419

Demo

flowise-multimodal-embed-test.mp4

@0xi4o 0xi4o added the enhancement New feature or request label Feb 13, 2024
@0xi4o 0xi4o self-assigned this Feb 13, 2024
@0xi4o 0xi4o marked this pull request as draft February 13, 2024 04:54
@0xi4o 0xi4o marked this pull request as ready for review February 13, 2024 08:15
@HenryHengZJ HenryHengZJ mentioned this pull request Feb 21, 2024
Merged
@0xi4o
Copy link
Contributor Author

0xi4o commented Feb 22, 2024

@HenryHengZJ @vinodkiran @chungyau97 The issues have all been fixed. We can review and merge this now.

HenryHengZJ
HenryHengZJ approved these changes Feb 26, 2024
View reviewed changes
Copy link
Contributor

@HenryHengZJ HenryHengZJ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@0xi4o this is all good, if you can resolve the conflict

@HenryHengZJ
Merge branch 'main' into feature/multimodal
bbbc344 
# Conflicts:
#	dist/components/bubbles/BotBubble.d.ts.map
#	dist/web.js
@HenryHengZJ HenryHengZJ merged commit fe9eba5 into FlowiseAI:main Feb 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HenryHengZJ HenryHengZJ HenryHengZJ approved these changes

@vinodkiran vinodkiran Awaiting requested review from vinodkiran

@chungyau97 chungyau97 Awaiting requested review from chungyau97

Assignees

@0xi4o 0xi4o

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@0xi4o @HenryHengZJ