What is a modality in AI? Give three examples of different modalities.
Modalities are types of data which a machine can learn from. Different modalities represent different ways of coding. Examples of these include text, images, audio, and more.
What is multimodal learning?
Multimodal learning is using multiple forms of data input to train an AI such that its outputs are more comprehensive.
Where is multimodal learning used? Can you find one real application and identify the types of information it combines?
Multimodal learning is used in healthcare, for instance, to analyze medical images. It is used when AI must be trained on several different data input types.
GPT-4o was the introduction of multimodal capabilities into ChatGPT.
What is embodied AI?
It is a branch of AI which refers to the integration of AI into the physical world, and physical systems, such as humanoid robots.
How are multimodal learning and embodied AI connected?
The multimodal learning, from the slight bit I understand of it, allows the AI to cognitively perceive the world around it and understand it, while the embodied AI allows the AI to actually ACT physically.