# multimodal interaction

> form of human-machine interaction using multiple modes of input/output

**Wikidata**: [Q738567](https://www.wikidata.org/wiki/Q738567)  
**Wikipedia**: [English](https://en.wikipedia.org/wiki/Multimodal_interaction)  
**Source**: https://4ort.xyz/entity/multimodal-interaction

## Summary
Multimodal interaction is a form of human-machine interaction that uses multiple modes, or channels, for input and output. As a sub-discipline of human-computer interaction, it focuses on creating systems that can process and combine information from various sources, such as speech, gestures, or touch, to communicate more naturally and effectively with users.

## Key Facts
- **Classification:** It is a subclass of the academic discipline of human-computer interaction.
- **Core Concept:** It is defined by the use of multiple modes for both input and output between a human and a machine.
- **Aliases:** The term is also known as "multimodal interface" and "Comunicacion multimodal".
- **Distinction:** The concept is formally considered different from the general computing term "mode".
- **Associated Expert:** German computer scientist Elisabeth André is a notable person associated with the field.
- **Formal Recognition:** The topic is recognized by the Library of Congress with the authority ID `sh2009000017`.
- **Global Reach:** The subject has dedicated Wikipedia articles in at least 10 languages, including English, German, French, and Japanese.

## FAQs
### Q: What is the difference between multimodal interaction and human-computer interaction?
A: Multimodal interaction is a specific field within the broader academic discipline of human-computer interaction (HCI). While HCI covers all aspects of the design and use of computer technology, multimodal interaction focuses specifically on systems that use multiple channels for input and output.

### Q: Is a "multimodal interface" the same as "multimodal interaction"?
A: Yes, "multimodal interface" is a recognized alias for multimodal interaction. The Spanish term "Comunicacion multimodal" is also used as an alternative name for the concept.

### Q: Who is a notable researcher in multimodal interaction?
A: Elisabeth André, a German computer scientist and professor born in 1961, is a key person associated with the field of multimodal interaction.

## Why It Matters
Multimodal interaction is significant because it represents a fundamental shift in how humans communicate with machines, moving beyond single-channel interfaces like the keyboard and mouse. By allowing users to interact through multiple modes simultaneously—much like how humans communicate with each other—it aims to make technology more intuitive, flexible, and accessible. This approach solves the limitations of single-mode interaction, where the user is constrained to one specific type of input. As a key sub-discipline of human-computer interaction, its principles are crucial for developing advanced systems in areas like virtual reality, intelligent assistants, and robotics, ultimately making technology more powerful and seamlessly integrated into human activities.

## Notable For
- **Use of Multiple Channels:** Its defining characteristic is the use of more than one mode of input or output within a single human-machine system.
- **Academic Sub-discipline:** It is formally classified as a distinct subclass within the broader academic field of human-computer interaction.
- **Conceptual Distinction:** The field is specifically differentiated from the more general computing concept of a "mode," which typically refers to a distinct state of operation.
- **International Recognition:** The topic is established enough to have a dedicated Wikimedia Commons category and Wikipedia articles in over 10 languages, indicating broad academic and public interest.

## Body
### Definition and Classification
Multimodal interaction is a form of human-machine interaction that utilizes multiple modes for input and output. It is formally categorized as a subclass of the academic discipline of human–computer interaction (HCI). The concept has several aliases, including "multimodal interface" and the Spanish term "Comunicacion multimodal". It is explicitly defined as being different from the general concept of a "mode".

### Academic and Institutional Recognition
The field of multimodal interaction is formally recognized across various knowledge bases and academic systems.
- **Library of Congress:** It holds the authority ID `sh2009000017`.
- **National Library of Israel:** Its J9U ID is `987007547418605171`.
- **Encyclopedia of China:** The concept is assigned the ID `187356` in the third edition.
- **Other Identifiers:** It has been assigned identifiers in multiple databases, including Freebase (`/m/06kw76`), Yale University's LUX (`concept/69bdae1e-b702-47fd-9a59-4e5d40dd9a0c`), and the discontinued Microsoft Academic ID (`135641252`).

### Associated Figures
Elisabeth André, a German computer scientist and professor from Saarlouis, is a notable person associated with the field of multimodal interaction. Her work contributes to the academic understanding and development of the discipline.

## References

1. [Source](https://github.com/JohnMarkOckerbloom/ftl/blob/master/data/wikimap)
2. Freebase Data Dumps. 2013
3. National Library of Israel Names and Subjects Authority File
4. [OpenAlex](https://docs.openalex.org/download-snapshot/snapshot-data-format)