Prerequisite/Recommended prerequisite for participation in the module

Content, progress and pedagogy of the module

The course will enable the student to understand the principles of multi modal user interaction, including speech based interaction and computer vision, and to extend the methods for HCI GUI design to analyze, design and synthesize multi modal user interaction

Learning objectives

Knowledge

• Must have knowledge about integration of sensory information from non-standard signal sources.
• Must have knowledge about methods and architectures for fusion of multi modal information from e.g. speech, gaze, sound and gesture modalities.
• Must have knowledge about context-aware multimodal interaction.

Skills

• Must be able to apply the taught platforms and methods to analyze and design multi modal user interfaces.
• Must be able to evaluate and compare interaction modalities relevant to a specific application.

Competences

• Must have competencies in analyzing a given problem and identifying appropriate modalities and their fusion to the problem.
• Must have competencies in understanding the pros and cons of the modalities of relevance

Type of instruction

As described in the introduction to Chapter 3.

Exam

Exams