Recommended prerequisite for participation in the module

The module builds upon knowledge obtained in the modules Human-computer interaction and Software design

Content, progress and pedagogy of the module

The course will enable the student to understand the principles of multi modal user interaction, including speech based interaction and computer vision, and to extend the methods for HCI GUI design to analyze, design and synthesize multi modal user interaction

Learning objectives

Knowledge

• Must have knowledge about integration of sensory information from non-standard signal sources.
• Must have knowledge about methods and architectures for fusion of multi modal information from e.g. speech, gaze, sound and gesture modalities.
• Must have knowledge about context-aware multimodal interaction.

Skills

• Must be able to apply the taught platforms and methods to analyze and design multi modal user interfaces.
• Must be able to evaluate and compare interaction modalities relevant to a specific application.

Competences

• Must have competencies in analyzing a given problem and identifying appropriate modalities and their fusion to the problem.
• Must have competencies in understanding the pros and cons of the modalities of relevance

Type of instruction

As described in § 17.

Exam

Exams

Name of exam	Platforms and Methods for Multi Modal Systems
Type of exam	Written or oral exam
ECTS	5
Assessment	Passed/Not Passed
Type of grading	Internal examination
Criteria of assessment	The criteria of assessment are stated in the Examination Policies and Procedures