Platforms and Methods for Multi Modal Systems

2018/2019

Prerequisite/Recommended prerequisite for participation in the module

The module builds upon basic knowledge of human-computer interaction and software design

Content, progress and pedagogy of the module

The course will enable the student to understand the principles of multi modal user interaction, including speech based interaction and computer vision, and to extend the methods for HCI GUI design to analyze, design and synthesize multi modal user interaction

Learning objectives

Knowledge

  • Must have knowledge about integration of sensory information from non-standard signal sources.
  • Must have knowledge about methods and architectures for fusion of multi modal information from e.g. speech, gaze, sound and gesture modalities.
  • Must have knowledge about context-aware multimodal interaction.

Skills

  • Must be able to apply the taught platforms and methods to analyze and design multi modal user interfaces.
  • Must be able to evaluate and compare interaction modalities relevant to a specific application.

Competences

  • Must have competencies in analyzing a given problem and identifying appropriate modalities and their fusion to the problem.
  • Must have competencies in understanding the pros and cons of the modalities of relevance

Type of instruction

As described in the introduction to Chapter 3.

Exam

Exams

Name of examPlatforms and Methods for Multi Modal Systems
Type of exam
Written or oral exam
ECTS5
AssessmentPassed/Not Passed
Type of gradingInternal examination
Criteria of assessmentAs stated in the Joint Programme Regulations
http:/​/​www.en.tech.aau.dk/​education-programmes/​Education+and+Programmes/​

Facts about the module

Danish titlePlatforme og metoder til multi modale systemer
Module codeESNVGISK3K1
Module typeCourse
Duration1 semester
SemesterAutumn
ECTS5
Empty-place SchemeYes
Location of the lectureCampus Aalborg
Responsible for the module

Organisation

Study BoardStudy Board of Electronics and IT
FacultyTechnical Faculty of IT and Design