Platforms and Methods for Multi Modal Systems


Recommended prerequisite for participation in the module

The module builds upon knowledge obtained in the modules Human-computer interaction and Software design

Content, progress and pedagogy of the module

The course will enable the student to understand the principles of multi modal user interaction, including speech based interaction and computer vision, and to extend the methods for HCI GUI design to analyze, design and synthesize multi modal user interaction

Learning objectives


  • Must have knowledge about integration of sensory information from non-standard signal sources.
  • Must have knowledge about methods and architectures for fusion of multi modal information from e.g. speech, gaze, sound and gesture modalities.
  • Must have knowledge about context-aware multimodal interaction.


  • Must be able to apply the taught platforms and methods to analyze and design multi modal user interfaces.
  • Must be able to evaluate and compare interaction modalities relevant to a specific application.


  • Must have competencies in analyzing a given problem and identifying appropriate modalities and their fusion to the problem.
  • Must have competencies in understanding the pros and cons of the modalities of relevance

Type of instruction

As described in ยง 17.



Name of examPlatforms and Methods for Multi Modal Systems
Type of exam
Written or oral exam
AssessmentPassed/Not Passed
Type of gradingInternal examination
Criteria of assessmentThe criteria of assessment are stated in the Examination Policies and Procedures

Facts about the module

Danish titlePlatforme og metoder til multi modale systemer
Module codeESNVGISK3K1
Module typeCourse
Duration1 semester
Language of instructionEnglish
Empty-place SchemeYes
Location of the lectureCampus Aalborg
Responsible for the module


Education ownerMaster of Science (MSc) in Engineering (Vision, Graphics and Interactive Systems)
Study BoardStudy Board of Electronics and IT
DepartmentDepartment of Electronic Systems
FacultyThe Technical Faculty of IT and Design