Multimodal User Interfaces

Multimodal interfaces (MMIs) coordinate natural input modalities (such as voice, gesture, facial expressions etc.) with multimedia output modalities (such as video, audio, information visualizations, 3D graphics etc.). This course is oriented towards Master students who want to gain a deeper understanding of the domain and will give them the basic techniques for designing, implementing and evaluating multimodal interfaces, as well as theoretical knowledge on multimodality, representation, visualisation of information and cognitive ergonomics.
 

Learning Outcomes: 

During the practical exercises, students will have the opportunity to create their own multimodal interfaces. By the end of the course, a student should:

  • Be able to design, program and evaluate a multimodal interface, thanks to the hands-on practice throughout the course.
  • Know the properties of multimodal interfaces.
  • Master the different levels of multimodal fusion.
  • Be familiar with the architectures of software adapted to multimodal interfaces and be able to understand synchronicity problems.
  • Have theoretical and practical knowledge of: gesture recognition, speech recognition, information visualisation and tangible interfaces.
  • Understand and know how to apply the various methods to evaluate multimodal interfaces.
     
Type: 
Course
Semester: 
S2019
ECTS: 
5
Lecturer: 
Site: 
F
Code: 
03035
33035
Language: 
english
Period: 
weekly
Schedule: 
Tuesday: 10:15 - 13:00
Location: 
UniFR, PER21
Room: 
E140
Evaluation type: 
written exam
Comment: 

First Lecture
The first lecture will take place on Tuesday, 19.02.2019 at 10:15 in UniFR, PER21, room E140.

ILIAS
The course page in ILIAS can be found at https://ilias.unibe.ch/goto_ilias3_unibe_crs_1340286.html.