Design and Analysis of Experiments

2018/2019

Prerequisite/Recommended prerequisite for participation in the module

Interaction Design, Mathematics for Multimedia Applications, Human Senses and Perception

Content, progress and pedagogy of the module

Objectives:

A crucial aspect of designing medialogy systems, tools or applications is the need to evaluate the work experimentally. The knowledge of how to properly design experiments to collect and evaluate data is essential to answer many of the problems within medialogy. Examples are testing which of two tracking algorithms is the most efficient; how users perform with different kinds of feedback; possible relationship between age and performance, etc.

Learning objectives

Knowledge

Students who complete the module will obtain the following qualifications:

  • Must be able to understand the basic concepts of probability: sample space of all possible events; combinatorics; independent events; conditional probability; Bayes’ formula; binomial distribution, etc.
  • Must display knowledge about basic statistic terminology and treatment of data: distributions (probability density function, cumulative distribution function, quantile function); measures of central tendency and variability; histogram; central limit theorem, significance, power, type I and II errors, etc.
  • Must be able to understand advantages and disadvantages with different types of designs and studies (between-group and within-group designs; correlational studies; blind/double blind, complete/incomplete and balanced/unbalanced designs)
  • Must be able to understand the difference between common experimental designs, e.g., single sample experiments, two sample experiments, and factorial/multifactorial experiments
  • Must understand the basic experimental design principles of independence, randomization, replication, and blocking and how these can be applied in experiments.
  • Must be able to relate frequency distributions to the concept of hypothesis testing (understanding)
  • Must be able to understand possible ethical concerns for a study

Skills

Students who complete the module will obtain the following qualifications:

  • Must be able to design an experiment to measure changes in a dependent variable, identifying and efficiently controlling relevant independent variables (application)
  • Must be able to properly inform and instruct persons participating in a study (application)
  • Must be able to understand and select among the most common methods for statistical analysis and assessment of experimental data (e.g., t-test, analysis of variance, chi-square tests, binomial test, correlation, and simple linear and logistic regression)
  • Must be able to understand the difference between parametric and non-parametric analysis methods
  • Must be able to understand different measurement scales and discuss experiments in terms of reliability, bias and sensitivity
  • Must be able to discuss own data in terms of assumptions for statistical testing (application)
  • Must be able to use an existing statistical package to analyse and present experimental results
  • Must be able to discuss and represent empirical data in different ways (describing text, numbers, formulas, graphs and figures) and shift between these according to the needs of the situation and context (application)
  • Must be able to read, understand and implement experimental and empirical work as described in relevant literature (application)

Competences

Students who complete the module will obtain the following qualifications:

  • Students who complete this module will be able to systematically design quantitative, scientific experiments, taking into account relevant factors (application)
  • Students who complete this module will be able to use a statistical software package to analyse experimental data (application)
  • Students who complete this module will be able to document their experimental results, and to understand experimental results presented by others (application)

Type of instruction

Refer to the overview of instruction types listed in the start of chapter 3. The types of instruction for this course are decided in accordance with the current Framework Provisions and directions are decided and given by the Study Board for Media Technology.

Exam

Exams

Name of examDesign and Analysis of Experiments
Type of exam
Written or oral exam
In accordance with the current Framework Provisions and directions on examination from the
Study Board for Media Technology:

To be eligible to take the exam the student must have fulfilled:
• handing in of written assignments or the like
• completion of certain – or all – study activities

Note that if admittance to the exam or parts of the assessment is to be based on written work or exercises, a deadline is stipulated for when the work must be handed in..
The exam format is individual assessment based on a written or oral exam with an internal censor. The assessment is performed with the 7-step grading scale.
ECTS5
Permitted aids
With certain aids:
See semester description
Assessment7-point grading scale
Type of gradingInternal examination
Criteria of assessmentThe criteria for the evaluation are specified in the Framework Provisions.

Facts about the module

Danish titleDesign og analyse af eksperimenter
Module codeMSNMEDB4143
Module typeCourse
Duration1 semester
SemesterSpring
ECTS5
Language of instructionEnglish
Location of the lectureCampus Aalborg, Campus Copenhagen
Responsible for the module

Organisation

Study BoardStudy Board of Media Technology
DepartmentDepartment of Architecture, Design and Media Technology
FacultyTechnical Faculty of IT and Design