• knowledge of information theoretical concepts such as entropy,
mutual information, divergence, the chain rule for entropy,
empirical entropy
• knowledge of lossless data compression, entropy coding, lossy
data compression (rate distortion theory)
• knowledge of channel capacity and error-correcting codes
• knowledge of joint source-channel coding and the separation
principle
• are able to give a theoretical description of the entropy of a
signal and in practice estimate the entropy of simple signals
• are able to design efficient entropy codes for simple signals
• are able to use information inequalities to provide bounds on
optimal performance of simple systems
• arte able to construct error-correcting codes with good
properties and parameters
• are able to decode error-correcting codes efficiently (e.g.
Reed-Solomon codes)
• understand the interaction between bitrate and distortion
(reconstruction error) in connection with source coding
• understand the interaction between bitrate and error probability
in connection with channel coding
• are able to perform calculations in finite fields
• have a good intuition and understanding of the concept of
entropy and its significance regarding the information within a
signal
• be able to use mathematical tools to discover and investigate the
fundamental mathematical tools that describes data transmission,
data reduction and data storage
Lectures with exercises.
This is a 5 ECTS course module and the work load is
expected to be 150 hours for the student.
Name of exam | Information and Coding Theory |
Type of exam | Written or oral exam |
ECTS | 5 |
Assessment | 7-point grading scale |
Type of grading | Internal examination |
Criteria of assessment | The criteria of assessment are stated in the Examination Policies and Procedures |
Danish title | Information og kodningsteori |
Module code | F-MTK-K1-2 |
Module type | Course |
Duration | 1 semester |
Semester | Autumn
|
ECTS | 5 |
Language of instruction | Danish and English |
Empty-place Scheme | Yes |
Location of the lecture | Campus Aalborg |
Responsible for the module |
Study Board | Study Board of Mathematics, Physics and Nanotechnology |
Department | Department of Mathematical Sciences |
Faculty | Faculty of Engineering and Science |