Information theory for cognitive sciences 2500-EN-COG-OB2Z-C-1
The course introduces the basic concepts and measures of information theory. It provides an overview of its practical applications within cognitive sciences and other related fields such as biology, linguistics and social sciences.
The first part of the class will be devoted to the most important concepts of the theory (entropy, information measures, coding and compression of information, complexity). Next we will present applications of the measures designed within the theory of information in physics, biology, neuropsychology, linguistics. Finally, the limitations of information theory as applied to cognitive sciences will also be addressed, basing on current discussions of the semantic or pragmatic aspects of information and the link between information-theoretical and thermodynamic entropy.
Type of course
Mode
Learning outcomes
Students after completing the course will be able to:
Describe the history of the notion of the quantity of information, efforts to formalize it in relation to research on and modeling of cognitive systems. (K_W01, K_W02)
Define the most important concepts of the theory (information quantity, entropy, mutual and joint information) and use mathematical formulas to compute them. (K_W01, K_W08)
Indicate the main areas of application for the measures of information within cognitive sciences and related disciplines. (K_W02, K_U01, K_U03, K_K02)
Use terminology pertaining to information theory and its application. (K_W08)
Discuss information-theoretic problems with specialists from other fields. (K_U07, K_K07)
Formulate questions within cognitive science, which can be answered using information-theoretic measures. (K_U02; K_K06)
Assessment criteria
40% Project and its presentation
30% Short paper presentation and guiding the discussion
20% Homework(s)
10% Class presence and active participation
Attendance to the seminar is obligatory, 2 unexcused absences are allowed.
Students must respect the principles of academic integrity. Cheating and plagiarism (including copying work from other students, internet or other sources) are serious violations that are punishable and instructors are required to report all cases to the administration.
CMP I, philosophy of mind course, basic skills in math, probability
Additional information
Additional information (registration calendar, class conductors, localization and schedules of classes), might be available in the USOSweb system: