production
Skip to Content

CS5063: EVALUATION OF AI SYSTEMS (2021-2022)

Last modified: 22 Oct 2021 15:50


Course Overview

Artificial intelligence has helped solve complex practical problems such as driving a car, translating text from/to different languages, understanding and answering questions, and playing games such as chess and Go. This course will provide students of our MSc in AI with knowledge of core evaluation concepts, approaches, tools, techniques and technologies.

Course Details

Study Type Postgraduate Level 5
Session First Sub Session Credit Points 15 credits (7.5 ECTS credits)
Campus Aberdeen Sustained Study No
Co-ordinators
  • Professor Ehud B. Reiter

What courses & programmes must have been taken before this course?

  • Either Any Postgraduate Programme or Programme Level 5
  • Either Any Postgraduate Programme or Master of Engineering in Computing Science

What other courses must be taken with this course?

None.

What courses cannot be taken with this course?

None.

Are there a limited number of places available?

No

Course Description

The course will cover concepts, methods, techniques and tools/technologies for evaluating AI systems. Students will be equipped with knowledge on statistical analysis (e.g., variance, correlations and regression) and learn to use software/tools for statistical analysis. The course will introduce criteria for the evaluation of AI systems (e.g., usability, accessibility and learnability), and the theoretical evaluation of AI systems (e.g., guarantees regarding correctness, completeness, complexity, admissibility of heuristics, and so on). The course will provide a comprehensive exposition to issues pertaining to the empirical evaluation of AI Systems, including the design of experiments (to address specific criteria/issues), human-driven experiments (including the design of forms and questionnaires, interviews, “talk-aloud” experiments, logging/filming, etc.), systems with optimal behaviours vs. (sub-optimal) human-like behaviour, crowd-sourcing of experiments (including Amazon’s “Mechanic Turk” and others), evaluation through gaming, and other related topics.


In light of Covid-19 this information is indicative and may be subject to change.

Contact Teaching Time

Information on contact teaching time is available from the course guide.

Teaching Breakdown

  • 4 Practicals during University weeks 15 - 17

More Information about Week Numbers


In light of Covid-19 and the move to blended learning delivery the assessment information advertised for second half-session courses may be subject to change. All updates for second-half session courses will be actioned in advance of the second half-session teaching starting. Please check back regularly for updates.

Summative Assessments

Report: Individual

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Report: Group

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Formative Assessment

There are no assessments for this course.

Resit Assessments

Report: Group

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Report: Individual

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Course Learning Outcomes

Knowledge LevelThinking SkillOutcome
FactualRememberILO’s for this course are available in the course guide.

Compatibility Mode

We have detected that you are have compatibility mode enabled or are using an old version of Internet Explorer. You either need to switch off compatibility mode for this site or upgrade your browser.