production

The system will be offline between 13:00 and 14:00 17 October 2024 for scheduled maintenance.

Skip to Content

CS5063: EVALUATION OF AI SYSTEMS (2023-2024)

Last modified: 23 Jul 2024 10:43


Course Overview

One of the biggest challenges in Artificial Intelligence is evaluating how well AI systems work.   This course will provide students of our MSc in AI with knowledge of core evaluation concepts, approaches, tools, techniques and technologies; we will also look at software testing of AI systems.

Course Details

Study Type Postgraduate Level 5
Term First Term Credit Points 15 credits (7.5 ECTS credits)
Campus Aberdeen Sustained Study No
Co-ordinators
  • Professor Ehud B. Reiter
  • Dr Arabella Sinclair

What courses & programmes must have been taken before this course?

  • Either Any Postgraduate Programme or Master of Engineering in Computing Science
  • Either Any Postgraduate Programme or Programme Level 5

What other courses must be taken with this course?

None.

What courses cannot be taken with this course?

None.

Are there a limited number of places available?

No

Course Description

The course will cover concepts, methods, techniques and tools/technologies for evaluating and testing AI systems. Students will be equipped with knowledge on statistical analysis and hypothesis testing (e.g., t-test, chi-square, correlations and regression) and learn to use software/tools for statistical analysis. The course will cover the design and execution of human evaluations of AI systems, including research ethics when working with human subjects.  It will also examine the use of automated metrics to evaluate AI systems, including best practice, common pitfalls, and avoiding bias; and methodologies for rigorous software testing of AI systems.


Contact Teaching Time

Information on contact teaching time is available from the course guide.

Teaching Breakdown

More Information about Week Numbers


Details, including assessments, may be subject to change until 30 August 2024 for 1st term courses and 20 December 2024 for 2nd term courses.

Summative Assessments

Report: Group

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Report: Individual

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Formative Assessment

There are no assessments for this course.

Resit Assessments

Report: Individual

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Report: Group

Assessment Type Summative Weighting 50
Assessment Weeks Feedback Weeks

Look up Week Numbers

Feedback
Learning Outcomes
Knowledge LevelThinking SkillOutcome
Sorry, we don't have this information available just now. Please check the course guide on MyAberdeen or with the Course Coordinator

Course Learning Outcomes

Knowledge LevelThinking SkillOutcome
FactualRememberILO’s for this course are available in the course guide.

Compatibility Mode

We have detected that you are have compatibility mode enabled or are using an old version of Internet Explorer. You either need to switch off compatibility mode for this site or upgrade your browser.