Guidance

In January 2019 the REF team published the final guidance for REF 2021

A list of 'Frequently Asked Questions' has also been published, grouped by category.  This will be added to as necessary.

In August 2018, the University organised information sessions for staff which summarised the main points arising from the initial guidance and provided an opportunity for staff to discuss any queries and raise any issues that may help to inform our institutional response to the consultation.  Staff were also informed of the next steps in our institutional preparations for REF 2021.

Please click here to access a copy of the powerpoint slides used in the information sessions.  Please click here to access a Panopto recording of the 30 August session.

Previously issued guidance and documentation for REF 2021 is available at https://www.ref.ac.uk/publications/

Please do not hesitate to contact Marlis Barraclough, Senior Policy Adviser (m.barraclough@abdn.ac.uk) if you have any queries regarding REF 2021.

REF 2021

REF 2021

What is the REF?

The REF is a sector wide assessment exercise of publicly funded research in the UK. It was last held in 2014, when UK institutions were invited to submit outputs, impact case studies and evidence about the quality of their research environment for assessment. Panels of peer reviewers assessed the institutional submissions in research areas, or units of assessment. The outcome was a quality profile for each unit of assessment which rated the quality of outputs, impacts and the research environment as world leading (4*), internationally excellent (3*), recognised internationally (2*) or recognised nationally (1*). For the general institutional quality profile, the elements of assessment were weighted as follows: publications 65%, impact 20% and research environment 15%.

The REF is the latest iteration of research assessment exercises held by the UK government since the 1980s, each 6 years or so apart from the next. It has always been a selective exercise, in which institutions were invited to submit their best (not all) of their research. It is a measure of research quality as well as research intensity, with research intensive institutions submitting the majority of their eligible staff and others submitting smaller groups of researchers. In the 2014 exercise the largest submission came from University College London which submitted 2,565.6 FTE of their staff (more than 90%), and the smallest came from St Mary’s University College, a teacher training and liberal arts institution which submitted 3 FTE (around 6%). Our own submission rate in 2014 was just over 71%; we submitted 597.2 FTE.

Why does the REF matter?

The REF outcome has become an internationally recognised standard of research quality for UK institutions, and feeds into many institutional ranking and benchmarking exercises. It therefore has great reputational value to UK institutions.

The REF results also feed into the formula used by the funding councils to calculate the annual  research block grant or Research Excellence Grant (REG). 

About two thirds of the REG is calculated through a formula which multiplies the weighted percentage of 4* research and the percentage of 3* research achieved in the REF by each unit of assessment with the number of staff submitted to work out our institutional share of the resource the Scottish Funding Council identifies for distribution each year. The remaining third of the REG calculated on the basis of our share of the sectoral total research income in Scotland over the last three years.

Our REG is currently around £20m a year and is distributed through the school budgets in accordance with numbers of staff submitted and REF quality profiles achieved. 

What do we know about REF 2021

For the next REF, which is likely to take place in 2020 or 2021, the funding councils have not yet announced any detailed guidance. In December 2015, the Government set up a review of the Research Excellence Framework, chaired by Lord Nicholas Stern.  The aim of the review is to ensure that future research funding is allocated more efficiently, offers greater rewards for excellent research and reduces the administrative burden on institutions. The review will draw on views articulated by stakeholders while responding to the recent Green Paper on Higher Education but also sought comments on specific questions posed by the Review Steering Group. The sole Scottish member of the Review Steering Group is Professor Anton Muscatelli, Vice-Chancellor of the University of Glasgow.  It will report in summer 2016.

More information on the Stern Review is available at https://www.gov.uk/government/consultations/research-excellence-framework-review-call-for-evidence

However, the funding councils have indicated that the open access requirements for outputs are likely to remain in place.  Impact will remain an element of assessment, the weighting of which in the overall quality profile may well increase. We may be asked to submit more impact case studies than in 2014, and some of the rules around underpinning research and evidence may change. Some other rules, including those on eligibility and portability of outputs, may change. Citations may play a more prominent part in the assessment of research outputs, at least for some panels. Compliance with voluntary instruments is likely to be an important indicator of the quality of the research environment, including Athena Swan compliance, compliance with the UK Research Integrity Office Code of Practice for Research, RCUK Concordat to Support the Career Development of Researchers, RCUK Concordat for Engaging the Public with Research and the RCUK Concordat on Open Research Data.

Whatever the changes that will be introduced we will need to be able to submit high quality outputs and high quality impact case studies, so the focus of activity within schools and units of assessment is on high quality and impactful research.

What are the REF open access requirements and how do I comply?

The REF open access policy requires that, in order to be eligible for submission in the next REF, all journal articles and conference proceedings with an ISSN number that have been accepted for publication on or after 1 April 2016 must be publicly accessible through an institutional repository within 3 months of acceptance for publication. Where publishers do not allow open access through a repository within the REF acceptable timelines, the output still needs to be discoverable and a valid reason for closed deposit will need to be recorded.

We are therefore asking that researchers should check the REF compliance of the journals to which they are planning to submit an article for publication – this can be done at  https://ref.sherpa.ac.uk/. Where possible, compliant journals should be chosen.  

On acceptance, or as soon as possible, please send your acceptance e-mail and final accepted manuscript to paperaccepted@abdn.ac.uk or upload both documents into Pure along with the bibliographic data available at that point. 

This applies to all articles, regardless of whether they can be enabled for open access or not.  Colleagues in the library will check the data, enable open access, set embargoes or record an exception and will make sure that the item is discoverable and accessible in accordance with the REF rules.

Find out more about the policy, how to comply and acceptable exception on /staffnet/research/impact-ref-and-open-access.php 

How will the University put together the REF 2021 submission?

The Vice Principal for Research, Professor Marion Campbell, is responsible for the institutional REF submission. She works with a small team within Research & Innovation who keep up to date on policy developments and support the systems that record and manage the data required for the submission. She is supported by the three Directors of Research who oversee the preparations for submissions to the main panels relevant to their own research areas: Professor Gary Macfarlane for Main Panel A (Life Sciences and Medicine), Professor Richard Neilson for Main Panel B (Physical Sciences and Engineering) and Professor Michael Brown for Main Panels C and D (Social Sciences , Arts and Humanities). 

Heads of School and School Directors of Research have identified a lead researcher for each unit of assessment, and a researcher responsible for co-ordinating the impact element of the submission. Some larger units of assessment have a small team of researchers working together on REF preparations. If you want to know who the relevant leads of your unit of assessment are, please contact either your School Director of Research or m.barraclough@abdn.ac.uk

What do I have to do

We are asking all REF eligible researchers (under the 2014 rules until the 2021 guidance has been published) to propose outputs for submission in Pure.  A short guide on how to do this is available here.

If your research has had, or has the potential to have, impact beyond academia, please discuss with your unit of assessment lead or impact lead in the first instance. The University supports the creation of impact of various kinds through

  • Research & Innovation – commercialisation, licensing, patenting , enterprise, knowledge exchange, contact Dr Ann Lewendon (a.lewendon@abdn.ac.uk; ext. 2477);
  • Public Engagement with Research Unit, (peru@abdn.ac.uk; ext. 3739); or
  • Public Affairs Team - engagement with policy makers/influence on public policy contact Sue Bird (sue.bird@abdn.ac.uk, ext. 2088) or Godfrey Brown (a.g.brown@abdn.ac.uk, ext. 3231)

Any further questions

Please contact Marlis Barraclough, Senior Policy Advisor 

Contacts

Marlis Barraclough 
Senior Policy Advisor for Research 
Tel: +44(0)1224 272038 
Email: m.barraclough@abdn.ac.uk

 

 

REF 2014

The page contains key information relating to the REF2014.

REF2014
  • The UK REF2014 was the largest assessment of University research in the world.
  • 76% of the University's research has been rated 'world leading' or 'internationally excellent' in the Research Excellence Framework (REF2014)

For additional information on the REF2014, please visit the HEFCE REF2014 website.

REF 2014 Results

Table of Results

The full results for the University's submissions are listed below.*

Arts and Social Sciences

Unit of Assessment

FTE Category A staff

4*

3*

2*

1*

U

16

Architecture, Built Environment and Planning

10.4

39

47

12

2

0

18

Economics and Econometrics

19.25

3

51

37

9

0

19

Business and Management Studies

13.3

31

42

25

2

0

20

Law

23.4

15

49

33

3

0

21

Politics and International Studies

11.2

7

43

37

13

0

23

Sociology

13

14

58

28

0

0

24

Anthropology and Development Studies

11

23

35

37

5

0

25

Education

9.6

8

59

29

4

0

28

Modern Languages and Linguistics

22

21

41

26

12

0

29

English Language and Literature

21.5

31

62

7

0

0

30

History

24

26

44

29

1

0

32

Philosophy

13.25

31

31

20

18

0

33

Theology and Religious Studies

19

29

39

24

7

1

35

Music, Drama, Dance and Performing Arts

11.36

15

51

23

8

3

Life Sciences and Medicine

Unit of Assessment

FTE Category A staff

4*

3*

2*

1*

U

01

Clinical Medicine

54.3

25

42

31

1

1

02

Public Health, Health Services and Primary Care

47.5

34

47

19

0

0

04

Psychology, Psychiatry an Neuroscience

20.6

29

65

6

0

0

05

Biological Sciences

89.42

30

53

16

0

1

06

Agriculture, Veterinary and Food Science

20.4

56

36

8

0

0

Physical Sciences

Unit of Assessment

FTE Category A staff

4*

3*

2*

1*

U

07

Earth Systems and Environmental Sciences

28.4

18

71

10

1

0

08

Chemistry

20.2

14

66

20

0

0

10

Mathematical Sciences

23.1

14

62

24

0

0

11

Computer Science and Informatics

19

22

52

26

0

0

15

General Engineering

38.6

12

70

18

0

0

16

Architecture, Built Environment and Planning

10.4

39

47

12

2

0

17

Geography, Environmental Studies and Archaeology

13.4

13

53

32

2

0

*Results downloaded from http://ref2014tool.analytics.elsevier.com/overall/internal_results
REF 2014 Results Analysis Tool is developed by Elsevier Analytical Services, part of Elsevier Research Intelligence Copyright © 2014 Elsevier B.V. All rights reserved

Excellence Performance

Scotland Excellence Performance

Top in Scotland for Performance

(4*+3* research ratings combined)

  • 1st in Public Health, Health Services and Primary Care
  • 1st in Earth Systems and Environmental Sciences (Geology and Geosciences)

Top in Scotland for Impact

  • 1st in Public Health, Health Services and Primary Care
  • 1st in Business and Management
  • 1st in Chemistry
  • 1st in Divinity
  • 1st in Geosciences
  • 1st in History

View examples of the University's impact

 

UK Excellence Performance

Top in the UK for Performance

  • 1st in Agriculture, Veterinary and Food Science (Soil and Environmental Science)

(4*+3* research ratings combined)

  • 2nd in the UK for English Language and Literature
  • 3rd in the UK for Psychology and Psychiatry
  • 5th in the UK for Architecture, Built Environment and Planning (Property and Transport)

UK Outstanding Impact

For the first time research was rated in terms of real world impact.

  • 85% of all submissions rated 'outstanding' or 'very considerable' for impact (4*+3*)
  • 1st (joint) in the UK for Agriculture, Veterinary and Food Science (Soil and Environmental Science)
  • 2nd in the UK for Business and Management Studies
  • 2nd in the UK for History

View examples of the University's impact

What was Assessed?

The REF2014 assed three key research areas, as follows:

  1. Research Outputs (65%)
  2. Research Impact (20%)
  3. Research Environment (15%)

The most important of these wss the assessment of research outputs. Each academic member of staff who is selected for submission will normally have to provide four research outputs for inclusion. These were assessed by the sub-Panels. Approximately half of the sub-Panels (mainly in the STEM subjects) took into account the citation counts of the submitted research outputs to inform their decisions. Assessment of research outputs accounted for 65% of each submission’s overall quality rating. The citation counts wereprovided to the REF panels via Scopus, and refered to the research outputs submitted.

After the research output element of the assessment exercise, the non-academic impact of research is the next most significant area to be assessed. This was also assessed by Unit of Assessment, via submission of a pre-determined number of “impact case studies” (number of case studies varying dependant on FTE per Unit) and by assessing how the research environment and research strategy within each Unit supports and facilitates non-academic research impact. The assessment of research impact was new to the REF2014 and accounted for 20% of the overall quality profile within each Unit.

The research output and impact elements of each submission was accompanied by a narrative which described the research environment of each Unit of Assessment. The “research environment” element of the assessment accounted for 15% of each submission. The research environment element assesses research facilities, research strategy, research metrics, career development opportunities, with particular emphasis on early career researchers and postgraduate students, and on equality and diversity issues.

For further information on how submissions were assessed, please access;

Alternatively, these documents are available on the HEFCE website.

 

What do the Quality Ratings Mean?

For the overall quality profile for each Unit of Assessment the quality ratings are as follows:

 

Rating

Definition

4*

Quality that is world leading in terms of originality, significance and rigour

3*

Quality that is internationally excellent in terms of originality, significance and rigour but which falls short of the highest standards of excellence

2*

Quality that is recognised internationally in terms of originality, significance and rigour

1*

Quality that is recognised nationally in terms of originality, significance and rigour

Unclassified

Quality that falls below the standard of nationally recognised work. Or work which does not meet the published definition of research for the purposes of this assessment

For each of the three elements of the assessment – outputs, impact and environment – sub-panels will develop a sub-profile, showing the proportion of the submission that meets each of four starred quality levels. 

  • View the assessment criteria and the definitions of the starred levels for the sub-profiles
How did the University Select Staff for Submission?

Final decisions on the selection of staff for submission to the exercise were made by the institutional REF2014 Steering Group, in consultation with the Colleges. The REF2014 Steering Group has overarching responsibility for managing and coordinating the University’s submission to the REF2014. Decisions on inclusion for submission will be based entirely on research quality.

In making decisions on inclusion, the University, via the REF2014 Steering Group, adhered to its internal REF2014 Equality and Diversity Code of Practice, as required by the Funding Councils. The University's REF2014 Equality and Diversity Code of Practice was approved via the University Court at its meeting on 6 December 2011 and was submitted to the national REF2014 Team (HEFCE) for formal approval.

Key Documentation

Please find a number of documents key REF2014 below.

Impact Related Links:

In order to access the additional documentation on Impact listed below, as released by HEFCE following the Impact Pilot Exercise (2010);

  • HEFCE Impact Pilot Exercise Expert Panel Findings.
  • Feedback from the Higher Education Institutions Involved in the Pilot.
  • Examples of impact case studies best practice, as submitted to the pilot exercise

Please visit the following link: http://www.hefce.ac.uk/rsrch/REFimpact/

RAE 2008

The University's research excellence is reflected in the results of the Research Assessment Exercise (RAE) 2008.

World Leading

  • 89% of Aberdeen’s research activity is of international quality and 55% is world leading or internationally excellent. (4* and 3*)
  • All of our 33 submissions have activity rated as world leading or internationally excellent

1st in the UK

  • 1st for Theology, Divinity and Religious Studies
  • 1st equal for Health Services Research

Outstanding Performance

Almost three quarters of our staff were submitted to units where at least half of the research activity was rated as world leading or internationally excellent (70%+)

  • Computer Science and Informatics (70%)
  • Health Services Research (80%)
  • Other Hospital Based Clinical Subjects (75%)
  • Theology, Divinity and Religious Studies (80%)