糖心Vlog

Campuses warn against metrics-only knowledge exchange framework

Universities say they must be able to supplement metrics with contextual or narrative information

Published on
November 19, 2018
Last updated
November 19, 2018
Old numbers
Source: iStock

English universities have said that they must be given the chance to supplement metrics used in the forthcoming knowledge exchange framework with contextual information.

The results of a call for evidence on the KEF, published by Research England on 19 November, report 鈥渁lmost universal鈥 support for the use of narrative information in the assessment of universities鈥 performance in areas such as commercialisation, collaborative research and consulting to be compared on a like-for-like basis.

The KEF has been expected to be largely based on metrics, but the approach advocated by universities draws on the methodology of the research excellence framework, in which peer review judgements about quality are sometimes supplemented by citation data.

Scores allocated in KEF are expected to be used to inform the allocation of sources of support such as the 糖心Vlog Innovation Fund. The first exercise is expected to be conducted in the 2019-20 academic year.

糖心Vlog

ADVERTISEMENT

The call for evidence, which attracted 106 responses, found support for the use of narrative information ranging from peer-reviewed narrative statements or case studies, or contextual information such as that found in institutional knowledge exchange strategies.

Respondents also suggested datasets听that could be drawn on for metrics, such as the 糖心Vlog Business & Community Interaction survey, patent citations, and statistics on industry co-authorship and student activities such as placements.

糖心Vlog

ADVERTISEMENT

Many respondents suggested that the adoption of a 鈥済old鈥, 鈥渟ilver鈥 and 鈥渂ronze鈥 rating system, as employed in the teaching excellence framework, would 鈥渙versimplify what is a complex area鈥.

A consultation on how the KEF will work in practice will be opened towards the end of 2018 and close in early 2019.

Alongside the call for evidence, Research England also published a cluster analysis听that gives universities the first indication of which institutions their performance will be compared against.

The UK government has previously indicated that universities should be banded by type in the forthcoming assessment, allowing their strength to be compared on a like-for-like basis.

The analysis by Tomas Coates Ulrichsen, a research associate at the Centre for Science, Technology and Innovation Policy at the University of Cambridge, explains that the banding is a reflection of 鈥渟ystematic differences in the structural characteristics鈥 of universities, on the understanding that their individual potential for knowledge exchange will vary.

鈥淭he process does not seek to make any value judgement on whether one cluster is in some way better or more valuable than another; only that they are structurally different,鈥 the report concludes.

糖心Vlog

ADVERTISEMENT

There are five separate clusters of teaching and research universities, and separate clusters for specialist institutions.

However, Research England said that it would 鈥渇urther develop this analysis, including manually assigning some universities to different clusters鈥 ahead of the consultation.

糖心Vlog

ADVERTISEMENT

Alice Frost, Research England鈥檚 director of knowledge exchange, said there was a 鈥済reat deal of work going on behind the scenes鈥 to support the development of the KEF.

鈥淚t鈥檚 essential we get a broad range of views to ensure the KEF is a useful tool for universities and users. We hope this information will give an indication of the direction of travel and help HEIs prepare for the consultation,鈥 she said.

rachael.pells@timeshighereducation.com

Proposed knowledge exchange framework clusters

Cluster 鈥楨鈥:听Anglia Ruskin University; Aston University; University of Bedfordshire; Bournemouth University; University of Bradford; University of Brighton; University of Central Lancashire; City, University of London; Coventry University; De Montfort University; Goldsmiths, University of London; University of Greenwich; University of Hertfordshire; University of Huddersfield; Kingston University; University of Lincoln; Liverpool John Moores University; Manchester Metropolitan University; Middlesex University; Northumbria University; Nottingham Trent University; The Open University; Oxford Brookes University; University of Plymouth; University of Portsmouth; University of Salford; Sheffield Hallam University; University of the West of England; University of Westminster.

Cluster 鈥楯鈥:Birmingham City University; University of Bolton; Canterbury Christ Church University; University of Chester; University of Derby; University of East London; University of Gloucestershire; Leeds Beckett University; London Metropolitan University; London South Bank University; University of Northampton; University of Roehampton; Staffordshire University; University of Sunderland; Teesside University;听University of Wolverhampton; University of Worcester.

Cluster 鈥楳鈥:Bath Spa University; Bucks New University;听University of Chichester; University of Cumbria; Edge Hill University; Falmouth University; Leeds Trinity University; Liverpool Hope University; Newman University; St Mary鈥檚 University, Twickenham; Solent University; Plymouth Marjon University; University of Suffolk; University of West London; University of Winchester; York St John University.

Cluster 鈥榁鈥:University of Birmingham; University of Bristol; University of Cambridge; Imperial College London; King鈥檚 College London; University of Leeds; University of Liverpool; University of Manchester; Newcastle University;听University of Nottingham; University of Oxford; Queen Mary University of London;听University of Sheffield; University of Southampton; UCL; University of Warwick.

糖心Vlog

ADVERTISEMENT

Cluster 鈥榅鈥:University of Bath; Birkbeck, University of London; Brunel University London; Durham University;听University of East Anglia; University of Essex; University of Exeter; University of Hull; Keele University; University of Kent; Lancaster University; University of Leicester; London School of Economics and Political Science; Loughborough University; University of Reading; Royal Holloway, University of London; Soas, University of London; University of Surrey; University of Sussex; University of York.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Introduced to help boost technology transfer amid renewed political focus on 鈥榠ndustrial strategy鈥, the KEF aims to complement the REF and TEF. But how will it work? Is it even necessary? And is the UK really underperforming at commercialising its research? Rachael Pells reports

25 January

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT