skip to content
Covid-19 virus
COVID-19 Resources

Reliable information about the coronavirus (COVID-19) is available from the World Health Organization (current situation, international travel). Numerous and frequently-updated resource results are available from this WorldCat.org search. OCLC’s WebJunction has pulled together information and resources to assist library staff as they consider how to handle coronavirus issues in their communities.

Image provided by: CDC/ Alissa Eckert, MS; Dan Higgins, MAM
The evaluators' eye : impact assessment and academic peer review Preview this item
ClosePreview this item
Checking...

The evaluators' eye : impact assessment and academic peer review

Author: Gemma Derrick
Publisher: Cham : Palgrave Macmillan, 2018.
Edition/Format:   eBook : Document : EnglishView all editions and formats
Summary:
This book offers an empirical analysis of how academic peer review panels mediate the traditionally non-academic criterion of societal impact. The UK's 2014 Research Excellence Framework (REF2014) for the first time included an "Impact" criterion that considered how research had influenced society, beyond academia. Using a series of interviews with REF2014 Main Panel A evaluators, the book explores how a dominant  Read more...
Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

Find a copy online

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Genre/Form: Electronic books
Additional Physical Format: Print version :
Material Type: Document, Internet resource
Document Type: Internet Resource, Computer File
All Authors / Contributors: Gemma Derrick
ISBN: 9783319636276 3319636278
OCLC Number: 1023424847
Description: 1 online resource
Contents: Intro; Preface; Acknowledgements; Contents; List of Figures; List of Tables; 1: Impact from the Evaluators Eye; Why Study Peer Review and Impact Together?; Peer Review Groups and Ambiguous Objects; Group Evaluation as an Object ; Tug-of-War; What Did You Find?; Is This Study Timely?; Outline of the Remainder of This Book; References; 2: Peer Review of Impact: Could It Work?; Methodological Considerations of Being Inside; Peer Review Laid Bare; Why Evaluate Impact?; What Is Impact in National Research Evaluation Policies? Purpose of Audit Frameworks as Research Governance ToolsThe UK;s Research Excellence Framework (REF2014) Critique; Evaluating Impact Models, Proxies and Assumptions; Group Processes in Peer Review Panels; Group Think and Impact Evaluation; The Emergent Dominant Definition of Impact; References; 3: Evaluation Mechanics; Facilitative and Infiltrative Mechanics; Typologies of Evaluation Mechanics; REF2014 Evaluation Mechanics; In-Group Structures and Star Ratings; The Impact Definition; The Impact Case Study and Template; Main Panels and Sub-panels; The Role of the Main Panel Significance and ReachCalibration Exercises; Evaluation Mechanics in Practice; Scoring Behaviour of Group Around Impact; Significance and Reach; Conclusion: What Have We Learnt About Evaluation Mechanics?; References; 4: Introducing Impact to the Evaluators; Previous Evaluator Experience of Assessing Impact; The Tick-Box Criteria; Outside Their Comfort Zone, but Working as a Group; Flagging the Concept of Impact Together; Judgements of Impact; Examples of Change Post-Evaluation; What We Are Learning About Peer Review of Societal Impact From the Group What Is/Was Impact? Public Engagement Impact, with a Little i; Finding that Linear Link; Developing the Centricity Strategy; Balancing Evidence, with Trust; Conclusion: Valuing Impact; References; 5: Peers, Experts and Impact; Why Are Panellists Chosen?; Balancing Representation with Expertise; Why Include Users?; The Political Value of User-Evaluators; Users Value to Impact Evaluation or Valuation?; The Challenge for Users; Cultural Differences; Evaluation Mechanics Working Against Users in Practice; Conclusion: How to Incorporate Outsiders; References 6: Risking Groupthink in Impact Assessment Group Behaviours Around Impact; Building a Consensus Around Impact; Strategic Voting to Combat Resistance; Forming a Common Identity; Conscious Consensus-Building Behaviour; Forming a Committee Culture Around Impact; The Influence of Power; The Risk of Groupthink; Social Loafing and Ambiguous Objects; Pragmatic Evaluation; Satisficing to Evaluation Mechanics; Shelving Evaluation Limitations; Conclusion: The Benefit of Groups Evaluating Impact; References; 7: Working Smarter with Multiple Impacts and One Eye
Responsibility: Gemma Derrick.

Abstract:

By exploring the legitimacy of peer review as a tool to assess the societal impact of research, Derrick states that the future for Impact evaluation is not to seek alternative tools where peer review  Read more...

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.
Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


\n\n

Primary Entity<\/h3>\n
<http:\/\/www.worldcat.org\/oclc\/1023424847<\/a>> # The evaluators\' eye : impact assessment and academic peer review<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Book<\/a>, schema:MediaObject<\/a>, schema:CreativeWork<\/a> ;\u00A0\u00A0\u00A0\nlibrary:oclcnum<\/a> \"1023424847<\/span>\" ;\u00A0\u00A0\u00A0\nlibrary:placeOfPublication<\/a> <http:\/\/id.loc.gov\/vocabulary\/countries\/sz<\/a>> ;\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/research_evaluation<\/a>> ; # Research--Evaluation<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/language_arts_&_disciplines_journalism<\/a>> ; # LANGUAGE ARTS & DISCIPLINES--Journalism<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Place\/great_britain<\/a>> ; # Great Britain.<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/dewey.info\/class\/070.5\/e23\/<\/a>> ;\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/peer_review<\/a>> ; # Peer review<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/id.loc.gov\/authorities\/classification\/Z286<\/a>> ;\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/educational_sociology<\/a>> ; # Educational sociology<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/scholarly_publishing<\/a>> ; # Scholarly publishing<\/span>\n\u00A0\u00A0\u00A0\nschema:about<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/research_great_britain_evaluation<\/a>> ; # Research--Great Britain--Evaluation<\/span>\n\u00A0\u00A0\u00A0\nschema:author<\/a> <http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Person\/derrick_gemma<\/a>> ; # Gemma Derrick<\/span>\n\u00A0\u00A0\u00A0\nschema:bookFormat<\/a> schema:EBook<\/a> ;\u00A0\u00A0\u00A0\nschema:datePublished<\/a> \"2018<\/span>\" ;\u00A0\u00A0\u00A0\nschema:description<\/a> \"This book offers an empirical analysis of how academic peer review panels mediate the traditionally non-academic criterion of societal impact. The UK\'s 2014 Research Excellence Framework (REF2014) for the first time included an \"Impact\" criterion that considered how research had influenced society, beyond academia. Using a series of interviews with REF2014 Main Panel A evaluators, the book explores how a dominant definition of Impact was constructed within panels and how this led to the development of strategies around valuing it as an ambiguous object. By doing so, Derrick brings a unique perspective to Impact that is currently overlooked in the dominant Impact evaluation discourse. Through examining the evaluation procedure as a dynamic process it is argued that the best models, strategies and insights for Impact evaluation are those constructed in practice, within peer review groups. By exploring the legitimacy of peer review as a tool to assess the societal impact of research, Derrick states that the future for Impact evaluation is not to seek alternative tools where peer review seemingly fails, but instead to highlight ways in which peer review panels can work smarter. The book will be essential reading for students, academics and policy-makers working in Education, as well as researchers interested in peer review processes and the research evaluation frameworks and audit exercises globally.<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\nschema:description<\/a> \"Intro; Preface; Acknowledgements; Contents; List of Figures; List of Tables; 1: Impact from the Evaluators Eye; Why Study Peer Review and Impact Together?; Peer Review Groups and Ambiguous Objects; Group Evaluation as an Object ; Tug-of-War; What Did You Find?; Is This Study Timely?; Outline of the Remainder of This Book; References; 2: Peer Review of Impact: Could It Work?; Methodological Considerations of Being Inside; Peer Review Laid Bare; Why Evaluate Impact?; What Is Impact in National Research Evaluation Policies?<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\nschema:exampleOfWork<\/a> <http:\/\/worldcat.org\/entity\/work\/id\/4396593563<\/a>> ;\u00A0\u00A0\u00A0\nschema:genre<\/a> \"Electronic books<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\nschema:inLanguage<\/a> \"en<\/span>\" ;\u00A0\u00A0\u00A0\nschema:isSimilarTo<\/a> <http:\/\/worldcat.org\/entity\/work\/data\/4396593563#CreativeWork\/<\/a>> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"The evaluators\' eye : impact assessment and academic peer review<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\nschema:productID<\/a> \"1023424847<\/span>\" ;\u00A0\u00A0\u00A0\nschema:url<\/a> <https:\/\/doi.org\/10.1007\/978-3-319-63627-6<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <http:\/\/www.vlebooks.com\/vleweb\/product\/openreader?id=none&isbn=9783319636276<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <https:\/\/public.ebookcentral.proquest.com\/choice\/publicfullrecord.aspx?p=5275417<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <https:\/\/search.ebscohost.com\/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=1709157<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <https:\/\/link.springer.com\/book\/10.1007\/978-3-319-63627-6<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <https:\/\/nls.ldls.org.uk\/welcome.html?ark:\/81055\/vdc_100065901431.0x000001<\/a>> ;\u00A0\u00A0\u00A0\nschema:url<\/a> <http:\/\/0-search.ebscohost.com.pugwash.lib.warwick.ac.uk\/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=1709157<\/a>> ;\u00A0\u00A0\u00A0\nschema:workExample<\/a> <http:\/\/worldcat.org\/isbn\/9783319636276<\/a>> ;\u00A0\u00A0\u00A0\numbel:isLike<\/a> <http:\/\/bnb.data.bl.uk\/id\/resource\/GBB838199<\/a>> ;\u00A0\u00A0\u00A0\nwdrs:describedby<\/a> <http:\/\/www.worldcat.org\/title\/-\/oclc\/1023424847<\/a>> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n\n

Related Entities<\/h3>\n
<http:\/\/dewey.info\/class\/070.5\/e23\/<\/a>>\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Person\/derrick_gemma<\/a>> # Gemma Derrick<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Person<\/a> ;\u00A0\u00A0\u00A0\nschema:familyName<\/a> \"Derrick<\/span>\" ;\u00A0\u00A0\u00A0\nschema:givenName<\/a> \"Gemma<\/span>\" ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Gemma Derrick<\/span>\" ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Place\/great_britain<\/a>> # Great Britain.<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Place<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Great Britain.<\/span>\" ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/educational_sociology<\/a>> # Educational sociology<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Educational sociology<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/language_arts_&_disciplines_journalism<\/a>> # LANGUAGE ARTS & DISCIPLINES--Journalism<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"LANGUAGE ARTS & DISCIPLINES--Journalism<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/peer_review<\/a>> # Peer review<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Peer review<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/research_evaluation<\/a>> # Research--Evaluation<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Research--Evaluation<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/research_great_britain_evaluation<\/a>> # Research--Great Britain--Evaluation<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Research--Great Britain--Evaluation<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/experiment.worldcat.org\/entity\/work\/data\/4396593563#Topic\/scholarly_publishing<\/a>> # Scholarly publishing<\/span>\n\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\nschema:name<\/a> \"Scholarly publishing<\/span>\"@en<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/id.loc.gov\/authorities\/classification\/Z286<\/a>>\u00A0\u00A0\u00A0\u00A0a \nschema:Intangible<\/a> ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/id.loc.gov\/vocabulary\/countries\/sz<\/a>>\u00A0\u00A0\u00A0\u00A0a \nschema:Place<\/a> ;\u00A0\u00A0\u00A0\ndcterms:identifier<\/a> \"sz<\/span>\" ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/worldcat.org\/entity\/work\/data\/4396593563#CreativeWork\/<\/a>>\u00A0\u00A0\u00A0\u00A0a \nschema:CreativeWork<\/a> ;\u00A0\u00A0\u00A0\nschema:description<\/a> \"Print version :<\/span>\" ;\u00A0\u00A0\u00A0\nschema:isSimilarTo<\/a> <http:\/\/www.worldcat.org\/oclc\/1023424847<\/a>> ; # The evaluators\' eye : impact assessment and academic peer review<\/span>\n\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n
<http:\/\/worldcat.org\/isbn\/9783319636276<\/a>>\u00A0\u00A0\u00A0\u00A0a \nschema:ProductModel<\/a> ;\u00A0\u00A0\u00A0\nschema:isbn<\/a> \"3319636278<\/span>\" ;\u00A0\u00A0\u00A0\nschema:isbn<\/a> \"9783319636276<\/span>\" ;\u00A0\u00A0\u00A0\u00A0.\n\n\n<\/div>\n