Evaluation Capacity Building for Informal STEM Education

Working for Success Across the Field

Marjorie Bequette, Christopher L.B. Cardiel, Sarah Cohn, Elizabeth Kunz Kollmann, Frances P Lawrenz

Research output: Contribution to journalArticle

Abstract

Informal STEM education (ISE) organizations, especially museums, have used evaluation productively but unevenly. We argue that advancing evaluation in ISE requires that evaluation capacity building (ECB) broadens to include not only professional evaluators but also other professionals such as educators, exhibit developers, activity facilitators, and institutional leaders. We identify four categories of evaluation capacity: evaluation skill and knowledge, use of evaluation, organizational systems related to conducting or integrating evaluation, and values related to evaluation. We studied a field-wide effort to build evaluation capacity across a network of organizations and found it important to address individuals’ evaluation capacities as well as capacities at the organizational level. Organizational factors that support ECB included redundancy of evaluation capacities across multiple people in an organization, institutional coherence around the value of evaluation, and recognition that ECB can be led from multiple levels of an organizational hierarchy. We argue that the increasing emphasis on evaluation in the ISE field represents an exciting opportunity and that, with targeted strategies and investments, ECB holds great promise for the future of ISE and ISE evaluation.

Original languageEnglish (US)
Pages (from-to)107-123
Number of pages17
JournalNew Directions for Evaluation
Volume2019
Issue number161
DOIs
StatePublished - Mar 1 2019

Fingerprint

evaluation
education
Evaluation capacity building
Education
Evaluation
redundancy
museum
Values
educator
leader
organization

Cite this

Evaluation Capacity Building for Informal STEM Education : Working for Success Across the Field. / Bequette, Marjorie; Cardiel, Christopher L.B.; Cohn, Sarah; Kollmann, Elizabeth Kunz; Lawrenz, Frances P.

In: New Directions for Evaluation, Vol. 2019, No. 161, 01.03.2019, p. 107-123.

Research output: Contribution to journalArticle

Bequette, Marjorie ; Cardiel, Christopher L.B. ; Cohn, Sarah ; Kollmann, Elizabeth Kunz ; Lawrenz, Frances P. / Evaluation Capacity Building for Informal STEM Education : Working for Success Across the Field. In: New Directions for Evaluation. 2019 ; Vol. 2019, No. 161. pp. 107-123.
@article{589a116decc84efda7d7670b6a97e314,
title = "Evaluation Capacity Building for Informal STEM Education: Working for Success Across the Field",
abstract = "Informal STEM education (ISE) organizations, especially museums, have used evaluation productively but unevenly. We argue that advancing evaluation in ISE requires that evaluation capacity building (ECB) broadens to include not only professional evaluators but also other professionals such as educators, exhibit developers, activity facilitators, and institutional leaders. We identify four categories of evaluation capacity: evaluation skill and knowledge, use of evaluation, organizational systems related to conducting or integrating evaluation, and values related to evaluation. We studied a field-wide effort to build evaluation capacity across a network of organizations and found it important to address individuals’ evaluation capacities as well as capacities at the organizational level. Organizational factors that support ECB included redundancy of evaluation capacities across multiple people in an organization, institutional coherence around the value of evaluation, and recognition that ECB can be led from multiple levels of an organizational hierarchy. We argue that the increasing emphasis on evaluation in the ISE field represents an exciting opportunity and that, with targeted strategies and investments, ECB holds great promise for the future of ISE and ISE evaluation.",
author = "Marjorie Bequette and Cardiel, {Christopher L.B.} and Sarah Cohn and Kollmann, {Elizabeth Kunz} and Lawrenz, {Frances P}",
year = "2019",
month = "3",
day = "1",
doi = "10.1002/ev.20351",
language = "English (US)",
volume = "2019",
pages = "107--123",
journal = "New Directions for Evaluation",
issn = "1097-6736",
publisher = "Jossey-Bass Inc.",
number = "161",

}

TY - JOUR

T1 - Evaluation Capacity Building for Informal STEM Education

T2 - Working for Success Across the Field

AU - Bequette, Marjorie

AU - Cardiel, Christopher L.B.

AU - Cohn, Sarah

AU - Kollmann, Elizabeth Kunz

AU - Lawrenz, Frances P

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Informal STEM education (ISE) organizations, especially museums, have used evaluation productively but unevenly. We argue that advancing evaluation in ISE requires that evaluation capacity building (ECB) broadens to include not only professional evaluators but also other professionals such as educators, exhibit developers, activity facilitators, and institutional leaders. We identify four categories of evaluation capacity: evaluation skill and knowledge, use of evaluation, organizational systems related to conducting or integrating evaluation, and values related to evaluation. We studied a field-wide effort to build evaluation capacity across a network of organizations and found it important to address individuals’ evaluation capacities as well as capacities at the organizational level. Organizational factors that support ECB included redundancy of evaluation capacities across multiple people in an organization, institutional coherence around the value of evaluation, and recognition that ECB can be led from multiple levels of an organizational hierarchy. We argue that the increasing emphasis on evaluation in the ISE field represents an exciting opportunity and that, with targeted strategies and investments, ECB holds great promise for the future of ISE and ISE evaluation.

AB - Informal STEM education (ISE) organizations, especially museums, have used evaluation productively but unevenly. We argue that advancing evaluation in ISE requires that evaluation capacity building (ECB) broadens to include not only professional evaluators but also other professionals such as educators, exhibit developers, activity facilitators, and institutional leaders. We identify four categories of evaluation capacity: evaluation skill and knowledge, use of evaluation, organizational systems related to conducting or integrating evaluation, and values related to evaluation. We studied a field-wide effort to build evaluation capacity across a network of organizations and found it important to address individuals’ evaluation capacities as well as capacities at the organizational level. Organizational factors that support ECB included redundancy of evaluation capacities across multiple people in an organization, institutional coherence around the value of evaluation, and recognition that ECB can be led from multiple levels of an organizational hierarchy. We argue that the increasing emphasis on evaluation in the ISE field represents an exciting opportunity and that, with targeted strategies and investments, ECB holds great promise for the future of ISE and ISE evaluation.

UR - http://www.scopus.com/inward/record.url?scp=85062211257&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062211257&partnerID=8YFLogxK

U2 - 10.1002/ev.20351

DO - 10.1002/ev.20351

M3 - Article

VL - 2019

SP - 107

EP - 123

JO - New Directions for Evaluation

JF - New Directions for Evaluation

SN - 1097-6736

IS - 161

ER -