In August 2012, the National Museum of Natural History (NMNH) contracted with Audience Focus (AF), a Maryland-‐based research and evaluation organization, to evaluate visitors’ experiences with the Scientist Is In program. Specifically, AF was asked to design a comprehensive study that would provide insight into the nature of visitors’ engagement with the program, and how participation in the program influenced visitors’ understanding of and curiosity about science topics, awareness of science careers, perceptions of NMNH as a research institution, and recognition of the connections between
In 2012, the Science Museum of Minnesota (SMM) received funding from the National Institutes of Health (NIH) to develop an exhibition utilizing objects from the former Museum of Questionable Medical Devices (QMDs), contextualizing them in the greater conversation about scientific skepticism and how people make healthcare decisions. The resulting exhibition, Weighing the Evidence, opened in December 2015. This kt, object-based exhibition is organized into four islands of artifacts with accompanying information and hands-on “Try It” interactives, which allow visitors to experience some
The San Diego Natural History Museum (theNAT) contracted RK&A to conduct a summative evaluation of the exhibition Extraordinary Ideas from Ordinary People: A History of Citizen Science and to explore how well the exhibition communicates an inclusive view of science. The goals for the evaluation were to explore visitors’ behaviors in the exhibition as well as understand what meanings visitors made from the exhibition, particularly with regard to how the exhibition’s messages about citizen science are resonating in the context of visitors’ science identity.
RK&A conducted timing and tracking
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
This summative evaluation study examines visitors' experiences of the "Plastics Unwrapped" exhibit at the Burke Museum of Natural History, Seattle, WA. The exhibit explores the complicated legacy of plastic, and the ways in which it has improved life, but not without serious impact on people and the environment. Within a framework of four evaluation questions, this study used multiple methods to assess what visitors do and where they spend their time in the exhibit, what knowledge they take away, and whether the exhibit impacts visitors' attitude toward plastic and their perception of the
The overall goal of the project was to convene a large-scale, open conference on public participation in scientific research, bringing together science researchers, project leaders, educators, technology specialists, evaluators, and others from across many disciplines to discuss advancing the field of PPSR. The conference included three sessions for posters and conversations, and five plenary sessions of presentations. The meeting culminated in an open meeting to explore strategies for large-scale collaborations to support and advance work across this field of practice, through the development
DATE:
TEAM MEMBERS:
The Schoodic Education and Research Center InstituteJoe E Heimlich
resourceevaluationProfessional Development, Conferences, and Networks
Children’s Discovery Museum of San Jose (CDM) contracted Randi Korn & Associates, Inc. (RK&A) to study the professional development component of Mammoth Discovery!, a NSF-funded project. The professional development part of the project convened a group of museum professionals (cohort participants) from select children’s museums to participate in several workshops, developed and conducted by CDM staff, and gatherings at a number of Association of Children’s Museums (ACM) conferences. RK&A conducted the evaluation to measure the impact of these experiences on the professional practice of cohort
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Children's Discovery Museum of San Jose
Purpose: To determine the effectiveness of the Evolution Wall and Research Highlight exhibit in conveying the main topics of the exhibit: biodiversity and the research of Burke curators. Evaluation Questions: 1.What is the nature of Evolution Wall and Research Highlight use by visitors? What draws their attention? 2.Do visitors understand that the exhibit is about evolution and biodiversity? 3.To what extent are visitors aware that Burke curators are involved with and conduct current research? Key Findings: 1.The Evolution Wall and the photos were the most interesting components of exhibit for
DATE:
TEAM MEMBERS:
Ari EinbinderAmy DygertDylan HighBurke Natural History Museum
Goodman Research Group, Inc. (GRG) conducted front-end evaluation and Alpha testing for the Harvard-Smithsonian Center for Astrophysics of EarthScope Panorama, an interactive Earth science game for middle school youth. The front-end evaluation focused on the prospective content, format, and platform of the game, with the broad goal of assessing four different game prototypes in a population of middle school students. The specific objectives of the evaluation were to document and assess what students already know about EarthScope-related themes and content, what geoscience questions they have
DATE:
TEAM MEMBERS:
Marianne E. McPhersonLaura HousemanIrene F GoodmanHarvard-Smithsonian Center for AstrophysicsSmithsonian Astrophysical Observatory
FETCH, a children's television series produced by WGBH since 2005, is a competition-based game/reality show for 6-10 year-old children that includes both animation and live action footage. Goodman Research Group, Inc. (GRG), a research firm specializing in the evaluation of educational programs, materials, and services, served as the external evaluator for the FETCH series in Season Two. GRG's evaluation focused on the science and engineering challenges presented in the show, and assessed the influence of the series on children's understanding of science and engineering concepts and processes
In June of 2007, American Institutes for Research (AIR) conducted two focus groups to support WGBH in gathering feedback from children aged 7-10 on the FETCH! television program. The main objective of the focus groups were to: 1) gain insight into children' previous perceptions of scientists and whether or not such perceptions related to the demographic composition of the groups or informed their perception of scientists and scientific careers, and 2) determine how FETCH! supports or challenges these perceptions and how the seres might be enhanced to inspire children to consider careers in