The Gallery of California Natural Sciences hosted four preview events before officially opening all sections. The target audiences for the evaluation of developing exhibits were Members and the general public with a focus on families. Researchers collected qualitative data in response to prototypes and developing exhibits for the Introduction and Oakland Sections, as well as for the developing Now and Then and Coastal Issues Lounges, and for the prototyping of live gallery animations. An exit survey was also administered to capture narrative, qualitative responses to visitors’ experience of
DATE:
TEAM MEMBERS:
Oakland Museum of CaliforniaMary T. Faria
These are samples of observation/interview testing instruments that were used in front end studies with recruited visitors to experience habitat case "interventions" such as guide cards and question prompts; and understanding concepts for a digital interactive.
DATE:
TEAM MEMBERS:
Oakland Museum of CaliforniaMary T. Faria
This study focused on informal reasoning regarding socioscientific issues. It sought to explore how content knowledge influenced the negotiation and resolution of contentious and complex scenarios based on genetic engineering. Two hundred and sixty-nine students drawn from undergraduate natural science and nonnatural science courses completed a quantitative test of genetics concepts. Two subsets (n = 15 for each group) of the original sample representing divergent levels of content knowledge participated in individual interviews, during which they articulated positions, rationales
The Educational Gaming Environments group (EdGE) at TERC embarked on a research project to study serious online collaborative gaming environments as a vehicle for engaging the public with National Science Digital Library (NSDL) resources. The goal of the project was two-fold: to design and test serious games that use a prototype virtual resource center; and to build a community and framework for creating a Serious Games Pathway to deliver NSDL resources into this burgeoning community with the aim of facilitating STEM learning. As part of this endeavor, the external evaluators under the
The data collection for this project involved three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after-school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Lincoln, Nebraska. Year two data collection was completed from September 2013 - March 2014. Appendix includes survey.
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets
The evaluation examined the overall visitor experience (time spent, main message comprehension, response to exhibition look and feel) in the 1,100-square-foot Animal Attraction as well as the exhibition's multimedia content delivered via 18 iPads. Specifically, researchers explored iPad usability and visitors’ reactions to the iPad content, especially compared to static labels found in other areas of Animal Attraction. Findings indicate that the iPads appealed to all visitors segments and that iPad users spent more time in the exhibition than visitors who did not use the iPads. However, many
DATE:
TEAM MEMBERS:
California Academy of SciencesJon DeuelJessica Brainard
Goodman Research Group, Inc. (GRG), a Cambridge-based research firm specializing in the evaluation of educational programs, conducted the summative evaluation of StarTalk. The overall focus was to examine how well the joint presentation of science and humor reaches a public audience, including an audience not typically exposed to informal science learning, and how well it engages and informs them, such that they are motivated to continue learning more. Primary evaluation research questions included: 1. To what extent does exposure to StarTalk lead to increased interest in and knowledge of
Knowledge of Climate Change Among Science & Technology Museum Visitors reports results from a national study of what the American public understands about how the climate system works, and the causes, impacts and potential solutions to global warming. This report describes how knowledge of climate change varies across Science and Technology Museum visitors. Using a straight grading scale, 38% of both occasional and frequent museum visitors received a passing grade (A, B, or C), compared to 19% of non-visitors. While knowledge levels vary across the groups, these results also indicate that
This report details a nine-month summative evaluation of the Underwater Dome Exhibit at the Seattle Aquarium. The study was undertaken to inform the Aquarium's development of short- term, cost-effective updates to improve visitor satisfaction and experience in the dome. The study sought to develop a baseline understanding of how visitors use and react to the exhibit, as well as to determine whether or not visitors understand that the dome represents the Puget Sound. Data was collected using observational and survey instruments (included in the appendix of this report).
This report presents findings based on the largest and most international study of zoo and aquarium visitors ever conducted worldwide. The study used a pre- and post-visit repeated-measures survey design to evaluate biodiversity literacy - biodiversity understanding and knowledge of actions to help protect biodiversity - in zoo and aquarium visitors. In total, more than 6,000 visitors to 30 zoos and aquariums around the globe participated in the study. Appendix contains survey.
DATE:
TEAM MEMBERS:
World Association of Zoos and AquariumsAndrew MossEric JensenMarkus Gusset
resourceresearchProfessional Development, Conferences, and Networks
In evaluating the success of teacher development programs, valid and scalable measures of teaching practice are needed. We have developed and validated the Science Lesson Plan Analysis Instrument (SLPAI) for quantitative evaluation of teacher-generated multiday lesson plans. This paper presents the SLPAI as a complement to surveys and classroom observation, and demonstrates its use in 2 pilot studies. The SLPAI was used formatively to measure the teaching practices of incoming program cohorts and tailor program instruction. It was also used to track changes in teaching practice and pedagogical
DATE:
TEAM MEMBERS:
Christina JacobsSonya MartinTracey Otieno
This research examined the nature of parent–child conversations at an informal science education center housed in an active gravitational-wave observatory. Each of 20 parent–child dyads explored an interactive exhibit hall privately, without the distraction of other visitors. Parents employed a variety of strategies to support their children's understanding of unfamiliar topics, including describing evidence, giving direction, providing explanation, making connections, and eliciting predictions. Parents' education was associated with both the amount of time dyads spent exploring exhibits and