This study focused on informal reasoning regarding socioscientific issues. It sought to explore how content knowledge influenced the negotiation and resolution of contentious and complex scenarios based on genetic engineering. Two hundred and sixty-nine students drawn from undergraduate natural science and nonnatural science courses completed a quantitative test of genetics concepts. Two subsets (n = 15 for each group) of the original sample representing divergent levels of content knowledge participated in individual interviews, during which they articulated positions, rationales
This front-end evaluation sought (1) to identify visitors' prior knowledge of microbial oceanography, and (2) to determine visitors’ interest in the different research conducted by microbial oceanographers with metagenomics data. The findings from this study served to (1) guide the selection of scientific datasets that are meaningful to visitors, (2) suggest areas of interest to highlight, and (3) identify information or explanations visitors may need to make sense of the content, for the Living Liquid pathways project that aimed to use visualization tools to engage museum visitors with
The evaluation examined the overall visitor experience (time spent, main message comprehension, response to exhibition look and feel) in the 1,100-square-foot Animal Attraction as well as the exhibition's multimedia content delivered via 18 iPads. Specifically, researchers explored iPad usability and visitors’ reactions to the iPad content, especially compared to static labels found in other areas of Animal Attraction. Findings indicate that the iPads appealed to all visitors segments and that iPad users spent more time in the exhibition than visitors who did not use the iPads. However, many
DATE:
TEAM MEMBERS:
California Academy of SciencesJon DeuelJessica Brainard
This report details a nine-month summative evaluation of the Underwater Dome Exhibit at the Seattle Aquarium. The study was undertaken to inform the Aquarium's development of short- term, cost-effective updates to improve visitor satisfaction and experience in the dome. The study sought to develop a baseline understanding of how visitors use and react to the exhibit, as well as to determine whether or not visitors understand that the dome represents the Puget Sound. Data was collected using observational and survey instruments (included in the appendix of this report).
This report summarizes findings from a three-year study of the Time Team America: Science of Archeology project, funded by the National Science Foundation. The project included a series of archaeology field schools for youth, four broadcast episodes and a redesigned website with a variety of information and instructional resources. The evaluation included both formative and summative components and a mix of qualitative and quantitative methods including surveys, interviews, and focus groups. Includes interview protocol and survey.
This report summarizes front-end research with visitors on the topic of agriculture, conducted by the Research & Evaluation Department of the Saint Louis Science Center. This front-end study was designed to inform the internal development teams connected to the Science Center agriculture exhibit. The main objective of the research was to gather information from Science Center visitors about their familiarity and interest in the topic, their experiences with farming, their top of mind knowledge about technology and sustainability as it relates to agriculture, and their expectations for an
Funded by NSF, Earth: The Operators’ Manual (ETOM) is a users’ guide to the present and future energy resources of our planet, providing “users” with the information, attitudes and tools to make wiser choices about powering homes, schools, businesses and communities. ETOM uses a hybrid model of science communication including video + in-person presentations + Web 2.0 social networking. Rockman et al evaluated project impact, working from front-end to summative stages to understand the reactions of media, online and on-site audiences using both qualitative and quantitative measures to look at
This report was completed by the Program Evaluation Research Group at Endicott College in October 2013. It describes the outcomes and impacts of a four-year, NSF-funded project called Go Botany: Integrated Tools to Advance Botanical Learning (grant number 0840186). Go Botany focuses on fostering increased interest in and knowledge of botany among youth and adults in New England. This was being done through the creation of an online flora for the region, along with the development of related tools, including PlantShare, and a user-friendly interface for ‘smartphones’. In January 2012, the PI
DATE:
TEAM MEMBERS:
Judah LeblangNew England Wild Flower Society
In 2011, the Space Science Institute (SSI) engaged Insight Evaluation Services (IES) to conduct a summative evaluation of an online, multi-user space science game called MyStar. The game, which was developed with funding from the National Aeronautics and Space Administration (NASA), was designed to introduce late middle school-early high school students to the basic concepts of stellar and planetary evolution. IES assessed the effectiveness of MyStar in meeting specific learning goals, including in particular (1) The galaxy has “habitable zones” where planetary formation and/or life is more
This article discusses visitors' ability to interpret geographic maps. It describes a study that examined how easily adult visitors to the Bronx Zoo were able to identify two continents and countries on maps, and their interpretation of the term "range." Findings suggest a need to revise maps in exhibit labels to improve visitor comprehension and the authors make recommendations on how to do so. The appendix includes a copy of the interview protocol used in the study.
This paper presents research methodology and findings from a formative evaluation of the "Habitat Africa! Thirsty Animal Trail" exhibit at the Brookfield Zoo. This exhibit intended to encourage visitors to imagine themselves as thirsty animals trying to gain access to a waterhole safely. The appendix of this paper includes copies of the interview protocol and the exit interview protocol.
In this paper, Margaret M. Ropp of the Michigan State University Museum discusses a study that explored visitors' experiences with the exhibit, "Ethiopia: Traditions of Creativity" and the role that the video interpretation played. The exhibition team was concerned that African art is often seen as primitive, anonymous, and devoid of creativity, so they developed individual videos for the 11 featured artists in an effort to counter those stereotypes. The major finding is that the videos helped the visitors who watched them to connect the creative process, the artist and the final product