From October 2015 to July 2016, Smart Start Evaluation & Research conducted a formative evaluation of a full-length film festival cut of the film The Anthropologist in order to provide feedback that improves decision-making capacity for the film’s final edit, production design, and distribution strategies in line with the project’s goals (see p. 5).
SmartStart conducted focus group interviews with participants to 1) measure their initial impressions of the film and its content, and 2) provide feedback on content, edits, target audience, website, and ideas for distribution. SmartStart then
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
This summative evaluation study examines visitors' experiences of the "Plastics Unwrapped" exhibit at the Burke Museum of Natural History, Seattle, WA. The exhibit explores the complicated legacy of plastic, and the ways in which it has improved life, but not without serious impact on people and the environment. Within a framework of four evaluation questions, this study used multiple methods to assess what visitors do and where they spend their time in the exhibit, what knowledge they take away, and whether the exhibit impacts visitors' attitude toward plastic and their perception of the
This study of American adults’ attitudes towards children’s experiences in nature was based on survey data from 2,138 people who participated in an independently commissioned, online consumer survey in February 2010. The Encouraging Children’s Nature Experiences Scale (EC-NES) was created to assess adult attitudes and beliefs surrounding encouragement of children’s nature experiences. While a great deal of empirical research has already been undertaken to demonstrate the value and impact of these experiences, not all of the research has been adopted by the public. The EC-NES scale was designed
Summative evaluation of the NSF- and NEH-funded Hunters of the Sky exhibition, including remedial, timing and tracking, and summative. The 5,000 square foot exhibition takes a science and humanities perspective on birds of prey. A particular focus of the evaluation was the exhibition's impact on "getting visitors to explore their own values and beliefs about the human relationship to the natural world" as well as "getting visitors to critically examine questions of economics, public policy, and environmental ethics related to the survival of raptors and their habitats." Sample data collection
DATE:
TEAM MEMBERS:
Deborah PerryKarla NiehusScience Museum of Minnesota
A NSF EArly-concept Grant for Exploratory Research (EAGER) was awarded to Principal Investigator John Fraser, PhD, AIA, in collaboration with co-Principal Investigators, Mary Miss and William Solecki, PhD, for City as Living Laboratory for Sustainability in Urban Design (CaLL). The CaLL project explored how public art installations can promote public discussion about sustainability. The project examined the emerging role of artists and visual thinkers as people with the skills to encourage conversation between scientists and the public. The grant supported an experimental installation
The Koshland Youth Research Lab (Research Lab) began as an eight-month pilot program funded by the DEK Family Fund at the San Francisco Foundation. The project (initially implemented in 2011) used frontend and formative evaluation to develop the program in line with the needs and interests of its target audience of Hispanic youth. The summative evaluation took place in the last month of the program (December 2011). Researchers from UXR Consulting, Inc. were engaged to conduct all phases of the evaluation. This report includes the interview protocol and surveys used in the study.
DATE:
TEAM MEMBERS:
Jes A. KoepflerKoshland Science Museum
resourceevaluationProfessional Development, Conferences, and Networks
Cosmic Serpent (NSF No. DRL-0714631 and DRL-0714629) is a professional development effort that supports collaboration with integrity between science museum professionals and Native communities and/or tribal museums. Cosmic Serpent aims to create awareness of the value and integrity of Native science paradigms among museum practitioners, support them in connecting Native worldviews to Western science learning; and nurture sustainable collaborations between science museums and Native communities around featuring multiple worldviews of science in informal settings. The primary component of the
This front-end study aimed to capture baseline information about students' science interests and skills in support of the development of a new program called the Koshland Youth Research Lab. Specifically, the evaluation was driven by the following questions: 1) What are students' current attitudes and interests toward four selected science topics: adolescent sleep needs, teen sexuality and risky behaviors, water quality in your community, and adolescent health and nutrition? 2) What are students' current knowledge and skills with regard to scientific research methods and research design? Data
DATE:
TEAM MEMBERS:
Jes A. KoepflerMarian Koshland Science Museum
In order to better understand how visitors to science and natural history museums connect to ideas around Indigenous knowledge and Western science, the Cosmic Serpent evaluation team (Institute for Learning Innovation and Native Pathways) conducted front-end audience research focused on audience perceptions and attitudes towards Indigenous ways of knowing and Western science in informal science settings.A total of 121 exit interviews were conducted with visitors to the New Mexico Museum of Natural History and Science in Albuquerque, NM, and to the Oregon Museum of Science and Industry in
DATE:
TEAM MEMBERS:
Jill SteinShelly ValdezTammy MessickUniversity of California-BerkeleyIndigenous Education Institute
Cracking the Maya Code is a one-hour PBS/NOVA adaptation of the two-hour feature documentary Breaking the Maya Code, based on the book of the same title by Michael D. Coe. Major funding for the project - which included website, eduational and outreach components - was provided by the National Science Foundation and the National Endowment for the Humanities. Knight Williams Research conducted a summative evaluation of Cracking the Maya Code. The evaluation examined the appeal, clarity, and educational impact of the program, focusing on educating Viewers about: The basic principles that underlie
The summative evaluation of Yuungnaqpiallerput used two evaluation strategies--tracking and timing (T&T) and an open-ended questionnaire (CQ)--to discover how visitors used the exhibition and what they could immediately recall about it. The combined data from these methods produced a well-rounded set of evidence for the degree of success achieved by the exhibition. Yuungnaqpiallerput was designed to be engaging to both an Alaska Native American audience and non-natives. Of the 61 people in the CQ sample, 69% said that they were first-time visitors to the Anchorage Museum, and 75% had no