In August 2012, the National Museum of Natural History (NMNH) contracted with Audience Focus (AF), a Maryland-‐based research and evaluation organization, to evaluate visitors’ experiences with the Scientist Is In program. Specifically, AF was asked to design a comprehensive study that would provide insight into the nature of visitors’ engagement with the program, and how participation in the program influenced visitors’ understanding of and curiosity about science topics, awareness of science careers, perceptions of NMNH as a research institution, and recognition of the connections between
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
The Koshland Youth Research Lab (Research Lab) began as an eight-month pilot program funded by the DEK Family Fund at the San Francisco Foundation. The project (initially implemented in 2011) used frontend and formative evaluation to develop the program in line with the needs and interests of its target audience of Hispanic youth. The summative evaluation took place in the last month of the program (December 2011). Researchers from UXR Consulting, Inc. were engaged to conduct all phases of the evaluation. This report includes the interview protocol and surveys used in the study.
DATE:
TEAM MEMBERS:
Jes A. KoepflerKoshland Science Museum
In order to better understand how visitors to science and natural history museums connect to ideas around Indigenous knowledge and Western science, the Cosmic Serpent evaluation team (Institute for Learning Innovation and Native Pathways) conducted front-end audience research focused on audience perceptions and attitudes towards Indigenous ways of knowing and Western science in informal science settings.A total of 121 exit interviews were conducted with visitors to the New Mexico Museum of Natural History and Science in Albuquerque, NM, and to the Oregon Museum of Science and Industry in
DATE:
TEAM MEMBERS:
Jill SteinShelly ValdezTammy MessickUniversity of California-BerkeleyIndigenous Education Institute
The Salmon Camp Research Team (SCRT) project was created to address the under-representation of Native Americans in information technology (IT) and IT-intensive professions in science, technology, engineering, and mathematics (STEM). The Oregon Museum of Science and Industry (OMSI) partnered with the Native American Youth and Family Association (NAYA) under renewed National Science Foundation funding to strengthen community involvement and work directly with students year round. The 2007-2008 evaluation of the project found evidence of effective implementation and data on important student
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
Overarching evaluation questions focus on continuous improvement, the degree to which the Salmon Camp project achieves its objectives with regards to students' skills and attitudes, as well as implementation and outcome questions. Evaluation activities are designed to probe five major areas: 1. Student Knowledge and Skills. To what extent do students gain experience with digital tools, field research, and workplace skills? 2. Student Attitudes. How are students' attitudes and self-efficacy as science students changing with involvement in Salmon Camp? How are career interests changing or
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
Overarching evaluation questions focus on continuous improvement, the degree to which the Salmon Camp project achieves it's objectives with regards to students' skills and attitudes, as well as implementation and outcome questions. Evaluation activities are designed to probe five major areas: 1. Student Knowledge and Skills. To what extent do students gain experience with digital tools, field research, and workplace skills? 2. Student Attitudes. How are students' attitudes and self-efficacy as science students changing with involvement in Salmon Camp? How are career interests changing or
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
In 2008, Goodman Research Group, Inc. (GRG) conducted summative evaluation of Absolute Zero, a collaborative effort of the University of Oregon's Cryogenic Helium Turbulence Laboratory and Twin Cities Public Television. The films were produced by Meridian/Windfall Productions, Washington DC, and/Windfall Films in London, UK. Outreach was spearheaded by Devillier Communications, Inc. The Absolute Zero project was centered on a two-part documentary about low-temperature physics, which aired on PBS/NOVA in early January 2008, as well as an outreach campaign, which included approximately 20
DATE:
TEAM MEMBERS:
Irene GoodmanUniversity of OregonLaura HousemanMarianne McPherson
Goodman Research Group, Inc. (GRG) conducted summative evaluation of the educational resources kit for Forgotten Genius, a program from the PBS television series Lives in Science. Forgotten Genius explored the life of the scientist Percy Julian, an African American chemist who persevered in the face of racism to become one of the great scientists and inventors of the 20th century. GRG's evaluation focused on how public librarians used and assessed the educational resources kit, as well as their suggestions for revising the kit and conducting future science-related library outreach. The
DATE:
TEAM MEMBERS:
Marianne McPhersonJennie MurackIrene F GoodmanWGBH