This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
Funded by the National Science Foundation (NSF), the Center for High-rate Nanomanufacturing (CHN) brings together three universities with unique strengths in nanoscience and nanomanufacturing: the University of Massachusetts, Lowell (UML); Northeastern University, Boston (NEU); and the University of New Hampshire, Durham (UNH). The University of Massachusetts Donahue Institute (UMDI) is conducting the five-year evaluation of CHN's education and outreach activities. The evaluation uses multiple sources of evidence to analyze project processes and outcomes. Using quantitative and qualitative
DATE:
TEAM MEMBERS:
Center for High-rate NanomanufacturingCarol Lynn AlpertCarol Barry
resourceevaluationProfessional Development, Conferences, and Networks
Funded by the National Science Foundation (NSF), the Center for High-rate Nanomanufacturing (CHN) brings together three universities with unique strengths in nanoscience and nanomanufacturing: the University of Massachusetts, Lowell (UML); Northeastern University, Boston (NEU); and the University of New Hampshire, Durham (UNH). The University of Massachusetts Donahue Institute (UMDI) is conducting the five-year evaluation of CHN's education and outreach activities. The evaluation uses multiple sources of evidence to analyze project processes and outcomes. Using quantitative and qualitative
DATE:
TEAM MEMBERS:
Center for High-rate NanomanufacturingCarol Lynn AlpertCarol BarryUMass Donahue Institute Research and Evaluation Group
resourceevaluationProfessional Development, Conferences, and Networks
Children’s Discovery Museum of San Jose (CDM) contracted Randi Korn & Associates, Inc. (RK&A) to study the professional development component of Mammoth Discovery!, a NSF-funded project. The professional development part of the project convened a group of museum professionals (cohort participants) from select children’s museums to participate in several workshops, developed and conducted by CDM staff, and gatherings at a number of Association of Children’s Museums (ACM) conferences. RK&A conducted the evaluation to measure the impact of these experiences on the professional practice of cohort
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Children's Discovery Museum of San Jose
Goodman Research Group, Inc. (GRG) conducted front-end evaluation and Alpha testing for the Harvard-Smithsonian Center for Astrophysics of EarthScope Panorama, an interactive Earth science game for middle school youth. The front-end evaluation focused on the prospective content, format, and platform of the game, with the broad goal of assessing four different game prototypes in a population of middle school students. The specific objectives of the evaluation were to document and assess what students already know about EarthScope-related themes and content, what geoscience questions they have
DATE:
TEAM MEMBERS:
Marianne E. McPhersonLaura HousemanIrene F GoodmanHarvard-Smithsonian Center for AstrophysicsSmithsonian Astrophysical Observatory
FETCH, a children's television series produced by WGBH since 2005, is a competition-based game/reality show for 6-10 year-old children that includes both animation and live action footage. Goodman Research Group, Inc. (GRG), a research firm specializing in the evaluation of educational programs, materials, and services, served as the external evaluator for the FETCH series in Season Two. GRG's evaluation focused on the science and engineering challenges presented in the show, and assessed the influence of the series on children's understanding of science and engineering concepts and processes
In June of 2007, American Institutes for Research (AIR) conducted two focus groups to support WGBH in gathering feedback from children aged 7-10 on the FETCH! television program. The main objective of the focus groups were to: 1) gain insight into children' previous perceptions of scientists and whether or not such perceptions related to the demographic composition of the groups or informed their perception of scientists and scientific careers, and 2) determine how FETCH! supports or challenges these perceptions and how the seres might be enhanced to inspire children to consider careers in
In August 2009, the Program Evaluation and Research Group (PERG) at Lesley University contracted with the project's PI at the University of New Hampshire (UNH) to evaluate My Dome: Defining the Computational and Cognitive Potential of Real Time Interactive Simulations in an Immersive Dome Environment, an NSF funded grant. The project focuses on creating interactive experiences in immersive virtual environments, and builds off previous work the PI and co PIs have done in developing films and immersive experiences in domes and traveling domes. The project includes staff from the Carnegie Museum
The University of Central Florida (UCF) received funding from the National Science Foundation through the Informal Science Education program (# 0638977) to create a series of exhibits entitled Water's Journey through the Everglades (Water's Journey). The project deliverables included ten kiosks integrated into an expansion of the Museum of Discovery and Science (MODS) in Fort Lauderdale, FL, with the new exhibition areas opening in November 2011. The kiosks model aspects of Florida's ecosystems and natural history, highlighting the natural balance of the Everglades and the interplay between
DATE:
TEAM MEMBERS:
Susan FoutzKara HershorinUniversity of Central FloridaMuseum of Discovery and Science
Frontier Scientists (FS) is an NSF-funded University of Alaska - Fairbanks (UAF) and WonderVisions (WV) collaborative project whose mission was to excite the general public about ongoing science in Alaska and the Arctic. The Frontier Scientists website (www.frontierscientists.com) covers a wide range of topics including: humanities, geology, biology, marine science, archaeology, ecology, chemistry, and more. At the time of the summative evaluation, it included 53 video clips (the major focus of the website), as well as a number of blog posts, narrative descriptions, and short bios.This
DATE:
TEAM MEMBERS:
Deborah PerryUniversity of Alaska - Fairbanks