Goodman Research Group, Inc. (GRG) conducted front-end evaluation and Alpha testing for the Harvard-Smithsonian Center for Astrophysics of EarthScope Panorama, an interactive Earth science game for middle school youth. The front-end evaluation focused on the prospective content, format, and platform of the game, with the broad goal of assessing four different game prototypes in a population of middle school students. The specific objectives of the evaluation were to document and assess what students already know about EarthScope-related themes and content, what geoscience questions they have
DATE:
TEAM MEMBERS:
Marianne E. McPhersonLaura HousemanIrene F GoodmanHarvard-Smithsonian Center for AstrophysicsSmithsonian Astrophysical Observatory
FETCH, a children's television series produced by WGBH since 2005, is a competition-based game/reality show for 6-10 year-old children that includes both animation and live action footage. Goodman Research Group, Inc. (GRG), a research firm specializing in the evaluation of educational programs, materials, and services, served as the external evaluator for the FETCH series in Season Two. GRG's evaluation focused on the science and engineering challenges presented in the show, and assessed the influence of the series on children's understanding of science and engineering concepts and processes
In June of 2007, American Institutes for Research (AIR) conducted two focus groups to support WGBH in gathering feedback from children aged 7-10 on the FETCH! television program. The main objective of the focus groups were to: 1) gain insight into children' previous perceptions of scientists and whether or not such perceptions related to the demographic composition of the groups or informed their perception of scientists and scientific careers, and 2) determine how FETCH! supports or challenges these perceptions and how the seres might be enhanced to inspire children to consider careers in
In August 2009, the Program Evaluation and Research Group (PERG) at Lesley University contracted with the project's PI at the University of New Hampshire (UNH) to evaluate My Dome: Defining the Computational and Cognitive Potential of Real Time Interactive Simulations in an Immersive Dome Environment, an NSF funded grant. The project focuses on creating interactive experiences in immersive virtual environments, and builds off previous work the PI and co PIs have done in developing films and immersive experiences in domes and traveling domes. The project includes staff from the Carnegie Museum
In 2009, the Monterey Bay Aquarium began looking at new ways to interpret its Seafood Watch program. This nationwide conservation program strives to educate the public about the importance of buying sustainable seafood. As part of the program, the Aquarium publishes a printed pocket guide that lists the types of seafood consumers should buy and the types they should avoid. (For more information, visit www.seafoodwatch.org.) Over the years, several zoos, aquariums and museums that partner with the Aquarium have expressed interest in displaying an exhibit to encourage more of their visitors to
The Koshland Youth Research Lab (Research Lab) began as an eight-month pilot program funded by the DEK Family Fund at the San Francisco Foundation. The project (initially implemented in 2011) used frontend and formative evaluation to develop the program in line with the needs and interests of its target audience of Hispanic youth. The summative evaluation took place in the last month of the program (December 2011). Researchers from UXR Consulting, Inc. were engaged to conduct all phases of the evaluation. This report includes the interview protocol and surveys used in the study.
DATE:
TEAM MEMBERS:
Jes A. KoepflerKoshland Science Museum
The University of Central Florida (UCF) received funding from the National Science Foundation through the Informal Science Education program (# 0638977) to create a series of exhibits entitled Water's Journey through the Everglades (Water's Journey). The project deliverables included ten kiosks integrated into an expansion of the Museum of Discovery and Science (MODS) in Fort Lauderdale, FL, with the new exhibition areas opening in November 2011. The kiosks model aspects of Florida's ecosystems and natural history, highlighting the natural balance of the Everglades and the interplay between
DATE:
TEAM MEMBERS:
Susan FoutzKara HershorinUniversity of Central FloridaMuseum of Discovery and Science
The exhibition Innovation Showcase focused on energy-related innovation and individual action. As part of a larger project, Innovations in Energy, the central visitor-focused question for this exhibition was: "To what extent and in what ways do the various components of Innovations in Energy serve toward meeting outcomes for the target audiences?" This summative evaluation of Innovation Showcase addressed this question by identifying how COSI visitors used the gallery space (particularly at the level of individual exhibition elements) and how they described their experience in Innovation
Frontier Scientists (FS) is an NSF-funded University of Alaska - Fairbanks (UAF) and WonderVisions (WV) collaborative project whose mission was to excite the general public about ongoing science in Alaska and the Arctic. The Frontier Scientists website (www.frontierscientists.com) covers a wide range of topics including: humanities, geology, biology, marine science, archaeology, ecology, chemistry, and more. At the time of the summative evaluation, it included 53 video clips (the major focus of the website), as well as a number of blog posts, narrative descriptions, and short bios.This
DATE:
TEAM MEMBERS:
Deborah PerryUniversity of Alaska - Fairbanks
In order to better understand how visitors to science and natural history museums connect to ideas around Indigenous knowledge and Western science, the Cosmic Serpent evaluation team (Institute for Learning Innovation and Native Pathways) conducted front-end audience research focused on audience perceptions and attitudes towards Indigenous ways of knowing and Western science in informal science settings.A total of 121 exit interviews were conducted with visitors to the New Mexico Museum of Natural History and Science in Albuquerque, NM, and to the Oregon Museum of Science and Industry in
DATE:
TEAM MEMBERS:
Jill SteinShelly ValdezTammy MessickUniversity of California-BerkeleyIndigenous Education Institute
The Salmon Camp Research Team (SCRT) project was created to address the under-representation of Native Americans in information technology (IT) and IT-intensive professions in science, technology, engineering, and mathematics (STEM). The Oregon Museum of Science and Industry (OMSI) partnered with the Native American Youth and Family Association (NAYA) under renewed National Science Foundation funding to strengthen community involvement and work directly with students year round. The 2007-2008 evaluation of the project found evidence of effective implementation and data on important student
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
Overarching evaluation questions focus on continuous improvement, the degree to which the Salmon Camp project achieves its objectives with regards to students' skills and attitudes, as well as implementation and outcome questions. Evaluation activities are designed to probe five major areas: 1. Student Knowledge and Skills. To what extent do students gain experience with digital tools, field research, and workplace skills? 2. Student Attitudes. How are students' attitudes and self-efficacy as science students changing with involvement in Salmon Camp? How are career interests changing or
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry