FETCH, a children's television series produced by WGBH since 2005, is a competition-based game/reality show for 6-10 year-old children that includes both animation and live action footage. Goodman Research Group, Inc. (GRG), a research firm specializing in the evaluation of educational programs, materials, and services, served as the external evaluator for the FETCH series in Season Two. GRG's evaluation focused on the science and engineering challenges presented in the show, and assessed the influence of the series on children's understanding of science and engineering concepts and processes
The findings from this evaluation indicate that compared to the typical children's Web site, parents consider the PEEP Web site to be more educational and easier for children to navigate on their own. Children were very engaged by the Interactive Games, and demonstrated proficiency with regard to comprehension and site navigation. Further, parents rated the Anywhere Science Activities very positively, particularly noting that the activities gave parents excellent ideas for how to turn everyday situations into science explorations with their children.
This external evaluation of the PEEP Explorer's Guide found the Guide effective in meeting its goals. Teachers who used the Guide were extremely satisfied with its content, materials, and usability. They reported the Guide was highly appealing to children, and they used materials from the Guide to forge home-school connections. Teachers found the Guide made useful links between science, literacy, and language. Pre-post comparisons demonstrated that, while teachers were engaged in similar instructional practices before and after using the Guide, the Guide alleviated the challenges of teaching
In this Summative Evaluation, Goodman Research Group, Inc. found that PEEP effectively models science inquiry skills, including predicting, observing, and problem solving. Children who were exposed to PEEP interacted with materials in ways that were significantly more grounded in science inquiry than children who were not. By a margin of 71% to 22%, for example, children who watched PEEP were more likely to initiate a question to be explored. Children exposed to PEEP were also more likely to use problem-solving strategies (76% compared to 34%) and more likely to solve the problems they
Summative evaluation of the NSF- and NEH-funded Hunters of the Sky exhibition, including remedial, timing and tracking, and summative. The 5,000 square foot exhibition takes a science and humanities perspective on birds of prey. A particular focus of the evaluation was the exhibition's impact on "getting visitors to explore their own values and beliefs about the human relationship to the natural world" as well as "getting visitors to critically examine questions of economics, public policy, and environmental ethics related to the survival of raptors and their habitats." Sample data collection
DATE:
TEAM MEMBERS:
Deborah PerryKarla NiehusScience Museum of Minnesota
In June of 2007, American Institutes for Research (AIR) conducted two focus groups to support WGBH in gathering feedback from children aged 7-10 on the FETCH! television program. The main objective of the focus groups were to: 1) gain insight into children' previous perceptions of scientists and whether or not such perceptions related to the demographic composition of the groups or informed their perception of scientists and scientific careers, and 2) determine how FETCH! supports or challenges these perceptions and how the seres might be enhanced to inspire children to consider careers in
In 2012, Concord Evaluation Group (CEG) conducted an evaluation of the impact of Peep and the Big Wide World (Peep) resources on Spanish-speaking families with preschool-aged children. The three-pronged evaluation included a National Family Study in which 112 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who did not use the Peep resources. It also included an In-Depth Family Study -- an experiment conducted in the metro Boston area in which 36 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who
Children's Discovery Museum of San Jose (CDM) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of the Mammoth Discovery! exhibition, one part of a comprehensive project funded by the National Science Foundation (NSF). Mammoth Discovery! features the story of Lupe, fossilized mammoth bones found in San Jose and includes a full-size replica of Lupe and Lupe's actual skull, femur, and pelvis fossils. Through engagement with the exhibition, CDM intends for children and their caregivers to engage in scientific thinking, become aware that they are engaging in a
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Children's Discovery Museum
Produced by Twin Cities Public Television, St. Paul, MN, and sponsored by the National Science Foundation, SciGirls (SG) is a multimedia project for upper grade-school and middle-school tweens. Weekly half-hour episodes are tied in with web and outreach activities in the fields of science, technology and engineering. Multimedia Research, an independent evaluation group implemented a summative evaluation of the SG Season Two multimedia project. Fifth grade girls (N = 87) viewed three shows over three weeks. They could visit the SG website at any time but were required to visit and play a Pick'm
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
In August 2009, the Program Evaluation and Research Group (PERG) at Lesley University contracted with the project's PI at the University of New Hampshire (UNH) to evaluate My Dome: Defining the Computational and Cognitive Potential of Real Time Interactive Simulations in an Immersive Dome Environment, an NSF funded grant. The project focuses on creating interactive experiences in immersive virtual environments, and builds off previous work the PI and co PIs have done in developing films and immersive experiences in domes and traveling domes. The project includes staff from the Carnegie Museum
The Natural History Museum of Los Angeles County (NHMLAC) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a hybrid evaluation that was both front-end evaluation and formative evaluation. NHMLAC created a full-size prototype of a portion of Nature Lab, an exhibition that prompts visitors to think about LA's urban nature and their connection to it, while highlighting the main idea that LA is a biodiversity hotspot. The prototype was installed in the space where the completed exhibition will live, and the evaluation explored visitors' responses to the proposed exhibition content and
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
In 2009, the Monterey Bay Aquarium began looking at new ways to interpret its Seafood Watch program. This nationwide conservation program strives to educate the public about the importance of buying sustainable seafood. As part of the program, the Aquarium publishes a printed pocket guide that lists the types of seafood consumers should buy and the types they should avoid. (For more information, visit www.seafoodwatch.org.) Over the years, several zoos, aquariums and museums that partner with the Aquarium have expressed interest in displaying an exhibit to encourage more of their visitors to