WGBH received funding to develop and create NOVA Labs, an online environment that provides teen audiences with an online research lab, educational content, and the opportunity to engage with authentic data, tools, and processes to investigate scientific questions. This work has begun with the development of a first pilot lab, called The Sun Lab. NOVA Education created and launched this lab in early summer 2012. Examining the site in its pilot form, the Lifelong Learning Group (LLG) engaged in a formative evaluation to support refinements and improvements in the design of subsequent NOVA Lab
NOVA Labs (www.pbs.org/nova/labs) is a web-based platform designed for use by educators, students, and teens to engage learners with authentic data, processes, and tools of working scientists. The present evaluation study sought to investigate the outcomes achieved by users of the third NOVA Labs platform developed: Cloud Lab. The intended outcomes identified for student users were that they would: • Be able to successfully work with the real data provided in the Cloud Lab; • Demonstrate ability to interpret and use scientific data and tools; • Engage with real scientific data through the
In 2009, NSF funded development of Model My Watershed (MMW), a place-based, watershed cyber-modeling tool for middle and high school students and teachers. The online learning tool encourages students to investigate their neighborhoods and use scientific reasoning with real-world decision-making models similar to those used by STEM professionals to simulate systems and analyze processes. The project also sought to increase youth interest in possible opportunities in the STEM workforce and to aid in development of knowledge about earth science. This summary represents the first of a two-phase
DATE:
TEAM MEMBERS:
Stroud Water Research CenterJohn Fraser
The Educational Gaming Environments group (EdGE) at TERC embarked on a research project to study serious online collaborative gaming environments as a vehicle for engaging the public with National Science Digital Library (NSDL) resources. The goal of the project was two-fold: to design and test serious games that use a prototype virtual resource center; and to build a community and framework for creating a Serious Games Pathway to deliver NSDL resources into this burgeoning community with the aim of facilitating STEM learning. As part of this endeavor, the external evaluators under the
At the Maryland Science Center, a new permanent exhibition with a companion mobile game is focused on electricity. Multimedia Research, an independent evaluation firm, implemented a summative evaluation to assess how using the PowerUp! game in the exhibition influences engagement and knowledge acquisition. The evaluation collected timing and tracking observations and pre- and post-interview data from 18 ten-year-olds who used the game within the Power Up! exhibition area and 16 ten-year-olds who did not use the game. Game players experienced the Power Up! exhibition area differently from non
DATE:
TEAM MEMBERS:
Maryland Science CenterBarbara FlaggIlona Holland
Produced by National Geographic Television and funded in part by the National Science Foundation (NSF), Alien Deep is a multi-platform media project designed to increase public literacy about: the fundamental principles and concepts underlying ocean systems and functions, the importance and challenges of oceanographic research and exploration, and the impact of the ocean on humanity and humanity’s impact on the ocean. The centerpiece of the project is a five-part mini-series that premiered on the National Geographic Channel in 2012. In addition to the five episodes, which were also made
DATE:
TEAM MEMBERS:
Knight Williams Inc.Valerie Knight-WilliamsDivan WilliamsRachel TeelEric AndersonGabriel Simmons
resourceevaluationWebsites, Mobile Apps, and Online Media
In 2013, Shedd Aquarium launched a pilot Teacher Badging program with a set of Great Lakes Science Certified badges. Badges include Intro to Badging, Great Lakes Basics, Invasive Species Defined, Environmental Literacy, Science Literacy, and 21st Century Skills, culminating in the achievement of the Great Lakes Science Certified badge. Each badge includes 3-7 missions that teachers must complete to be awarded a given badge. As of December 31, 2013, 262 people have logged into the site, with 499.75 contact hours recorded in 1140 completed missions. The project was partially funded by the USDA
DATE:
TEAM MEMBERS:
John G. Shedd AquariumHeather SchneiderStephanie Bohr
In 2011, the Space Science Institute (SSI) engaged Insight Evaluation Services (IES) to conduct a summative evaluation of an online, multi-user space science game called MyStar. The game, which was developed with funding from the National Aeronautics and Space Administration (NASA), was designed to introduce late middle school-early high school students to the basic concepts of stellar and planetary evolution. IES assessed the effectiveness of MyStar in meeting specific learning goals, including in particular (1) The galaxy has “habitable zones” where planetary formation and/or life is more
The goal of this evaluation was to assess issues of user friendliness, appeal and comprehension related to the Cyberchase website’s homepage, web adventures, weekly polls and games. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS GO! using broadcast, web, new media and educational outreach to impact millions nationwide. Designed for children ages 8 to 11 and packed with mystery, humor, and action, Cyberchase’s mission is to improve kids' problem-solving and math skills, and inspire them with confidence and enthusiasm toward math. The TV series airs daily on PBS
DATE:
TEAM MEMBERS:
Barbara FlaggSandra SheppardCarey BolsterMichael TempletonThirteen/WNET
Goodman Research Group, Inc. (GRG) conducted front-end evaluation and Alpha testing for the Harvard-Smithsonian Center for Astrophysics of EarthScope Panorama, an interactive Earth science game for middle school youth. The front-end evaluation focused on the prospective content, format, and platform of the game, with the broad goal of assessing four different game prototypes in a population of middle school students. The specific objectives of the evaluation were to document and assess what students already know about EarthScope-related themes and content, what geoscience questions they have
DATE:
TEAM MEMBERS:
Marianne E. McPhersonLaura HousemanIrene F GoodmanHarvard-Smithsonian Center for AstrophysicsSmithsonian Astrophysical Observatory
Produced by Twin Cities Public Television, St. Paul, MN, and sponsored by the National Science Foundation, SciGirls (SG) is a multimedia project for upper grade-school and middle-school tweens. Weekly half-hour episodes are tied in with web and outreach activities in the fields of science, technology and engineering. Multimedia Research, an independent evaluation group implemented a summative evaluation of the SG Season Two multimedia project. Fifth grade girls (N = 87) viewed three shows over three weeks. They could visit the SG website at any time but were required to visit and play a Pick'm
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
PlanetMania is an iOS and Android mobile app game produced by Maryland Science Center and Eduweb, Inc. in 2012 to accompany the Center's latest permanent exhibit, entitled Life Beyond Earth. Multimedia Research carried out a summative evaluation of the PlanetMania app, focusing on the app's usage in the exhibit, appeal, value and learning outcomes. The evaluation is a pre-post quasi-experimental study in which a sample of 24 9-11 year olds were interviewed prior to and after experiencing the app and exhibit as well as observed during their exposure to the app and exhibit. The app game combines