In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This assessment serves as the summative assessment of the IMLS-funded project at KU Biodiversity Institute and Natural History Museum: Natural History Mystery: Immersing families in a problem-solving game using museum collections. The assessment employs a mixed methods approach, in which both quantitative and qualitative data are collected. More specifically, quantitative data are generated from surveys that are administered to participants at the beginning and end of the game and analyzed by using descriptive statistics (i.e., mean, standard deviation, and histogram) and paired sample t-test
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
WCS launched its electronic field trip program, Distance Learning Expeditions, in 2001 when there
was tremendous interest in the educational community in the potential of videoconferencing
technology for program delivery, as well as money available for the purchase of related broadcast
equipment. The program grew rapidly and was successful through 2009 -- serving 9,600 students
in 2006-07, its largest year. From 2010 to 2014, with school budget cuts, high equipment
maintenance costs, and shifts in staffing, participation in the program declined. In 2010, WCS
secured a grant from IMLS for
In support of a summative evaluation of SciGirls Season Three, Multimedia Research developed a scale to assess preteen girls’ interest in nature and science. The work was sponsored by Twin Cities PBS under NSF Grant No. 1323713. Multimedia Research developed, piloted, validated and implemented the GINSS: A nine statement Likert scale constructed to reveal girls’ strength of interest in nature and science activities. Researchers and evaluators are encouraged to use this scale to extend its application. Please email if you eventually use the scale in your research or evaluation: Flagg
This report includes six separate formative evaluations conducted to inform the design and development of the deliverables for the 3D Visualization Tools for Enhancing Awareness, Understanding and Stewardship of Freshwater Ecosystems project. Deliverables were tested with both students and general visitor groups, with a focus on groups including late elementary and middle school children. Many different components were tested, including prototype versions of 3D visualizations, high-tech interactive experiences, apps on tablets and phones, and table top exhibits. Results are reported in each of
A two stage summative evaluation was conducted following the launch of the Mystic Seaport for Educators website, the final output resulting from the IMLS National Leadership grant entitled Mystic E-Port Digital Classroom project. The results of four focus groups, conducted in two phases, found consistent results suggesting that the project was successful at achieving all four goals as outlined in the original grant proposal. Appendix includes focus group protocol.
At the Maryland Science Center, a new permanent exhibition with a companion mobile game is focused on electricity. Multimedia Research, an independent evaluation firm, implemented a summative evaluation to assess how using the PowerUp! game in the exhibition influences engagement and knowledge acquisition. The evaluation collected timing and tracking observations and pre- and post-interview data from 18 ten-year-olds who used the game within the Power Up! exhibition area and 16 ten-year-olds who did not use the game. Game players experienced the Power Up! exhibition area differently from non
DATE:
TEAM MEMBERS:
Maryland Science CenterBarbara FlaggIlona Holland
The goal of this evaluation was to assess issues of user friendliness, appeal and comprehension related to the Cyberchase website’s homepage, web adventures, weekly polls and games. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS GO! using broadcast, web, new media and educational outreach to impact millions nationwide. Designed for children ages 8 to 11 and packed with mystery, humor, and action, Cyberchase’s mission is to improve kids' problem-solving and math skills, and inspire them with confidence and enthusiasm toward math. The TV series airs daily on PBS
DATE:
TEAM MEMBERS:
Barbara FlaggSandra SheppardCarey BolsterMichael TempletonThirteen/WNET
Produced by Twin Cities Public Television, St. Paul, MN, and sponsored by the National Science Foundation, SciGirls (SG) is a multimedia project for upper grade-school and middle-school tweens. Weekly half-hour episodes are tied in with web and outreach activities in the fields of science, technology and engineering. Multimedia Research, an independent evaluation group implemented a summative evaluation of the SG Season Two multimedia project. Fifth grade girls (N = 87) viewed three shows over three weeks. They could visit the SG website at any time but were required to visit and play a Pick'm
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
PlanetMania is an iOS and Android mobile app game produced by Maryland Science Center and Eduweb, Inc. in 2012 to accompany the Center's latest permanent exhibit, entitled Life Beyond Earth. Multimedia Research carried out a summative evaluation of the PlanetMania app, focusing on the app's usage in the exhibit, appeal, value and learning outcomes. The evaluation is a pre-post quasi-experimental study in which a sample of 24 9-11 year olds were interviewed prior to and after experiencing the app and exhibit as well as observed during their exposure to the app and exhibit. The app game combines