This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
The purpose of the Science Center Public Forums project was to engage citizens with NOAA data about climate-related hazards, resilience strategies, and related policies. Forum modules about four climate-related hazards were created, and used as a part of forum programs at eight museums around the US. Evaluation findings are structured around three themes: 1) learning, 2) interest, engagement, and attitudes, and 3) educator outcomes. Data showed high levels of prior knowledge about environmental hazards and interactions between human and natural systems; resilience efforts; and the ways science
A mixed-methods series of surveys were used to explore public literacy related to environmental science and sustainability in Indianapolis. Surveys also explored predictive variables including environmental identity, nature affinity, use of nature places as learning opportunities, and motivations for visiting nature spaces. An online, citywide consumer survey was distributed alongside a parallel identical survey of employees at a major science-based corporation to assess variation in knowledge, attitudes, and learning behaviors. This science-based corporation provides substantial support to
DATE:
TEAM MEMBERS:
John FraserSu-Jen RobertsNezam Ardalan
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a program developed to immerse adult learners in the processes of scientific research by teaching participants to locate and report orphan and abandoned natural gas wells.
Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
With support from the National Science Foundation, MacGillivray Freeman Films has produced an IMAX® film titled, Journey into Amazing Caves. The 40-minute film follows two women cavers on an expedition as they explore limestone caverns of the Grand Can-yon, underwater caves of the Yucatan and ice caves of Greenland. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent and in what ways did the film appeal to viewers? To what extent did the film achieve its intended viewing goals? What did viewers perceive that they learned from the
With funding from the National Science Foundation, MacGillivray Freeman Films has produced an IMAX® film titled, Journey into Amazing Caves. The 40-minute film follows two women cavers on an expedition as they explore limestone caverns of the Grand Canyon, underwater caves of the Yucatan and ice caves of Greenland. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent and in what ways did the film appeal to eighth grade viewers? To what extent did the film achieve its intended viewing goals? Did exposure to a web-based school activity
With major funding from the National Science Foundation, the Museum Film Network and NOVA/WGBH in conjunction with MacGillivray Freeman Films have produced an IMAX/ OMNIMAX film called Stormchasers. Stormchasers follows scientists as they investigate the dramatic weather effects of monsoons, hurricanes, and tornadoes. A quasi-experimental separate-sample pretest/posttest design was used to evaluate the film in its natural theater setting, focusing on the following major outcomes with adult audiences:
• To what extent did the program appeal to adult viewers? • To what extent did the
In the previous three years, 144 90-second Earth & Sky radio shows have been produced under sponsorship of the National Aeronautics and Space Administration. The impact of these shows was explored with a posttest-only experimental design comparing a treatment group that listened to nine daily NASA shows focused on the topic of Antarctica and a control group that listened to nine daily non-NASA shows about whales. Participants were randomly assigned to groups, which did not differ on the variables of gender, age, ethnicity, education, frequency of hearing Earth & Sky, and interest in hearing
This article summarizes summative evaluation of the impact on public radio listeners of Earth & Sky, a short-format science radio program airing daily on more than 1,000 commerical and public radio stations in the U.S. as well as on satellite and Internet radio outlets. Earth & Sky’s goals are to make science accessible and interesting and to increase science literacy by providing daily doses of science to listeners with a range of science backgrounds, knowledge and interest. Subsequent to listening to Earth & Sky, the producers hope listeners may be motivated to turn to other sources of