RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
In the previous three years, 72 90-second Earth & Sky radio shows have been produced under sponsorship of the National Oceanic and Atmospheric Administration. The impact of these shows was explored with a posttest-only experimental design comparing a treatment group that listened to nine daily NOAA shows focused on the topic of whales and a control group that listened to nine daily non-NOAA shows about Antarctica. Participants were randomly assigned to groups, which did not differ on the variables of gender, age, ethnicity, education, frequency of hearing Earth & Sky, and interest in hearing
Summative evaluation of the Worldviews Network, a NOAA-funded project comprised of institutions trying to create an innovative approach for engaging the public with topics of human induced global change. The project's approach sought to 1) leverage the power of immersive environments within informal science institutions (ISIs), such as planetariums and portable domes, by 2) incorporating visualizations of scientific data sets about relevant social-ecological issues as they relate to "planetary boundaries," framed by 3) a systems-based narrative approach that incorporated cosmic, global, and
The Science Museum of Minnesota prototyped interpretive approaches to using an innovative scientific visualization system developed by the National Oceanic and Atmospheric Administration (NOAA) called Science On a Sphere (SOS). SOS is composed of a wide variety of visualizations projected onto a six-foot sphere creating animated, whole-planet views of the Earth, other planets in our solar system, and their moons. Visualizations of the Earth cover topics such as weather, climate, topography, earth system dynamics, and geophysical processes. A challenge of SOS is making the content accessible
In May of 2006, Science on a Sphere (SOS) was set up in a permanent exhibit space at the Science Museum of Minnesota. With the new installation of the Sphere, came the addition of a variety of features that were not included in the initial front-end study. These new features included an expanded playlist, new audio for some of the visualizations, accompanying labels projected on the wall describing the visualization, indication on the labels of what image will be playing next, and seating for visitors so they can sit and view the sphere. The new master playlist was composed of three smaller
During January 2007, the Science Museum of Minnesota carried out a study to gather visitor feedback on a variety of potential interpretive features of Science on a Sphere. Visitor preferences related to the use of interpretive labels and graphics directly on the Sphere and the speed in which visualizations rotate were studied. A total of 51 visitors were interviewed. Key findings include: 1. Three quarters of visitors preferred descriptive labels to be directly on the Sphere. 2. If labels were projected on the Sphere, almost all the visitors wanted them to disappear after a period of time. 3
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This evaluation report summarizes the extent to which the Aquarium accomplished these goals over the 3-year project period. The five project components and their key associated evaluation findings follow. 1. Classroom-based activities
The Science Museum of Virginia (SMV) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Sphere Corps, a Science on a Sphere program about climate change developed by SMV with funding from the National Oceanic and Atmospheric Administration (NOAA). The study was designed around RK&A's belief that organizations must be intentional in their practice by continually clarifying purpose, aligning practices and resources to achieve purpose, measuring outcomes, and learning from practice to strengthen ongoing planning and actions. To this end, the Sphere Corps project included five phases
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Science Museum of Virginia
The American Museum of Natural History (AMNH) received a NOAA-ELG grant for a three-year project, entitled Exploring Earth Systems: Expanding Data Visualizations Experiences for Museum Learners (or Data Visualizations). The project focuses on the development, testing, and distribution of Visualizations for the Earth and Bio content strands of the AMNH's Science Bulletins program. The Visualizations are short media pieces that use satellite data to tell the story of Earth processes on land, in the oceans, and in the atmosphere, with the larger goals of helping viewers to understand the dynamic
DATE:
TEAM MEMBERS:
Susan FoutzAmerican Museum of Natural History
The American Museum of Natural History (AMNH) received a NOAA-ELG grant for a three-year project, entitled Exploring Earth Systems: Expanding Data Visualizations Experiences for Museum Learners (or Data Visualizations). The project focuses on the development, testing, and distribution of Visualizations for the Earth and Bio content strands of the AMNH's Science Bulletins program. The Visualizations are short media pieces that use satellite data to tell the story of Earth processes on land, in the oceans, and in the atmosphere, with the larger goals of helping viewers to understand the dynamic
DATE:
TEAM MEMBERS:
Susan FoutzAmerican Museum of Natural History
This document outlines front-end and formative evaluation findings including baseline use; improving attraction and holding power and interactions; and improving interfaces. While we found that people like the globe and will stay and interact especially with the redesigned kiosk, there is still room for improvement in support for information transfer and meaning generation, as well as opportunities for retaining user choice and control while adding usability features such as narration.
DATE:
TEAM MEMBERS:
Shawn RoweKatie StoferCéleste BarthelNancee HunterHatfield Marine Science Center
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This formative evaluation report summarizes the extent to which the Aquarium has made progress toward these goals in the first year of the project and provides an information base for identifying opportunities to strengthen