RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
‘6 Degrees of Connection’ is an informative and memorable program that combines a one-hour Science On a Sphere® interactive presentation with a follow-up creative art activity – each aspect of which encourages middle school students to think of interconnections among phenomena on the planet, including the natural world and human activity.
The ‘6 Degrees of Connection’ program was developed by the Nurture Nature Center (Easton PA) in collaboration with the Maryland Science Center (Baltimore MD) through an extensive process of developing the concept, prototypes, and final program. Lehigh
The Anthropologist is a film by Ironbound Films, Inc. that focuses on the impact of climate change on indigenous cultures around the world, through the lens of anthropologist Susie Crate and her daughter Katie. The goals of the film are to (1) Increase viewers’ knowledge of how climate change affects communities and cultures and help viewers understand how scientists are responding to these changes; (2) Inform viewers’ attitudes towards climate change and how it will affect communities around the world; (3) Motivate viewers to become actively involved in assisting people adversely affected by
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
From October 2015 to July 2016, Smart Start Evaluation & Research conducted a formative evaluation of a full-length film festival cut of the film The Anthropologist in order to provide feedback that improves decision-making capacity for the film’s final edit, production design, and distribution strategies in line with the project’s goals (see p. 5).
SmartStart conducted focus group interviews with participants to 1) measure their initial impressions of the film and its content, and 2) provide feedback on content, edits, target audience, website, and ideas for distribution. SmartStart then
The Anthropologist examines climate change like no other film before. The fate of the planet is considered from the perspective of American teenager Katie Crate. Over the course of five years, she travels alongside her mother Susie, an anthropologist studying the impact of climate change on indigenous communities. Their journey parallels that of renowned anthropologist Margaret Mead, who for decades sought to understand how global change affects remote cultures.
From January 2012 to May 2012, SmartStart Educational Consulting Services conducted a front-end evaluation of the documentary
In its program, “Maximizing Lifelong Learning Opportunities: Innovative Strategies for Science Museums,” the American Museum of Natural History sought to develop, implement and assess a series of online and face-to-face adult learning courses, that shared the name “Our Earth’s Future” and focused on the topic of climate change. An external evaluation of this effort was conducted by Rockman et al, an independent evaluation firm that specializes in the evaluation of informal science learning programs. This research effort builds on prior knowledge gained from studies of adult learning programs
DATE:
TEAM MEMBERS:
Jennifer BorlandRuth CohenDebra TillingerMaria Janelli
Ciencia Pública is a National Science Foundation (NSF) -funded initiative in which the Exploratorium, in collaboration with the Boys and Girls Club of San Francisco (BGCSF), developed a parklet to engage Latino families in STEM content. The Parklet is located in San Francisco’s Mission District (the Mission), a historically Latino neighborhood. Buena Vista Horace Mann School (BVHM) is an additional project partner and hosts the Parklet on its site. Garibay Group conducted a summative evaluation of the project outcomes. This report discusses evaluation findings.
From 2013-2016, Pacific Science Center, implemented the Exploring Earth Systems Sciences (EESS) project with the purpose of developing and delivering scripted demonstrations utilizing the Science On a Sphere (SOS) technology in order to promote understanding of and increase interest in Earth systems sciences. Specifically, the grant allowed the Science Interpretation team to research and write 20-minute presentations, targeted towards visitors aged 11 and older, about nine unique topics such as: climate change, weather, seasons, or the Polar Regions. Staff were then provided training in
Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
In the previous three years, 144 90-second Earth & Sky radio shows have been produced under sponsorship of the National Aeronautics and Space Administration. The impact of these shows was explored with a posttest-only experimental design comparing a treatment group that listened to nine daily NASA shows focused on the topic of Antarctica and a control group that listened to nine daily non-NASA shows about whales. Participants were randomly assigned to groups, which did not differ on the variables of gender, age, ethnicity, education, frequency of hearing Earth & Sky, and interest in hearing
The purpose of the summative evaluation is to two-fold: 1) provide documentation to NSF about the extent to which the project met its goals and objectives, and 2) give the Lab of Ornithology information about how well the Web application and the ecosystem within which it resides is engaging the intended audiences. The main evaluation questions the study needed to answer related to who is participating in YardMap, how much participation affects participants’ knowledge, attitudes and behaviors around birding, gardening, and citizen science.
A true experimental design was used, where