From October 2015 to July 2016, Smart Start Evaluation & Research conducted a formative evaluation of a full-length film festival cut of the film The Anthropologist in order to provide feedback that improves decision-making capacity for the film’s final edit, production design, and distribution strategies in line with the project’s goals (see p. 5).
SmartStart conducted focus group interviews with participants to 1) measure their initial impressions of the film and its content, and 2) provide feedback on content, edits, target audience, website, and ideas for distribution. SmartStart then
While interest in citizen science as an avenue for increasing scientific engagement and literacy has been increasing, understanding how to effectively engage underrepresented minorities (URMs) in these projects remains a challenge. Based on the research literature on strategies for engaging URMs in STEM activities and the project team’s extensive experience working with URMs, the project team developed a citizen science model tailored to URMs that included the following elements: 1) science that is relevant to participants’ daily lives, 2) removal of barriers to participation, such as
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
SciGirls' (Season'Three) is a multimedia project that presents videos and games designed to engage and educate millions of children about citizen science. Multimedia Research, an independent evaluation group, implemented a summative evaluation that assessed a model of citizen science engagement and education that examined the contribution of SciGirls multimedia to preteen girls' experience of citizen science.
Throughout the five year SciGirls CONNECT grant the independent evaluation firm Knight Williams assisted Twin Cities PBS (TPT) in a wide range of program evaluation activities. Given the project’s emphasis on a Train-the-Trainer model, the evaluation prioritized two goals: (i) assessing the various levels of CONNECT trainings from different vantage and time points, and (ii) capturing information on the implementation of SciGirls programs led by those who completed a training. This evaluation approach allowed the team to collect ongoing data over the course of the grant and share this
In the previous three years, 144 90-second Earth & Sky radio shows have been produced under sponsorship of the National Aeronautics and Space Administration. The impact of these shows was explored with a posttest-only experimental design comparing a treatment group that listened to nine daily NASA shows focused on the topic of Antarctica and a control group that listened to nine daily non-NASA shows about whales. Participants were randomly assigned to groups, which did not differ on the variables of gender, age, ethnicity, education, frequency of hearing Earth & Sky, and interest in hearing
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the second study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not one listens to
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk radio show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the first study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ future increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not
This document reports on the first phase of a summative evaluation of Science Friday's expansion to examine the importance of research as a theme underlying all science and technology changes. In this phase of the evaluation, in-depth qualitative discussions concerning public understanding of basic research were held with listeners of Science Friday. The study has two goals: (1) To provide feedback to producers as to the series’ current strengths and weaknesses with respect to the above stated goals; and (2) To guide the development of a written questionnaire to be mailed to random public
The Lemelson Center for the Study of Invention and Innovation and the National Museum of American History (NMAH) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of Places of Invention (POI), an exhibition funded by the National Science Foundation. The evaluation was designed to determine the extent to which the exhibition achieved its outcomes: 1)Visitors identify the 21st century skills that inventors practice; 2)Visitors identify characteristics that support innovative communities; 3)Visitors express interest in learning about inventions and/or inventors; 4