From October 2015 to July 2016, Smart Start Evaluation & Research conducted a formative evaluation of a full-length film festival cut of the film The Anthropologist in order to provide feedback that improves decision-making capacity for the film’s final edit, production design, and distribution strategies in line with the project’s goals (see p. 5).
SmartStart conducted focus group interviews with participants to 1) measure their initial impressions of the film and its content, and 2) provide feedback on content, edits, target audience, website, and ideas for distribution. SmartStart then
Frontier Scientists is comprised of a website and portfolio of videos created for distribution web-wide and through television broadcast. The goal of this program is to excite the general public about ongoing science in Alaska and the Arctic. This is the summary evaluation of a three-year National Science Foundation grant received by Frontier Scientists. Frontier Scientists contracted PEER Associates to conduct the evaluation. Over the course of the three years, the evaluation was focused on both formative (intended to inform and improve programming) and summative (what has the program
SciGirls' (Season'Three) is a multimedia project that presents videos and games designed to engage and educate millions of children about citizen science. Multimedia Research, an independent evaluation group, implemented a summative evaluation that assessed a model of citizen science engagement and education that examined the contribution of SciGirls multimedia to preteen girls' experience of citizen science.
Throughout the five year SciGirls CONNECT grant the independent evaluation firm Knight Williams assisted Twin Cities PBS (TPT) in a wide range of program evaluation activities. Given the project’s emphasis on a Train-the-Trainer model, the evaluation prioritized two goals: (i) assessing the various levels of CONNECT trainings from different vantage and time points, and (ii) capturing information on the implementation of SciGirls programs led by those who completed a training. This evaluation approach allowed the team to collect ongoing data over the course of the grant and share this
In the previous three years, 144 90-second Earth & Sky radio shows have been produced under sponsorship of the National Aeronautics and Space Administration. The impact of these shows was explored with a posttest-only experimental design comparing a treatment group that listened to nine daily NASA shows focused on the topic of Antarctica and a control group that listened to nine daily non-NASA shows about whales. Participants were randomly assigned to groups, which did not differ on the variables of gender, age, ethnicity, education, frequency of hearing Earth & Sky, and interest in hearing
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the second study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not one listens to
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk radio show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the first study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ future increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not
This document reports on the first phase of a summative evaluation of Science Friday's expansion to examine the importance of research as a theme underlying all science and technology changes. In this phase of the evaluation, in-depth qualitative discussions concerning public understanding of basic research were held with listeners of Science Friday. The study has two goals: (1) To provide feedback to producers as to the series’ current strengths and weaknesses with respect to the above stated goals; and (2) To guide the development of a written questionnaire to be mailed to random public
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the external evaluation for Youth Radio's DO IT! program, which was funded by the National Science Foundation. Building upon Youth Radio's previous Science and Technology Program, the DO IT! initiative consisted of three primary components that promoted STEM (science, technology, engineering, and mathematics) learning by training underserved youth in cutting-edge digital technologies: (1) Brains and Beakers: Young people hosted a line-up of investigators and inventors for demo-dialogues at Youth Radio's studios
DATE:
TEAM MEMBERS:
Rockman et al | Youth RadioKristin BassJulia Hazer
Rockman et al evaluated BURN: An Energy Journal, an NSF-funded radio series about the energy issues that impact our communities. Evaluation activities consisted of formative and summative focus groups, web usability studies, interviews with listeners, and surveys.
Goodman Research Group, Inc. (GRG) conducted front-end evaluation of New Earth Explorers, a four-part science documentary series developed by Earth Images Foundation. The project's goal was to create a series that would target prime time PBS viewers with an aim to present information about earth science and relevant current research in a way that is engaging for viewers. In addition to the series, the project intended to develop related outreach with the intent of increasing STEM learning and promoting an understanding and appreciation of the earth sciences as an interesting field and
Goodman Research Group, Inc. (GRG) conducted a summative evaluation of the second season of NOVA scienceNOW, the PBS series that explores cutting-edge scientific and technological innovation in real time. (GRG also served as the external evaluator for NOVA scienceNOW during Season One). In addition to the television series, WGBH-TV developed a companion website, a series of high school classroom activities, and a Science Cafe outreach initiative, designed to discuss, in non-academic environments, the latest developments in science. The Season Two evaluation included: 1) a viewer study