Listening to the River (LTTR) is a watershed science education project funded by the National Science Foundation. Its aims are to deliver education experiences in the local area, Traverse City, Michigan, and also to develop a model that could be replicated in other locations. Inverness Research was contracted by the Listening to the River project to conduct both formative and summative evaluations. Our work began in 2005 when the project received a planning grant, and continued through the life of the project. Primarily through interviews and product reviews, along with some direct program
DATE:
TEAM MEMBERS:
Mark St. JohnHeather MitchellDawn RoblesElizabeth HorschLaura StokesLand Information Access Assocation
Radiolab is a public radio series of hour-long interdisciplinary shows, co-hosted by Robert Krulwich and Jad Abumrad, and produced by WNYC. To help guide the future development of shows, this evaluation, sponsored by the National Science Foundation, gathered feedback from listeners via online and mailed questionnaires in response to a season 4 show entitled Choice. The general goals for the evaluation process are: (1) To explore what attributes of the format engage and interest listeners; (2) To examine influences on awareness and comprehension of content; and (3) To assess impact on post
ConCiencia News was the first Spanish-language news service in the United States focused exclusively on health, science and environmental news, providing free of cost news stories to a diverse array of Hispanic media including 100+ newspapers and magazines, top Hispanic web portals, and almost 150 Spanish-language radio stations. Each news story features original content developed by SRF journalists, and Hispanic researchers are often features to serve as role models for the public. The summative evaluation focused on two primary audiences for the Spanish-language stories: 1) the professional
In 2008, Goodman Research Group, Inc. (GRG) conducted summative evaluation of Absolute Zero, a collaborative effort of the University of Oregon's Cryogenic Helium Turbulence Laboratory and Twin Cities Public Television. The films were produced by Meridian/Windfall Productions, Washington DC, and/Windfall Films in London, UK. Outreach was spearheaded by Devillier Communications, Inc. The Absolute Zero project was centered on a two-part documentary about low-temperature physics, which aired on PBS/NOVA in early January 2008, as well as an outreach campaign, which included approximately 20
DATE:
TEAM MEMBERS:
Irene GoodmanUniversity of OregonLaura HousemanMarianne McPherson
GRG conducted summative evaluation of Ganga, a NSF-funded six-segment series of NPR radio programs about the culture and ecology of the river Ganga in India and Bangladesh and its companion Website. Through a web-based survey, GRG assessed the study participants' knowledge gain from and the satisfaction with the series and the Website. The appendix of this report includes the online survey used in the study.
DATE:
TEAM MEMBERS:
Irene GoodmanIndependent Broadcasting Associates, Inc.
The goal of this project is to extend the impact of the nationally broadcast weekly radio program, Science Friday to a new, young audience through the various new cyber-space platforms and interactive tools such as Facebook, Twitter, and Second Life as well as new emerging social networking tools. The STEM content over the course of the two year project will include a wide variety of topics in all disciplines. The relationship between art and science will also be a focus. The NPR radio broadcasts currently reach 1.3 million listeners every week, and that audience is expected to increase. In addition to that audience, this project will target a new audience of adults under the age of 35 using various cyber platforms and new social networking tools such as Second Life, Facebook, YouTube and Twitter. Audiences will also be reached through remote broadcasts from science centers and art centers around the country. Over 30 science centers will use this project's web content on their own web sites, reaching their audiences as well. The web content will be translated into Spanish and widely disseminated to Hispanic audiences. Each Friday afternoon, Ira Flatow, the PI will produce and host the nationally broadcast Science Friday radio program interviewing scientists and engineers in a lively engaging format. In addition, the Science Friday digital media team will be producing and inviting others to create and post digital content and commentary on the Science Friday web site for further dissemination through Second Life, Facebook, as well as other emerging networking platforms. The evaluation will use a quasi-experimental design to study the appeal of both the radio broadcasts and the cyber-platforms with both older and younger audiences. Proposed audience impacts include increased STEM knowledge, interest, and behaviors. Partner organizations include the Self Reliance Foundation, the New York Hall of Science, LA Theatreworks, and Tribeca Film Festival.
In the Spring of 2003, Rockman et al conducted an evaluation that was designed to explore children's viewing behavior, outcomes of viewing, the impact of the program's structural features, viewers' content preferences, and factors that motivate greater participation by viewers. Nearly six hundred children and twenty-five adults in three major U.S. cities participated in this study. Evaluation activities included: Five sets of student surveys: one administered prior to viewing episodes of DragonflyTV, one following each of the three programs viewed as part of the evaluation, and one
DATE:
TEAM MEMBERS:
Rockman, et. al.Twin Cities Public TelevisionJennifer Borland
The Adult Literacy Media Alliance (ALMA), producer of TV411 and the NSF-funded Think Math, will undertake a planning process for the development of a ten part series, TV411 Cook Smart, which will incorporate lessons in math, biochemical and physical processes into a cooking show format. The television series is geared towards low-literate adults and builds on ALMA's prior experience in producing science/math-based programming. The deliverables include a standards-based curriculum outline for the series; outreach and training plans with the project's broadcast partner, Kentucky Educational Television; development of strategic partnerships with community organizations, including Head Start programs and Neighborhood Networks National Consortium; and evaluation strategies to study the impact of the TV411 Cook Smart on adult learners.
The Coalition for Watershed Education, consisting of the Land Access Information Association, Great Lakes Children's Museum, Interlochen Public Radio and Northwestern Michigan College Great Lakes Studies Institute will implement a comprehensive science education project for youth and adults. The major components include: Watershed Discovery field experiences, Soundscapes radio broadcasts, Waterscapes exhibits, a project website, and the expanded Great Lakes Coalition for Watershed Education. Watershed Discovery is a field-based experience for youth ages 11-17. Teams of 6-10 youth will work with mentors who specialize in GPS, GIS, geology and geography to research and collect data on the Great Lakes watershed. These students will also use their new knowledge to produce radio segments as part of the Soundscapes component. Youth teams will be trained to interview sources, gather information and write scripts for use on the local National Public Radio affiliate. The Great Lakes Children's Museum will design a permanent, interactive watershed of 1,500 square feet, as well as a traveling exhibit of 500 square feet for visitors ages 7-12. Other deliverables include "A Community Guide to Watershed-based Science Education" (available in print and CD-ROM), a one-day regional dissemination conference, and an interactive website. Strategic impact will be realized through the development of a novel model for watershed education, its subsequent replication and summative evaluation outcomes. It is estimated that over 40,000 children will be reached by this community-wide initiative.
Glaciers: A Chronology of Climate Change is a CRPA project that seeks to explain the historical cycling of glaciers in the context of climate change. By using chemical isotopes (Beryllium 10), the age of rocks that have been covered with glacier ice and exposed to sunlight later can be determined fairly accurately. Through this method, the glaciation cycles have been determined for the last 70,000 years. In collaboration between the Lamont-Doherty Earth Observatory at Columbia University and the American Museum of Natural History (AMNH), this project is designed to impact adult audiences, youth in grades 6th-12th, and teachers writ large. The research results shall be expressed via an eight-minute high definition film for large screen viewing in the \"Science Bulletins\" section of the AMNH and the affiliated museums. A rigorous front-end evaluation will be used to inform the presentation and assess audience impact. Subsequent formative evaluations are designed to measure the learning impact of the film and the retention of longer term concepts. It is anticipated that more than 700,000 individuals will have access to current, scientifically accurate data and related information on glaciation cycles and climate change through the educational film and website. Materials will be easily accessible to teachers and the film will be closed captioned in both English and Spanish.
DATE:
-
TEAM MEMBERS:
Joerg SchaeferGeorge DentonMichael Kaplan
The PBS NewsHour STEM Learning project is a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience. The multi-platform project goals are to: (1) increase and improve the knowledge of the audience with respect to science and technology; (2) stimulate the active engagement of the audience with science and technology through interactive tools; and (3)position the PBS NewsHour as a regular destination for in-depth and innovative science reporting; (4) deploy new and creative digital tools to extend the impact of NewsHour science reporting, especially for youth. The PBS NewsHour is produced by MacNeil/Lehrer Productions and distributed by PBS to PBS television and radio stations across the country, five nights per week. This project is informed by an expert advisory board and other consultants. Project evaluation will be conducted by City Square Associates. The formative evaluation in year one will employ focus groups of adults from the general audience and teens as well as a quantitative survey online to determine a benchmark of current science knowledge, attitudes and behaviors. The evaluation in year two will test digital components of the project in a usability lab setting to gather information to help improve the quality and effectiveness of these deliverables. The summative evaluation will administer a tracking study with the same population surveyed in the first year. Deliverables include: a minimum of 26 science documentary reports broadcast per year plus additional in-studio interviews and coverage of breaking science news; a revamped website, notably "Science and Tech To Go"; a weekly STEM interview or report online featuring Hari Sreenivasan or other reporters; additional weekly digital STEM reporting; and an expanded and redesigned outreach program for teens and educators including an innovative, cloud-based student editing and content-sharing initiative in collaboration with several science centers. Six new PBS NewsHour Student Reporting Labs, established in high-need urban schools, will shoot, edit, and post their videos on the web. The PBS NewsHour science reports will be broadcast and featured on the NewsHour iPhone app, as well as disseminated on the NewsHour's YouTube Channel, Disqus and UStream, Hulu.com, with new science material updated daily on the web. The NewsHour is seen by more than 7 million viewers each week, with additional audiences being reached by radio, the Online NewsHour website, podcasts, and other social media. New community-based programs expand the audience farther. The final summative report will outline the impact of the project and identify the strategies and tactic found to be most effective in making use of digital media to support project goals.
The objective of this youth media project is to provide 14-24 year olds with training and hands-on experience in engineering, and the physical and biological sciences. The project is designed around core practices that engage youth in original research and inquiry through experimentation, development, and creative use of new technologies and tools to communicate STEM to the public. Youth Radio project participants in Oakland, CA, Atlanta, GA and Washington, DC include 540 youth, 80% of whom are low-income and/or youth of color, plus another 400 youth via off-site outreach in schools and community centers. Core deliverables include: (1) "Brains and Beakers," eight live events per year where a visiting STEM researcher brings his/her work out of the lab and onto the stage at Youth Radio facilities, demonstrating key principles and discoveries and interacting with youth participants; (2) "Youth Radio Investigates," an annual 6-part multimedia series, where youth partner with university and industry-based researchers to explore the veracity of scientific claims applied to products and services and they use every day; (3) The "Application Development Lab," where youth develop, create and disseminate online embeddable and downloadable applications (12 annually) that serve real needs in youth communities. The digital media produced by the youth will be broadcast by National Public Radio and distributed online through various sites including iTunes and BoingBoing.net, one of the most frequently visited technology-focused sites on the web. Project advisors include STEM researchers in universities as well as highly experienced and successful new media technology developers. Project partners include National Public Radio, KQED, the California Academy of Sciences, and the Oakland Unified School District. This project builds on the successful prior work (NSF #0610272) that initiated a Science and Technology program within the Youth Radio organization. The summative evaluation by Rockman et al will measure how the program affects students' science and technology knowledge, skills, and attitudes. It will build on the evaluation from the prior NSF funded project (#0610272) that highlighted the organizational and staff growth processes as Youth Radio discovered how to design and implement successful, sustainable STEM programs. Rockman will evaluate the new programs (Youth Investigates, Brains and Beakers, and the Application Lab), measuring the following STEM-related student outcomes/impacts: perceptions of selves as producers/creators of science or technology; attitudes toward science and perceptions of scientists; understanding the process of scientific inquiry and research and/or technology skills development; and understanding or interest in careers in science or technology (based on National Research Council report, 2009). Data will be collected from the youth at the Oakland site and from the other Youth Radio bureaus to determine which aspects of the program transfer to multiple sites and which ones are unique to a specific location or set of circumstances. Methods include surveys of student attitudes, participant focus groups, interim assessments, objective skills assessments, and interviews. This project provides an innovative new model for collaborations between STEM researchers and under-represented youth resulting in digital media that impacts the youth as well as the public's understanding and engagement in science.