The National Science Foundation funded Roadside Heritage (RH) to produce three major deliverables during this project: (1) STEM-rich audio stories for the traveling public that highlight the science associated with Highway 395; (2) Traveling festival kits that highlight major STEM features of the Eastern Sierra landscape; and (3) The RH website, a STEM-rich site highlighting the natural and cultural landscape associate with Highway 395. During the project’s final year, WestEd conducted summative evaluation activities targeting each of these deliverables. Appendix contains survey.
DATE:
TEAM MEMBERS:
Jerome HippsSharon HerpinDonna Winston
Goodman Research Group, Inc. (GRG) is serving as the external evaluator of the three-year, NSF-funded Science Festival Alliance (SFA) project with this report summarizing results from the first year of the project. First year data collection was completed in June 2010. It included: Surveys of 1,411 San Diego Science Festival (SDSF) and 1,054 Cambridge Science Festival (CSF) attendees; End-of-year focus groups with each of the festival (SDSF and CSF) team leaders; and An online survey of 11 principal Alliance team members. The report is organized around four key questions: 1. Who participated
The Nurture Nature Foundation’s Flood Forum project, funded by a two-year National Science Foundation (NSF) planning grant effective August 1, 2009, explored innovative means to promote science learning by and for local communities. The NSF planning grant allowed Nurture Nature Foundation (NNF) to develop a model of outreach for science centers that engages rural and underserved audiences in public dialogue on the science underlying an issue of high public concern—frequent flooding in Pennsylvania’s Lehigh Valley. Building on a public forum model used by other science centers such as the
DATE:
TEAM MEMBERS:
Alice ApleyNurture Nature Foundation
The Nexus of Energy, Water, and Climate: From Understanding to Action (Café +) project will develop and test two interactive board game concepts focused on energy, water, and climate with youth and adults from four highly diverse communities in New Mexico. The four primary goals of the project are to: (a) develop, play test, and implement two board, card, or other non-electronic games grounded in energy, water, and climate content at four project sites, (b) identify the key characteristics of the games that maximize problem solving while stimulating interest, engagement, and learning, (c) explore the implications of game playing on dialog, learning, and Café+ satisfaction for youth and adult participants, and (d) evaluate the viability of this model for full scale implementation throughout the existing Café Scientifique program, from which this project is based. Los Alamos National Laboratory, Sandia National Laboratory, PNM Resources, Scott Balaban Games Design, the Los Alamos County Utilities Department, and a host of advisors and consultants from a broad range of organizations and institutions will collaborate to develop, test, and implement the Café+ games model. The primary deliverables include: (a) two non-electronic multiage commercial quality games focused on energy, water, and climate content, (b) a comprehensive pilot study examining the impact, effectiveness, and viability of the Café+ model with the target audiences, and (c) formative and summative evaluations of the games implementation model. A significant outcome of Café+ is that New Mexico youth and adults, from diverse backgrounds, will learn relevant science content through the development and testing of engaging, innovative commercial quality games. Over 250 youth and adults will benefit directly from their participation in the pilot study. They will not only learn important science content while working collaboratively in groups (youth only and youth/adult groups), but they will also participate in an authentic scientific process experience as playtesters. In this role, youth and adults will experience critical science concepts such as trial and error and refinement. Further, the games will be made publicly available and implemented across the entire Café Scientifique program (n=960 youth). The evaluation study will employ a mixed methods approach to examine project implementation, effectiveness, and impacts. Focus groups, observations, and surveys will be employed to assess a number of variables such as (but not limited to): content knowledge and learning, interest, engagement, game features, game play processes, gaming obstacles and challenges, participant interactions, and motivation. Embedded assessment opportunities will also examine participants\' decision making abilities, analytical skills, and ability to transfer knowledge gained to real world situations as they navigate through the games. Data collected at the youth-only pilot test sites will be used in a comparative analysis of similar variables tracked at the youth and adult sites. Formative approaches will provide iterative, ongoing opportunities for programmatic and game refinement and adjustments. The formative and summative evaluations will endeavor to document critical data and findings needed to assess the viability of Café+ as a full scale development project, with additional games and project sites across the country. The Café+ project would add to the limited literature base on learning and science engagement of youth within Science Café settings in the 21st century. More critically, this pilot study could contribute to the dearth of current research on the impact of non-electronic game play can have on youth only groups and youth/adult groups working collaboratively to make important scientific decisions within Science Café settings. This comparative data could prove significant for other program models interested in implementing similar youth and adult game based program. Further, the relevance of the content could potentially spark youths' interest not only in pursuing courses and careers in STEM, but it could also motivate youth and adult participants to become more involved in civic engagement activities occurring within and beyond their local communities.
WGBH is producing the fifth and sixth seasons of NOVA scienceNOW, a multimedia project that addresses a wide array of science, technology, engineering, and mathematics subjects via multiple platforms. They include national PBS broadcast, the PBS web site, and innovative outreach activities such as an expanded Science Café initiative. Hosted by astrophysicist Dr. Neil deGrasse Tyson, Season Five will air in 2010; Season Six in 2011. The focus is "stories of transformative research," e.g., nanotechnology, stem cells, quantum computing, as well as clean energy, and climate change. Project goals are to "produce a lasting impact on Americans' appreciation for and understanding of current scientific research," and to encourage an interest in STEM careers among younger viewers. Building upon solid prior work, the proposed project is finding new ways to interweave the television show, web materials, and Science Cafés to provide multiple entry points and pathways for the audience. For example, they will produce 32 web-only scientist profiles supported by a blog and social media tools, and then train these scientists as presenters for the Science Cafés. NOVA is planning a new strategy to maximize carriage and increase audience for the six new programs per year; the programs will run consecutively in the NOVA Wednesday evening primetime slot during the summer. During Season Three, over 2.7 million television viewers per week tuned in NOVA scienceNow, with 62,000 unique visitors to the web site per month and 75 active Science Cafés across the country. The expanded Science Café initiative is designed to become self-sustaining beyond the grant period through new partnerships with groups such as the Astronomical Society of the Pacific, the American Chemical Society, and the Coalition for the Public Understanding of Science. The project will also collaborate with the Association of Science-Technology Centers and science centers around the country to host Science Cafés featuring scientists profiled on the web. Goodman Research Group will assess the reach and effectiveness of Seasons Five and Six. The focal/primary evaluation activity is a viewing and engagement study on the influence of viewing the series along with accessing and participating actively with the increased web and outreach offerings. This study will comprise web-based surveys with adaptive branching patterns, which will include data collection from a variety of participants and will focus on participants? use of the series, website, and outreach. The summative evaluation will measure how the project is reaching these audience segments, while also meeting the overall goals of increasing public understanding of science and engagement in science-related activities.