In support of a summative evaluation of SciGirls Season Three, Multimedia Research developed a scale to assess preteen girls’ interest in nature and science. The work was sponsored by Twin Cities PBS under NSF Grant No. 1323713. Multimedia Research developed, piloted, validated and implemented the GINSS: A nine statement Likert scale constructed to reveal girls’ strength of interest in nature and science activities. Researchers and evaluators are encouraged to use this scale to extend its application. Please email if you eventually use the scale in your research or evaluation: Flagg
Sea Studios Foundation will extend the Strange Days on Planet Earth multimedia initiative to raise public science literacy on pressing environmental issues. Based on pioneering Earth System Science research, Phase Two will be a media and outreach project focused on the ocean and water issues. The goal of the project is to increase public awareness and understanding of the scope and scale of key issues affecting the ocean. At the core of the project is a four part television documentary series for PBS primetime entitled Strange Days, Ocean. The programs will concentrate on four content areas: overexploitation of ocean resources, pollution, coastal development, climate change and the role of the ocean in Earth's system. Each episode is structured around a compelling scientific questions designed to engage the audience in a search for answers based on the most current research from the varied Earth System Science disciplines. The series focuses on explaining how scientists come to know what they know. The series will be complemented by activity-based learning supported by a national consortium of informal learning institutions, a citizen science program, training sessions for informal educators, and a project website. Collaborators include the National Geographic and three new major partners: Monterey Bay National Marine Sanctuary Program to expand citizen science programs around invasive species; Americans for Informed Democracy (AID), dedicated to organizing college campus educational events; The Ocean Project (TOP), a network of 600 organizations; plus the Arizona Sonora Desert Museum and eight other informal science institutions. Knight Williams Research Communications, and Public Knowledge and Cultural Logic will assess the impact of the series. The project will contribute to the field of informal science education by providing widely applicable communication lessons on ocean and water issues and a model methodology for creating science education media that is credible, informative, and relevant. The results of two unique adult learning case studies will be shared with the field through presentations at national meetings and workshops, and posted online.
DATE:
-
TEAM MEMBERS:
Mark ShelleyDavid EliscoTierney Thys
In Defense of Food (IDOF) is a media and outreach project based on Michael Pollan's best-selling book of the same title. Through the lens of food science, IDOF is designed to engage diverse audiences in learning about: (1) how science research is conducted, (2) how research findings are used in media, marketing, and public policy, and (3) how to apply food science research in everyday life. IDOF will be created by Kikim Media, an independent production company, broadcast and distributed by PBS and supported by an extensive outreach campaign and interactive website. The project's educational materials will be developed, in part, by the Teacher's College at Columbia University's Center for Food and Nutrition, with dissemination supported by the Coalition for Science After School and by Tufts University's Healthy Kids Out of School initiative, which involves nine of the leading out of school time (OST) organizations, such as Girl Scouts USA, and the National Urban League. The project advisory committee includes highly respected researchers in food, nutrition, and health. IDOF will use an integrated strategy of learning resources, combining a television documentary with online/social media, community outreach, and youth activities. Knight Williams Research Communications will conduct formative and summative evaluation of all major components of the project. The results will advance the informal science community's understanding of how the combination of a documentary with outreach, website/social media, and afterschool activities impacts motivation and learning. The evaluation study will pay special attention to the degree to which participation in the community events, social media/website, and afterschool activities motivates deeper or extended engagement with the subject. Project evaluation results and educational resources will be widely disseminated to the informal science community. IDOF includes a two-hour documentary film that will be produced in both English and Spanish; a community-level outreach campaign focused on reaching underserved audiences who may not watch public television; a set of activities for use in afterschool programs, youth programs and schools; and an interactive and content-rich website with tightly integrated social media tools. IDOF will be nationally broadcast by PBS; the Spanish-language version of IDOF will be broadcast by Vme Television. The ambitious IDOF educational materials and outreach campaign, combined with interactive web and social media, will reach large and diverse audiences. The intended impacts on audiences include increased knowledge and understanding of the scientific process by learning what food scientists do, what techniques they use, and how scientists arrive at their conclusions; the development of critical thinking skills audiences can use when evaluating messages about food and nutrition in media and advertising and when making decisions about what food to buy and eat; and becoming active learners and consumers regarding food. Evaluation results will be widely disseminated to science media producers and the informal science community via professional publications and presentations at conferences. The ultimate value of the In Defense of Food documentary and learning initiative will be to enhance public understanding of the crucial importance of science in people's everyday lives and in shaping dozens of daily decisions.
The purpose of the ETOM project is to develop a "user's guide" to the present and projected energy resources of our planet and the relationship to climate change. It will prototype and evaluate new ways of providing the public with the information and online tools to make wiser choices about powering homes, schools, businesses, and communities. The project uses a hybrid model of science communication that includes video, in-person presentations, and Web 2.0 social networking. National PBS broadcasts of three hour long programs, with two new specials premiering on Earth Day 2012, will reach large audiences influencing the understanding of climate change and the potential of renewable energy in measurable ways. Events at four science centers and natural history museums located across the country will explore how increased knowledge of Earth Science through in-person presentations informs behavior. The project's social networking tools and resources will motivate and support accessible real-world activities. An online "Energy Gauge" will allows users to find rebates, explore driving and diet, and make choices that can save money and reduce carbon emissions. The core project team includes Richard Alley, chair of the National Academy of Sciences panel on Abrupt Climate Change, who will host the television programs. Outreach partners include science centers across the nation and the Society for the Advancement of Chicanos and Native Americans in Science. The project will leverage existing NSF-supported projects such as the Future Earth Initiative led by the Science Museum of Minnesota. Rockman Et Al will evaluate the project impacts working from front-end to summative stages to understand the reactions of media, online, and on-site users. Proposed project impacts include increasing participants' understanding of how the Earth's system is affected by human uses of energy and the impact of those energy uses on climate. Other impacts include changes in attitude and behavior affecting individual uses of energy. Evaluations will be conducted with TV show viewers as well as science center and website visitors using quasi-experimental, quantitative, and qualitative study designs.
Soundprint Media Center, Inc. and RLPaul Productions, produced a cross-media package that includes a website (capecosmos.org), radio programs, and museum-based family events related to the 50th anniversary of the Space Program. The project, Out of This World (OOTW), is a program that sought to stimulate interest in science by presenting the little known stories of African-Americans and women who contributed to the U.S. Space program, and to provide historical context for the scope and reach of the nascent aerospace science program. Through radio documentaries and collaborations with science centers and museums, including the Smithsonian's National Air and Space Museum (NASM), OOTW broke new ground in developing an integrated media project that reached different audiences. The deliverables included: three radio documentaries (; an educational DVD package with 20 video mini-documentaries, curator interviews with space research pioneers and a learning guide; an interactive website that recreates a space mission circa 1961, and a series of live two-way video conferences between NASM and some 14 partner museums and science centers. OOTW used the power of investigative journalism and the reach of public radio and local science museums to connect with adults and school-age children, to cut across demographic categories, and to include a significant number of minority and at-risk children.
The Science Museum of Minnesota, in collaboration with six NSF-funded Science and Technology Centers (STCs) around the country, is developing several deliverables around the theme of the Anthropocene; that is, the idea that Earth has entered a new geologic epoch in which humanity is the dominant agent of global change. Deliverables include: (1) a 3,500 square-foot exhibit with object theater at the museum; (2) an Earth Buzz Web site that focuses on global change topics equivalent in design intent to the museum's popular current science Science Buzz website; (3) kiosks with Earth Buzz experiences installed in selected public venues; (4) Public programs with decision makers and opinion leaders on the implications of a human-dominated planet; and (5) youth programs and activities that engage them with the exhibit, web site, and careers in STEM. The exhibits and Web site will feature scientific visualizations and computational models adapted to public learning environments from research work being conducted by STCs and other academic research partners. First-person narrative videos of scientists and their research produced by Twin Cities Public Television now are on display in the Future Earth exhibit and also have been packaged into a half-hour program for broadcast statewide. The intended strategic impact on the field of informal STEM education is twofold: (1) explore how to accelerate the dissemination of scientific research to public audiences; (2) investigate ways science centers/museums can serve as forums for public policy dialogues.
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the external evaluation for Youth Radio's DO IT! program, which was funded by the National Science Foundation. Building upon Youth Radio's previous Science and Technology Program, the DO IT! initiative consisted of three primary components that promoted STEM (science, technology, engineering, and mathematics) learning by training underserved youth in cutting-edge digital technologies: (1) Brains and Beakers: Young people hosted a line-up of investigators and inventors for demo-dialogues at Youth Radio's studios
DATE:
TEAM MEMBERS:
Rockman et al | Youth RadioKristin BassJulia Hazer
This Science Learning+ project will develop a Youth Access & Equity Research & Practice Agenda, focusing on addressing equity issues for youth, ages 11-14, primarily from non-dominant backgrounds. The project will involve researchers and practitioners from three ISL settings/contexts, (1) Designed spaces, e.g., museums; (2) Community-based, e.g., afterschool clubs; and (3) Everyday science, e.g., science media. The goal of the agenda will be to advance scholarly understanding of equity issues in relation to these three contexts. Taking an ecological view of STEM learning as a sociocultural process of participation and transformation, the project will employ a Complex Adaptive System lens to document multiple pathways youth take (or not) within/across ISL settings over time, the impact these pathways have on learning and development, and their influence on ISL organizations themselves. These lenses will help us identify aspects of learning environments which shape youth access and development, and the value and impact of the equity ideas, tools and practices.
This report presents findings from Goodman Research Group's evaluation of the following: (1) The NOVA scienceNOW series, including viewer feedback on Season Three and the knowledge gained from viewing the six new episodes, (2) The NOVA scienceNOW website, and (3) Focus groups conducted at the Science Café conference in June 2008. Includes survey.
The National Science Foundation funded Roadside Heritage (RH) to produce three major deliverables during this project: (1) STEM-rich audio stories for the traveling public that highlight the science associated with Highway 395; (2) Traveling festival kits that highlight major STEM features of the Eastern Sierra landscape; and (3) The RH website, a STEM-rich site highlighting the natural and cultural landscape associate with Highway 395. During the project’s final year, WestEd conducted summative evaluation activities targeting each of these deliverables. Appendix contains survey.
DATE:
TEAM MEMBERS:
Jerome HippsSharon HerpinDonna Winston
During the spring of 2006, American Institutes for Research (AIR) conducted an evaluation study on behalf of WGBH. The purpose of the study was to gather data related to the effectiveness of the FETCH! Activity Guide, which was designed to extend the teachings of a new children’s show, “FETCH! with Ruff Ruffman.” The Activity Guide was developed for after-school program facilitators and other informal science educators to use at their facilities, either in conjunction with the television show or as stand-alone resources. Appendix includes instruments.
Knight-Williams collaborated with five aquaria to solicit the reactions of a random sample of their aquaria members to the PBS broadcast of the Shape of Life series. The collaborating aquaria were located in geographically diverse regions of the country and included: The Seattle Aquarium, Cabrillo Marine Aquarium, Dauphin Island Sea Lab, Shedd Aquarium, and New York Aquarium. The report focuses on questionnaire data provided by both the non-viewer respondents and by viewers of two or more episodes from the series.