Summative Evaluation of Soundprint's Pole to Pole (NSF #0632194): An Exploratory Study of the Impact of Radio Documentaries non Listener Understanding of Science Research on Climate Change (This report was published in The Informal Learning Review, #103, July/August 2010.) Robert L. Russell, Learning Experience Design Washington, DC eldrbob@gmail.com Soundprint Media was awarded a grant from the National Science Foundation in 2007 to produce eight half-hour radio documentaries on scientific research in the Polar Regions. The programs have been broadcast on participating National Public Radio
Throughout the year, El Museo del Barrio hosts various cultural programs that are open to the public and often free. To explore the effectiveness of the Museum's cultural programs, Randi Korn & Associates, Inc. (RK&A) conducted case studies for three programs Day of the Dead, Three Kings Day, and Super Sabado - Carnival. RK&A conducted naturalistic observations of visitors to the three programs. Trained data collectors unobtrusively observed program attendees and took notes on select behaviors using observation guides specific to each program. RK&A interviewed program participants 18 years and
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.El Museo del Barrio
A research study was conducted to help inform UC Davis's Tahoe Environmental Research Center (TERC) about the greater Lake Tahoe area community's perceived value of the center and two 3D visualizations included as part of their guided tour of the center. Research questions focused on how various local groups perceived the center, how TERC can better engage locals and tourists alike, the potential for the current 3D visualizations (Lake Tahoe, Earthquakes) for impacting attitudes and behaviors about the Lake and how the Lake Tahoe 3D visualization impacted middle school students during a school
This Pathways Project connects rural, underserved youth and families in Eastern Washington and Northern Idaho to STEM concepts important in sustainable building design. The project is a collaboration of the Palouse Discovery Science Center (Pullman, WA), Washington State University and University of Idaho, working in partnership with rural community organizations and businesses. The deliverables include: 1) interactive exhibit prototype activities, 2) a team cooperative learning problem-solving challenge, and (3) take-home materials to encourage participants to use what they have learned to investigate ways to make their homes more energy-efficient and sustainable. The project introduces youth and families to the traditionally difficult physics concept of thermal energy, particularly as it relates to sustainable building design. Participants explore how building materials and their properties can be used to control all three types of heat transfer: conduction, convection, and radiation. The interactive exhibit prototypes are coupled with an Energy Efficient Engineering Challenge in which participants, working in cooperative learning teams, use information learned from the exhibit prototype activities to retrofit a model house, improving its energy efficiency. The project components are piloted at the Palouse Discovery Science Center, and then travel to three underserved rural/tribal communities in Northern Idaho and Eastern Washington. Front-end and formative evaluation studies will demonstrate whether this model advances participant understanding of and interest in STEM topics and careers. The project will yield information about ways that other ISE practitioners can effectively incorporate cooperative learning strategies in informal settings to improve the transferability of knowledge gained from exhibits to real-world problem-solving challenges, especially for rural and underserved audiences. This project will also provide the ISE field with: 1) a model for increasing the capacity of small, rural science centers to form collaborative regional networks that draw on previously unused resources in their communities and provide more effective outreach to the underrepresented populations they serve, and 2) a model for coupling cooperative learning with outreach exhibits, providing richer experiences of active engagement.
Glaciers: A Chronology of Climate Change is a CRPA project that seeks to explain the historical cycling of glaciers in the context of climate change. By using chemical isotopes (Beryllium 10), the age of rocks that have been covered with glacier ice and exposed to sunlight later can be determined fairly accurately. Through this method, the glaciation cycles have been determined for the last 70,000 years. In collaboration between the Lamont-Doherty Earth Observatory at Columbia University and the American Museum of Natural History (AMNH), this project is designed to impact adult audiences, youth in grades 6th-12th, and teachers writ large. The research results shall be expressed via an eight-minute high definition film for large screen viewing in the \"Science Bulletins\" section of the AMNH and the affiliated museums. A rigorous front-end evaluation will be used to inform the presentation and assess audience impact. Subsequent formative evaluations are designed to measure the learning impact of the film and the retention of longer term concepts. It is anticipated that more than 700,000 individuals will have access to current, scientifically accurate data and related information on glaciation cycles and climate change through the educational film and website. Materials will be easily accessible to teachers and the film will be closed captioned in both English and Spanish.
DATE:
-
TEAM MEMBERS:
Joerg SchaeferGeorge DentonMichael Kaplan
The PBS NewsHour STEM Learning project is a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience. The multi-platform project goals are to: (1) increase and improve the knowledge of the audience with respect to science and technology; (2) stimulate the active engagement of the audience with science and technology through interactive tools; and (3)position the PBS NewsHour as a regular destination for in-depth and innovative science reporting; (4) deploy new and creative digital tools to extend the impact of NewsHour science reporting, especially for youth. The PBS NewsHour is produced by MacNeil/Lehrer Productions and distributed by PBS to PBS television and radio stations across the country, five nights per week. This project is informed by an expert advisory board and other consultants. Project evaluation will be conducted by City Square Associates. The formative evaluation in year one will employ focus groups of adults from the general audience and teens as well as a quantitative survey online to determine a benchmark of current science knowledge, attitudes and behaviors. The evaluation in year two will test digital components of the project in a usability lab setting to gather information to help improve the quality and effectiveness of these deliverables. The summative evaluation will administer a tracking study with the same population surveyed in the first year. Deliverables include: a minimum of 26 science documentary reports broadcast per year plus additional in-studio interviews and coverage of breaking science news; a revamped website, notably "Science and Tech To Go"; a weekly STEM interview or report online featuring Hari Sreenivasan or other reporters; additional weekly digital STEM reporting; and an expanded and redesigned outreach program for teens and educators including an innovative, cloud-based student editing and content-sharing initiative in collaboration with several science centers. Six new PBS NewsHour Student Reporting Labs, established in high-need urban schools, will shoot, edit, and post their videos on the web. The PBS NewsHour science reports will be broadcast and featured on the NewsHour iPhone app, as well as disseminated on the NewsHour's YouTube Channel, Disqus and UStream, Hulu.com, with new science material updated daily on the web. The NewsHour is seen by more than 7 million viewers each week, with additional audiences being reached by radio, the Online NewsHour website, podcasts, and other social media. New community-based programs expand the audience farther. The final summative report will outline the impact of the project and identify the strategies and tactic found to be most effective in making use of digital media to support project goals.
The University of Minnesota is partnering with several nature centers in the Midwest to transform citizen "technicians" into citizen "scientists." The Driven to Discover project will use existing citizen science programs with strong educational components to engage 12-14 year old youth and their adult mentors in authentic research. The goal of the project is to develop a training model for adults who work with youth in a variety of informal education settings to involve them in authentic scientific inquiry via citizen science rather than just data collection activities. In the proof-of-concept phase, teams consisting of 4-H youth, adult leaders, and several scientists are conducting participatory action research to understand what factors lead youth to full engagement in ecological research. In phase two, project personnel are training 4-H educators, naturalists, and teachers how to engage youth and their adult leaders in other 4-H programs and other informal education programs to conduct ecological research with scientists in advisory roles. Phase one involves approximately 10 adults and 70 youth, whereas phase two involves approximately 40 adults and 300 youth. A front-end study defined the project's target audiences and partners. Formative evaluation study will monitor interactions among members of the research teams and summative evaluation will measure impacts on participants' knowledge, skills development, attitudes, and behavior. Project deliverables include youth-generated ecological research findings, web-based program implementation materials, an annual conference, and a model for engaging youth groups in informal settings in authentic scientific inquiry. The model is expected to impact more than six million youth nationwide.
DATE:
-
TEAM MEMBERS:
Karen OberhauserNathan MeyerAndrea Lorek StraussPamela NippoltKatie ClarkRobert Blair
This project will engage underserved Native and non-native youth and adults in environmental science content and awareness through innovative exhibitions and hands-on activities. Traditional ecological knowledge (TEK) and western science will be communicated and promoted within culturally relevant contexts as valuable, complementary ways of knowing, understanding, and caring for the world. The Oregon Museum of Science and Industry (OMSI), the lead institution, and its partner organizations, The Indigenous Education Institute (IEI), The National Museum of the American Indian (NMAI), the Tramastklikt Cultural Institute, the Confederated Tribes of the Umatilla Indian Reservation, the Hibub Cultural Center and Natural History Preserve (Tulalip Tribes) will work collaboratively to develop and deliver all aspects of the project. An estimated 1.5 million Native American and non-Native American youth and adults are expected to be engaged in the project\'s exhibits, website, and activity kits over the five year duration of the project. Native American and non-Native American youth (ages 11-14) and their families from the Portland area and visitors to national science centers, tribal museums, and members of Native American organizations and service providers will be targeted for participation in Generations of Knowledge activities. In addition, the Professional Collaborative component will bring professionals from the partnering organizations to share resources, professional opportunities, and document their collaborative process. OMSI, project partners, Native scientists, tribal museum partner, exhibit developers, advisors, and members of various Native American communities will work collaboratively to develop four integrated deliverables. Each deliverable will be interconnected and designed to accommodate a variety of venues and audiences. Project deliverables include: (a) a 2,000 sq ft traveling exhibition, (b) a small traveling graphic panel exhibition, (c) an online virtual exhibition, (d) an activity kit for Native youth in informal and formal settings, and (e) opportunities and resources for reciprocal collaboration between ISE and Native American partners through a professional collaborative initiative. IEI and advisors from RMC Research and Native Pathways will conduct the external evaluation using a mixed method, community-based participatory research (CBPR) approach. Formative and summative evaluative data will be used to monitor, assess, and inform the project and the extent to which project goals have been met and the intended impacts achieved. The anticipated project outcomes include (but not limited to): (a) an awareness and understanding of the interconnectedness of TEK and western science, (b) a recognition of the relevancy and value of TEK and western science for understanding and caring for the natural world, (c) intergenerational learning and discussions about related TEK and western science issues, and (d) an increased capacity, supported by evidence, among the project team and partners to facilitate reciprocal collaborative efforts. This project builds on a long history of successful NSF/DRL supported work led by OMSI and IEI. It also extends existing traditional ecological knowledge focused work through a culturally contextualized hands-on traveling and virtual exhibitions, a rigorous professional development component, highly visible national partners (e.g., NMAI), and a national reach to over one million Native American and non-Native American youth and adults over a five year period. The project\'s research and evaluation findings will add to the knowledge base on strategies that can be employed to communicate and promote TEK and western science as complementary, valuable was of understanding and caring for the natural world.
Life on Earth aims to advance (1) public understanding of the history of life on Earth and biodiversity, and (2) our knowledge of how people interact and learn from large interactive science data visualizations on multi-touch displays in public settings. Our multi-institutional project team has developed the DeepTree, the FloTree, and Build-A-Tree (BAT). The focal exhibit, called the DeepTree, utilizing large data sets from four online databases including Tree of Life web project (www.tolweb.org), Encyclopedia of Life (www.eol.org), National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/) and Time Tree (www.timetree.org), allow museum visitors to explore the relationships of 70,000 species, spanning over 3.5 billion years of evolutionary history using touch gestures on a large multi-touch computer display. Embedded inside the DeepTree, the "FloTree" encourages exploration of evolutionary processes within a single population. "Build-a-Tree" (BAT) is a multi-level phylogenetic tree-building game. These learning experiences are designed to target core evolutionary concepts and be self-directed, physically interactive, embodied, and collaborative. The Life on Earth exhibit has been installed at California Academy of Sciences in San Francisco, the Field Museum in Chicago, University of Nebraska State Museum in Lincoln Nebraska, and Harvard Museum of Natural in Cambridge Massachusetts. Please visit the Life on Earth website at https://lifeonearth.seas.harvard.edu/ to find more details on publications, and the ongoing learning research and summative evaluation. The Life on Earth project brings together a team of interdisciplinary researchers in human-computer interaction and information visualization, learning sciences, museum exhibit design, cognitive and developmental psychology, and evolutionary biology.
The objective of this youth media project is to provide 14-24 year olds with training and hands-on experience in engineering, and the physical and biological sciences. The project is designed around core practices that engage youth in original research and inquiry through experimentation, development, and creative use of new technologies and tools to communicate STEM to the public. Youth Radio project participants in Oakland, CA, Atlanta, GA and Washington, DC include 540 youth, 80% of whom are low-income and/or youth of color, plus another 400 youth via off-site outreach in schools and community centers. Core deliverables include: (1) "Brains and Beakers," eight live events per year where a visiting STEM researcher brings his/her work out of the lab and onto the stage at Youth Radio facilities, demonstrating key principles and discoveries and interacting with youth participants; (2) "Youth Radio Investigates," an annual 6-part multimedia series, where youth partner with university and industry-based researchers to explore the veracity of scientific claims applied to products and services and they use every day; (3) The "Application Development Lab," where youth develop, create and disseminate online embeddable and downloadable applications (12 annually) that serve real needs in youth communities. The digital media produced by the youth will be broadcast by National Public Radio and distributed online through various sites including iTunes and BoingBoing.net, one of the most frequently visited technology-focused sites on the web. Project advisors include STEM researchers in universities as well as highly experienced and successful new media technology developers. Project partners include National Public Radio, KQED, the California Academy of Sciences, and the Oakland Unified School District. This project builds on the successful prior work (NSF #0610272) that initiated a Science and Technology program within the Youth Radio organization. The summative evaluation by Rockman et al will measure how the program affects students' science and technology knowledge, skills, and attitudes. It will build on the evaluation from the prior NSF funded project (#0610272) that highlighted the organizational and staff growth processes as Youth Radio discovered how to design and implement successful, sustainable STEM programs. Rockman will evaluate the new programs (Youth Investigates, Brains and Beakers, and the Application Lab), measuring the following STEM-related student outcomes/impacts: perceptions of selves as producers/creators of science or technology; attitudes toward science and perceptions of scientists; understanding the process of scientific inquiry and research and/or technology skills development; and understanding or interest in careers in science or technology (based on National Research Council report, 2009). Data will be collected from the youth at the Oakland site and from the other Youth Radio bureaus to determine which aspects of the program transfer to multiple sites and which ones are unique to a specific location or set of circumstances. Methods include surveys of student attitudes, participant focus groups, interim assessments, objective skills assessments, and interviews. This project provides an innovative new model for collaborations between STEM researchers and under-represented youth resulting in digital media that impacts the youth as well as the public's understanding and engagement in science.
Boston's Museum of Science (MOS), with Harvard as its university research partner, is extending, disseminating, and further evaluating their NSF-funded (DRL-0714706) Living Laboratory model of informal cognitive science education. In this model, early-childhood researchers have both conducted research in the MOS Discovery Center for young children and interacted with visitors during the museum's operating hours about what their research is finding about child development and cognition. Several methods of interacting with adult visitors were designed and evaluated, including the use of "research toys" as exhibits and interpretation materials. Summative evaluation of the original work indicated positive outcomes on all targeted audiences - adults with young children, museum educators, and researchers. The project is now broadening the implementation of the model by establishing three additional museum Hub Sites, each with university partners - Maryland Science Center (with Johns Hopkins), Madison Children's Museum (with University of Wisconsin, Madison), and Oregon Museum of Science and Industry (with Lewis & Clark College). The audiences continue to include researchers (including graduate and undergraduate students); museum educators; and adults with children visiting the museums. Deliverables consist of: (1) establishment of the Living Lab model at the Hub sites and continued improvement of the MOS site, (2) a virtual Hub portal for the four sites and others around the country, (3) tool-kit resources for both museums and scientists, and (4) professional symposia at all sites. Intended outcomes are: (1) improve museum educators' and museum visiting adults' understanding of cognitive/developmental psychology and research and its application to raising their children, (2) improve researchers' ability to communicate with the public and to conduct their research at the museums, and (3) increase interest in, knowledge about, and application of this model throughout the museum community and grow a network of such collaborations.
The Lost Ladybug Project (LLP) is a Cornell University citizen science project that connects science to education by using ladybugs to teach non-scientists concepts of biodiversity, invasive species, and conservation. The project has successfully engaged thousands of children (ages 5-11) in collecting field data on ladybugs and building a ladybug biology database that is useful to scientists. It has also reached 80,000 people over the Internet. The goal of the project is to promote lifelong appreciation of biodiversity and science, and provide scientists with data on the changing distribution and abundance of ladybug species across the country. The current project is broadening the Lost Ladybug Project's reach geographically, culturally, demographically, and contextually by creating new tools and materials for the website, and forging new connections with (1) youth groups, (2) science centers, community centers, botanical gardens, nature centers, and organic farms, (3) adults, (4) Native Americans, and (5) Spanish-speakers. The expanded project could potentially involve tens of thousands of new individuals in ladybug monitoring research. An evaluation study is measuring the impacts of the expansion on new participants' knowledge, skills, attitudes, interests, and behavior. The Lost Ladybug Project has been important in advancing scientific discovery and building scientific knowledge. Data collected by the project's volunteers have improved scientists' understanding of (1) ladybug species presence/absence, (2) shifts in ladybug species composition, (3) shifts in ladybug species ranges, and (4) change in ladybug body size and spot number. Evaluation data show that the project has a broad audience reach and is achieving its learning goals for adults and children. Broadening the project's reach will further increase the project's importance to ecology, conservation biology and biodiversity research, as well as education research.