This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Lineage project was a collaboration between Twin Cities Public Television and the Smithsonian’s National Museum of Natural History. The project included creation of a feature-length video program, a Virtual Reality game, and a set of hands-on activities designed for use by multigenerational audiences—all of which were incorporated as part of a series of seven Fossil Festival events at museums and other sites around the United States. This report presents findings from a set of external evaluation studies that examined impacts on families who participated in Fossil Festival events as well
The Year in ISE is a slidedoc designed to track and characterize field growth, change and impact, important publications, and current topics in ISE in 2018. Use it to inform new strategies, find potential collaborators for your projects, and support proposal development. Scope This slidedoc highlights a selection of developments and resources in 2018 that were notable and potentially useful for the informal STEM education field. It is not intended to be comprehensive or exhaustive, nor to provide endorsement. To manage the scope and length, we have focused on meta analyses, consensus reports
This CAISE report is designed to track and characterize sector growth, change and impact, important publications, hot topics/trends, new players, funding, and other related areas in Informal STEM Education (ISE) in 2017. The goal is to provide information and links for use by ISE professionals, science communicators, and interested stakeholders who want to discover new strategies and potential collaborators for project and proposal development. Designed as a slide presentation and divided into sectors, it can be used modularly or as a complete report. Each sector reports on research, events
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
The Nexus of Energy, Water, and Climate: From Understanding to Action (Café +) project will develop and test two interactive board game concepts focused on energy, water, and climate with youth and adults from four highly diverse communities in New Mexico. The four primary goals of the project are to: (a) develop, play test, and implement two board, card, or other non-electronic games grounded in energy, water, and climate content at four project sites, (b) identify the key characteristics of the games that maximize problem solving while stimulating interest, engagement, and learning, (c) explore the implications of game playing on dialog, learning, and Café+ satisfaction for youth and adult participants, and (d) evaluate the viability of this model for full scale implementation throughout the existing Café Scientifique program, from which this project is based. Los Alamos National Laboratory, Sandia National Laboratory, PNM Resources, Scott Balaban Games Design, the Los Alamos County Utilities Department, and a host of advisors and consultants from a broad range of organizations and institutions will collaborate to develop, test, and implement the Café+ games model. The primary deliverables include: (a) two non-electronic multiage commercial quality games focused on energy, water, and climate content, (b) a comprehensive pilot study examining the impact, effectiveness, and viability of the Café+ model with the target audiences, and (c) formative and summative evaluations of the games implementation model. A significant outcome of Café+ is that New Mexico youth and adults, from diverse backgrounds, will learn relevant science content through the development and testing of engaging, innovative commercial quality games. Over 250 youth and adults will benefit directly from their participation in the pilot study. They will not only learn important science content while working collaboratively in groups (youth only and youth/adult groups), but they will also participate in an authentic scientific process experience as playtesters. In this role, youth and adults will experience critical science concepts such as trial and error and refinement. Further, the games will be made publicly available and implemented across the entire Café Scientifique program (n=960 youth). The evaluation study will employ a mixed methods approach to examine project implementation, effectiveness, and impacts. Focus groups, observations, and surveys will be employed to assess a number of variables such as (but not limited to): content knowledge and learning, interest, engagement, game features, game play processes, gaming obstacles and challenges, participant interactions, and motivation. Embedded assessment opportunities will also examine participants\' decision making abilities, analytical skills, and ability to transfer knowledge gained to real world situations as they navigate through the games. Data collected at the youth-only pilot test sites will be used in a comparative analysis of similar variables tracked at the youth and adult sites. Formative approaches will provide iterative, ongoing opportunities for programmatic and game refinement and adjustments. The formative and summative evaluations will endeavor to document critical data and findings needed to assess the viability of Café+ as a full scale development project, with additional games and project sites across the country. The Café+ project would add to the limited literature base on learning and science engagement of youth within Science Café settings in the 21st century. More critically, this pilot study could contribute to the dearth of current research on the impact of non-electronic game play can have on youth only groups and youth/adult groups working collaboratively to make important scientific decisions within Science Café settings. This comparative data could prove significant for other program models interested in implementing similar youth and adult game based program. Further, the relevance of the content could potentially spark youths' interest not only in pursuing courses and careers in STEM, but it could also motivate youth and adult participants to become more involved in civic engagement activities occurring within and beyond their local communities.