Overview
In 2022, we worked with The Wild Center to evaluate its new IMLS-funded climate change exhibition, which used an innovative approach focused on presenting climate solutions through place-based examples and storytelling. Our evaluation came at a time when many museums were wrestling with how to effectively empower visitors to take climate action.
In the early stages of exhibition development, we also conducted audience research using Yale’s Six Americas Short Survey (SASSY) to help The Wild Center understand their audience’s dispositions toward climate change, which they used to
This guidebook will help you plan your action project. The initial brainstorm pages will help you consider where to start, and the Action Project Framework will navigate you through steps to get to your destination: the completion of your project!
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.
This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
Overview
In 2020, RK&A (now Kera Collective) partnered with the National Museum of Natural History to conduct a summative evaluation of the David H. Koch Hall of Fossils: Deep Time, a 31,000 square foot exhibition that explores how Earth’s distant past shapes our future.
Our evaluation explored how visitors process complex scientific topics, such as climate change, mass extinctions, the evolution of life on Earth, and humans’ role in positively impacting Earth’s future.
Approach
We designed a large-scale evaluation study with four distinct but interrelated parts:
A
This Innovations in Development project supports racially and ethnically diverse youth in learning about climate resilience in informal settings, including community centers, afterschool programs, and museums. The project aims to: (1) build the capacity of community organizations to implement youth programming on climate resilience; (2) increase youth knowledge, skills, and self-efficacy associated with climate resilience (also referred to as environmental health literacy for climate resilience); and (3) explore how collaborating research universities and community organizations engage diverse youth in informal STEM learning. Project partners include the UNC Institute for the Environment, the University of Washington-Interdisciplinary Center for Exposures, Diseases, Genomics and Environment, the North Carolina Museum of Natural Sciences, Juntos NC, and the Duwamish River Community Coalition (DRCC). Juntos NC and DRCC actively engage Latino and Indigenous youth in their programming and seek to implement resilience-focused programming that supports youth science learning and leadership development.
Together, informal educators and participating youth will develop locally relevant solutions to climate impacts in their communities. Youth will interact with university-based climate scientists and educators to collect and analyze data and will participate in resilience-focused dialogue, planning, and actions in their communities. Youth will share what they learn with their families and peers through family events and teen summits. The project will engage dozens of educators in community organizations and at least 250 youth, who will share what they learn with their families and communities, reaching hundreds more people through communications and local action projects. Mixed-methods assessment will provide insight into the extent participating youth (a) develop environmental health literacy for climate resilience, and (b) take action to address resilience in their home communities. The team will assess how these outcomes vary by location, and the implications of any variation on potential for project replication. A participatory evaluation, led by an external evaluator, will provide insight into empowerment outcomes. Findings will be disseminated to professional audiences at local and national conferences; and curricular materials from this project will be disseminated through the project website.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
The impacts of changes in the climate at local and global levels threaten how people live. Some frontline communities, especially in historically disenfranchised and under-resourced areas, are particularly vulnerable to the devastating effects of climatological events such as wildfires, flooding, and urban heat islands. As such, there is an urgent need for collective, evidence-based understanding and engagement to prevent and prepare for these potentially fatal events. Led by the Oregon Museum of Science and Industry (OMSI) in Portland, Oregon, in collaboration with local and national partners, Youth Lead the Way is an early-stage Innovations in Development project that offers a theory-based approach for youth in climatologically vulnerable communities to work in climate science research alongside field researchers, develop leadership skills, and engage in timely conversations that impact their own communities. The project will develop and evaluate a Youth Advisory Research Board model to equip and support youth and informal STEM education institutions to conduct evidence-based research on local climate impacts and communicate the findings of their research to their communities. Youth Lead the Way advances the work of several previous NSF-funded projects on climate education, youth advisory boards, and collaborative networks to engage the public in informal STEM learning. Findings from this project will support ongoing efforts in the informal STEM education field to meaningfully engage youth and to more effectively communicate science related to climate and its impacts to the public.
During this initial two-year early-stage project, youth predominantly from racial and ethnic groups underrepresented in STEM will engage in a year-long extended STEM experience. These youth will work collaboratively with scientists and museum professionals to enhance their skills as climate researchers, science communicators, and educational leaders, while reaching an estimated 4,000 or more public audience members through research and events at OMSI, in their schools, and in their communities. Using a cohort model, the youth will conduct scientifically based research studies on various local climate impact topics while concurrently serving in an advisory role at the Oregon Museum of Science and Industry, where they will participate in shaping relevant museum programs and practices. The youth will also develop and present climate stories, a communication approach based on storytelling, to raise public understanding and awareness about local climatological changes and impacts. In addition to the youth component, a companion workshop will be held at the Sciencenter in Ithaca, New York, a partner organization, to train staff and formatively assess the feasibility of scaling the model in other museums. At the program level, an exploratory qualitative research study will be conducted to identify the factors of the overall model that contribute to desired outcomes of youth engagement, climate impact education, and informal science education professional development. Interviews, surveys, focus groups, group chats among youth cohort members, and reviews of artifacts generated by the youth will inform this exploratory study. A theory-based guide outlining key findings, considerations, and recommendations will also be produced. The dissemination of this work will be multi-tiered, reaching thousands within the target communities through public programs, professional networks, at conferences, and a live virtual professional development event hosted by the Association for Science-Technology Centers. If successful, Youth Lead the Way will lay the groundwork for a model that promotes youth and public engagement in STEM through climate science research and identifies promising pathways for future research and similar efforts well beyond this project.
This early-stage Innovations in Development project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This program will derive knowledge on extreme weather and its concepts to be shared with youth in the Boston and Kansas City areas. Subsequently, the youth will share this knowledge by displaying it as art work on the rapid transit systems. The art projects will culminate in broad-based exhibition at the end of each group's sessions. The project will involve 200 youth per region resulting in an impact of 1000 youth per year, 80 adult mentors and 20,000 adult transportation riders in learning about extreme weather concepts. Participant organizations are the University of Mass-Boston, University of Mass-Lowell, The Massachusetts College of Art, the University of Kansas Center for Research Inc., and the Goodman Research Group Inc.
The goals of this project are to bring the topic of extreme weather to the foreground by educating youth and in turn having them educate a selected group of adults that use the rapid transit system. Groups of youths will learn about the topic through a series of meetings with mentors who are experts on the issues around extreme weather. The youth will derive their own art-works with their interpretation. These art-works will be displayed on the rapid transit systems in New England (Merrimack Valley and Worcester regions) and the Mid-West (Topeka and Kansas City areas). Using a quasi-experimental mixed methodology (demographics, bus ridership, initial level of science awareness, and interest) the goal is to understand science learning outcomes associated with the creation and public display of youth art. Research questions of importance in this regard are 1. In what ways does blending art with the science enhance youth learning about extreme weather concepts? 2. To what extent does youth art support adult learning of science? and 3. How does regional context affect learning about extreme weather?
Broader impacts will result from the youth diversity as well as the diversity of riders of the rapid transit systems where the art of extreme weather is displayed.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert ChenLois HetlandJill LohmeierStephen MisholSteven SchrockClaudia Bode
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings.The project plans to develop evidence-based principles to guide citizen science project owners in the coordinated management of project participants within the SciStarter landscape. SciStarter is a repository of over 1,500 citizen science (CS) projects. Through prior research, SciStarter 2.0 tools were developed which can be used to study and coordinate recruitment and retention strategies across projects. Coordinated management has the potential to deepen volunteer learning and growth and benefit project goals because it can address across-project skew (CS volunteers involved in multiple projects), evolving motivations, seasonal gaps, untapped synergies across projects, and other unanticipated factors that cannot be addressed via management within project silos. The project will increase the capacity of citizen science projects to achieve their myriad scientific, learning and conservation goals through enhanced coordination of volunteer management, facilitated by evidence-based guidance from the SciStarter's User's Manual for Project Owners. The findings of the research will guide project design and implementation towards synergies that increase the capacity of projects to generate scientific, learning, and conservation outcomes. Research about citizen scientists has focused on within-project assessments and comparisons of projects, but few have examined dynamics of recruitment, retention, and movement of individuals across projects. SciStarter is designed for embedded tracking of participation dynamics in a landscape of projects. The project will expand embedded assessment to measure scientific, learning, and conservation outcomes and their links to participation dynamics within and across projects. Through social network analysis, the project will describe patterns of bridges, ties, and distances among projects based on the cross-over of participants. The project will also propose qualitative research to understand project managers' perceptions of SciStarter and the costs and benefits of coordinated management of citizen scientists. The research is designed to provide insights into participation dynamics that will lead to subsequent knowledge building across citizen science projects, and determine whether new evidence about advantages and disadvantages of coordinated management will persuade project owners to rely less on the silo approach to volunteer management.