The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
Why Zoos and Aquariums Matter (WZAM3) conference presentaiton slides for the 2018 ASTC Annual Conference (Hartford, CT) and the NAAEE 2018 Annual Conference and Research Symposium (Spokane, WA).
The Monterey Bay Aquarium is planning to redesign existing conservation-related interactives as well as add new experiences on the Aquarium floor. In preparation for this project, the Aquarium sought to gain a better understanding of visitors’ awareness of and engagement in conservation-related actions and responses to conservation-related messaging. The Aquarium contracted with MWA Insights to conduct a front-end evaluation study to help inform the planning for these conservation stations. Specifically, the evaluation sought to understand:
Are visitors aware of issues affecting the
Increased integration and synergy between formal and informal learning environments is proposed to provide multiple benefits to science learners. In an effort to better bridge these two learning contexts, we developed an educational model that employs the charismatic nature of arachnids to engage the public of all ages in science learning; learning that aligns with the Next Generation Science Standards (NGSS Disciplinary Core Ideas associated with Biodiversity and Evolution). We created, implemented, and evaluated a family-focused, interactive science event—Eight-Legged Encounters (ELE)—which
This ChangeMakers project builds on a 2016 National Academies report finding that scientific literacy can be understood at a community level as opposed to a traditional focus on the individual. This is important since scientific knowledge is often seen as abstract and distant from the daily concerns of average citizens. A community focus shifts the spotlight away from individual learning to collective learning facilitated by trusted cultural institutions serving as social assets. This work brings together scientific expertise and community organizations to advance operational science literacy--scientific ways of problem-solving--for community leaders and functional science literacy--information and skills people can use in their daily lives--among their service populations. This will be done by gathering and sharing knowledge and developing skills and abilities to contribute to the community's overall well-being.
The New England Aquarium (NeAq) and Aquarium of the Pacific (AoP) will apply a community engagement model involving active listening, documentation, alignment of concerns and goals, and co-development of shared solutions that serves the needs of all participants. As part of the Advancing Community Science Literacy (ACSL) project, multi-disciplinary teams from NeAq, AoP and their regional partners will participate in training on the model. They will apply that training to build and implement action plans to advance community-driven responses to local environmental issues. Teams will be assessed with respect to how they use tools from their shared training, along with peer support and coaching, to make progress in engaging diverse community stakeholders. Results of the evaluation will offer insights and recommendations for informal science learning centers to serve their communities more effectively as engagement facilitators and change agents to support science literacy development and action. By applying techniques developed for cultural institutions to communicate about climate science, and combining those with techniques developed for libraries and other organizations to help meet emergent community concerns, such as storm surges and coastal flooding, it is possible to redefine the role informal science learning centers can play as part of a community culture.
ACSL is funded by the Advancing Informal STEM Learning (AISL) program which supports projects that provide multiple pathways for broadening access to and engagement in STEM learning experiences, advances innovative research on and assessment of STEM learning in informal environments, and develops understandings of deeper learning by participants.
The project will conduct a nation wide study to address three broad questions:
(1) How does the public view zoos and aquariums and how do these institutions affect STEM (Science Technology Engineering Mathematics) learning outside their walls?
(2) How do visitors experience zoos at different stages in their lives and how do zoo visits affect their knowledge and perspectives concerning environmental issues and conservation?
(3) What are the entry characteristics of visitors and how do those characteristics play out in behaviors during a visit?
The project is designed to advance understanding of how informal STEM learning emerges through the intersection of institutional pedagogy and learning goals and the characteristics of individuals and their social and cultural backgrounds. As the first institutional study that advances a field-wide research agenda, the project will map how to implement a national collaborative effort that can help refine program delivery and cooperation between zoos, aquariums and other STEM learning institutions.
The study will describe zoo and aquarium visitors based on a broad understanding of demographics, group, and individual perspectives to expand understanding of how these factors influence visitor learning and how they view the relevance of educational messages presented by zoos and aquariums. The project will result in reports, workshops and a handbook presenting findings of practical value for educators, a research platform and research tools, online discussion forums, and directions for future research. The project, led by New Knowledge Organization (NKO), will be carried out through the collaboration of NKO with other informal research organizations and the Association of Zoos and Aquariums (AZA) with its 230 informal science learning institutional members. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.