This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This guidebook will help you plan your action project. The initial brainstorm pages will help you consider where to start, and the Action Project Framework will navigate you through steps to get to your destination: the completion of your project!
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.
This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Public outdoor spaces present opportunities for social experiences and learning. This Broader Implementation project will expand and evaluate a model that transforms urban public spaces into accessible and engaging environments for learning social science in outdoor public spaces. The model combines social science inquiry exhibits, place making and human facilitation of learning experiences in outdoor public areas. Project exhibits use the facilitated social interactions as both the content of and medium for the experiences. This project will adapt the existing exhibits and add new exhibits and facilitation techniques for testing in three different urban environments. Project research will explore the efficacy of these adaptations and revised facilitation techniques for the different settings in collaboration with civic partners at each site. The project will share the model and research findings widely through the Exploratorium website and publications for researchers, developers, and educators.
The team’s prior research showed that facilitators improved multiple learning outcomes with the current exhibits. Visitors acquired new social observation skills, reflected on their own experiences, perceptions, and actions, and increased their awareness for how social behavior, cognition, and emotion can be studied scientifically. Building on the prior research, the project will install the exhibition and test its efficacy in three different urban environments and explore the adaptations that are required for different settings with different civic partners. The project will use design-based research to develop a new theoretical model of facilitation strategies for supporting science learning in outdoor public spaces. For evaluation, the project will use mixed methods, including observations, interviews, surveys, and document review. Evaluation will assess success in attracting and engaging visitors; conveying social science concepts; prompting self-reflection of judgments and actions; and fostering empathy among those with different social identities. The project will assess the extent to which participants, particularly those from marginalized communities, experience feelings of belonging and inclusion. The project will be presented in three sites which represent the significant diversity, income levels, and urban environments of San Francisco. Facilitation strategies are being co-developed with Urban Alchemy, an organization that works within distressed urban communities in San Francisco. Project site partners and collaborators include the San Francisco Public Library, the Port of San Francisco, and the San Francisco Department of Parks and Recreation. The project will also measure partnership outcomes, through surveys and interviews, to look at the extent and ways the project integrates a co-creation model and develops an authentic, mutually beneficial, sustainable partnership. The project will generate and disseminate generalizable knowledge about the affordances of combining informal science learning, placemaking, and facilitation in a variety of free, outdoor STEM learning spaces in collaboration with local community groups. The project will also advance public understanding of the social and behavioral sciences.
This research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and sssessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Middle Ground, funded by the National Science Foundation, was an outdoor public installation developed by the Exploratorium and located in the Civic Center. This installation focused on the social science of how people think about others, particularly the cognitive basis for biases, judgements, and stereotypes, as well as more pro-social behavior and ways of connecting with others. Garibay Group is currently conducting a summative evaluation. As data are still being collected and analyzed, this report presents select preliminary results about installation-specific outcomes.
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.
Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This video presents reflections on SCIENCES: Supporting a Community’s Informal Education Needs—Confidence and Empowerment in STEM. SCIENCES brought together Eden Place Nature Center and the Chicago Zoological Society to collaboratively support environmental conservation and lifelong scientific learning in the Fuller Park neighborhood of Chicago.
The SCIENCES project began in 2013 and focused on adapting existing educational programs into a suite of environmentally focused science learning opportunities for professional, student, and public audiences in the Fuller Park neighborhood
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically