This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Environmental educators have used guided-inquiry in natural and supportive learning environments for decades, but comparatively little programming and research has focused on experiences in urban environments, including in constructed ecosystems like green roofs, or impacts on older youth and adults. To address this gap, we designed a tiered, near-peer research mentoring program called Project TRUE (Teens Researching Urban Ecology) and used a mixed-methods approach to evaluate impacts on undergraduates serving as research mentors. During the 11-week program, undergraduates conducted
WCS Education is committed to creating a diverse and inclusive movement of conservation advocates. We do this by creating equitable pathways to increased scientific literacy, engagement in conservation advocacy, and lasting connection with animals and nature.
One of the programs that incorporates all of these strategies is Project TRUE (Teens Researching Urban Ecology). Project TRUE is a partnership between WCS and Fordham University that is both a social science research study and a youth development program designed to support youth in STEM career pathways. Teams of high school students
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
Free-choice and interest-driven learning activities are a highly significant source of STEM (science, technology, engineering, and mathematics) learning for adults through their lifespans. Gardening is one such activity that is widespread across communities with one in every fifty American adults reporting an interest in gardening/plants and who associate that interest/hobby with science. While the terms interest and hobby are related, the latter refers to something one actively does, not just thinks about doing. Adults who seek out learning and participation opportunities in highly visible community spaces (e.g., gardening clubs, science centers, botanical gardens) are likely to be White and well-educated. Further understanding is needed of when and how community members from other demographic groups access different resources (people, organizations, and places) for information and opportunities, and what influences them to do so. This Pilot and Feasibility Study will explore informal learning networks in Alameda County, California, specifically around gardeners and gardening. Researchers will use surveys, focus groups, and program observations to gather data on how those who pursue self-directed scientific learning about gardening access information. Of interest is how the differential access to and pursuit of information occurs among diverse community members, especially those outside of more established Master Gardener and other organized gardening programs. This research will: 1) contribute to understanding of the resources that interest-driven adult STEM learners access, describing the barriers they perceive and how/if the accessed resources differ by gender, race, or socioeconomics; 2) determine the feasibility of a sampling approach to gather data from individuals in demographic groups who may not have been reached in prior research efforts; and 3) generate insights for informal science education practitioners and researchers about how to better support diverse interest-driven STEM learners. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
It is hypothesized that there is a large percentage of individuals from non-dominant populations engaged in free-choice STEM learning; past efforts have likely under-counted the participation of individuals from these communities. To achieve the research aims the research team will utilize respondent-driven sampling, engaging gardening hobbyists' social contacts to recruit participants, and collect data from diverse (gender, race, socioeconomics) urban gardeners who may be differently connected to STEM learning ecosystem resources/organizations than their highly visible peers. This approach will be used to investigate the behaviors, perceptions, and outcomes related to STEM learning such as development of self-efficacy and science identity. Focus groups will provide context for themes that arise in the survey data and clarify hobbyists' participation preferences and experiences. In situ observations of learning environments comprise the third mechanism for collecting data. All three data sources will support triangulation of results and contribute to the findings. Key outcomes of this project will be to determine if the target population has been reached through the sampling approach, to identify methodological guidelines for sampling with an intent to reach those from populations under-represented in STEM-related free-choice activities, and to clarify which network variables are most useful to study. This research lays the foundation for future work. It is anticipated that the approach developed and tested in this research may be adapted by others in the future and will have the potential to serve as a model for community-based organizations and researchers interested in studying the learning ecosystems of previously hidden populations of participants, including how these individuals perceive and access resources to support their STEM learning.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Urban environments are remarkable natural laboratories to study ecology and speciation. These learning ecosystems are ecologically diverse and potentially more accessible for urban youth and their families. Unfortunately, disparities in STEM access continue to persist. Transportation, social and financial barriers, and a lack of awareness of STEM opportunities are a few of the inequities that significantly limit participation in STEM programs among urban youth, especially from underrepresented groups. Perceptions of who can meaningfully engage in scientific research remain demographically skewed to affluent, aged, and non-minoritized individuals. In an effort to address these challenges, this pilot study will investigate the feasibility of using remote cameras to survey local, urban wildlife to promote inclusive practices and youth engagement in STEM. A co-created curriculum will be employed, bringing urban ecologists and Detroit youth (6th-8th grade) together to participate in wildlife field experiences to garner and analyze data collected from cameras deployed through the city. It is the unique coupling of the camera surveys with authentic place-based, culturally relevant ecological research that will facilitate the innovative, experiential learning experiences. This pilot study will advance the understanding of the extent to which various facilitation methods and participation in out-of-school time programs like the Wildlife Neighbors program impact youth. From a broader impacts perspective, this work may yield positive environmental literacy outcomes and prove applicable for other urban youth in the country. The research findings would lay the foundation for future research and add novel approaches to the NSF portfolio on urban, out-of-school time environmental education programs for middle school youth using camera surveys to promote inclusivity, engagement in scientific field research, and increase youths' interest in STEM.
Through a strategic partnership between the Applied Wildlife Ecology Lab at the University of Michigan and the Detroit Zoological Society, this pilot will examine the effects of experiential learning through wildlife monitoring in twenty-four Detroit parks on strengthening four aspects of youth's environmental literacy: knowledge of ecology, competencies as researchers, empathy for wildlife, and sense of place. Youth will self-select into one of four facilitation models, each varying in intensity (summer experience, afterschool club) and mode (in-person, remote). Using camera surveys deployed in Detroit parks, youth will be immersed in ecological research, engaging them in the entire scientific process: observation, inquiry, data collection, fieldwork, data analysis and storytelling. Youth pre- and post-surveys, daily reflections on program activities, and parent/guardian questionnaires will assess impacts and experiences of the Wildlife Neighbors facilitation models and program more broadly. The research questions will explore the extent to which participation in Wildlife Neighbors: (a) differs across facilitation intensity and mode, and (b) strengthens environmental literacy among middle school urban youth when engaged in a co-created out-of-school time experiential program using remote cameras to survey local wildlife. Over the two-year pilot duration, approximately 100 youth and their families will participate in the program.
This pilot study is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
"PLUM RX: Researching a new pathway for bringing active science exploration to urban families" is a project that makes use of public media resources to create innovative opportunities to bring environmental science learning to the hard-to-reach audience of urban families. As part of this project, media producers at WGBH and researchers at EDC worked together to: (1) develop a new pathway for bringing active environmental science exploration to urban families with children ages 6-9; (2) expand PLUM LANDING’s media assets to support urban families and informal educators when engaging in
This report looks across multiple phases of work to discuss the PLUM Rx project’s contribution to broader knowledge about supporting children’s active, outdoor science exploration in informal, urban settings. The PLUM LANDING Explore Outdoors Toolkit that resulted from this work is designed for use by outdoor prescription programs and a broad range of informal education programs serving urban children and families. This report describes (1) the rationale for the design principles that guided Toolkit development, (2) the Toolkit components developed in accordance with the design principles; and