This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
This innovations in development project will develop and study the Wéetespeme Stewardship Program (Wéetespeme: “I am of this land”). Tribal led, the project supports and studies climate science learning experiences grounded in traditional ecological knowledge, culturally relevant pedagogy, and land education pedagogy. Nez Perce high-school youth and college-age adults will choose specific species and places; work with tribal resource management offices to learn to monitor, assess, and mitigate climate impacts; and receive mentorship from tribal elders, as they co-develop climate-science adaptive management plans for local concerns. Adaptive management plans may include topics such as: drought and extreme weather impacts, shifts in animal populations and migration patterns, cultivating traditional foods, and managing important cultural sites. The Tribal research team will collaborate with curriculum developers and Indigenous graduate student(s) from the University of Idaho and Northwest Youth Corps to explore how a STEM curriculum centered on cultural identity and traditional knowledge can align with Indigenous youths’ identities, resource responsibilities, and understanding and interest in STEM career pathways within the Tribe and in the region. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This project’s approach to curriculum development, and youths’ identity and career interest development, will contribute to the informal STEM learning field’s nascent understanding of Tribal-driven education efforts, and approaches to blending or bridging traditional ecological knowledge and Western ways of knowing. With co-funding from the Directorate of Geosciences’ (GEO), this project will further advance efforts related to the application of traditional ecological knowledge to the geosciences, including Indigenous workforce development opportunities and research experiences for Indigenous graduate students.
Over a two-year duration, the study will address two research questions. 1) How and in what ways does a culturally relevant out-of-school curriculum support Indigenous youths’ understanding of their own identity, resource responsibility, and possible career pathways, including those on Tribal land? 2) How and in what ways does a culturally relevant out-of-school curriculum develop Indigenous youths’ ability to monitor and address climate change impacts, to protect, preserve and recover land relationships that are central to their cultural identities and values? Thirty-two college-age young adults and high-school youth (sixteen of each age group) will participate in the Wéetespeme Stewardship Program and research study. Indigenous research methodologies will guide the approach to investigating and sharing Indigenous youths’ understanding of their own identity, resource responsibility, possible career pathways, and learning experiences within the Wéetespeme Stewardship Program activities. Two Indigenous graduate students will play a central role in conducting the research, supporting systemic impacts within, and beyond, the Tribe. Methods will be embedded in learners’ experiences and will include field journals, adaptive management plans, story maps, and talk circles. Youth will also participate as research partners: understanding the research questions, assisting with the analysis, contributing to interpretation of the findings, and co-authoring manuscripts that share their stories and this work. The informal STEM curriculum will be shared regionally, allowing for Tribes in the plateau region to benefit from culturally relevant approaches youth engagement to support climate resilience. The results of the research will also be shared more broadly, contributing to the emerging knowledge-base about the ways that cultural practices and values, guided by land education pedagogy and the mentorship of traditional ecological knowledge keepers, and embedded in informal STEM learning experiences, can contribute to Indigenous youths’ identities and understanding of, and investment in, local and meaningful environmental resources and STEM career pathways.
DATE:
-
TEAM MEMBERS:
Nakia WilliamsonKarla Bradley EitelJeff ParkerJosiah Pinkham
The RASOR project is designed to increase engagement of students from rural Alaska communities in biomedical/STEM careers. Rural Alaskan communities are home to students of intersecting identities underrepresented in biomedical science, including Alaska Native, low-income, first generation college, and rural. Geographic isolation defines these communities and can limit the exposure of students to scientifically-minded peers, professional role models, and science career pathways. However these students also have a particularly strong environmental connection through subsistence and recreational activities, which makes the one-health approach to bio-medicine an intuitive and effective route for introducing scientific research and STEM content. In RASOR, we will implement place-based mentored research projects with students in rural Alaskan communities at the high school level, when most students are beginning to seriously consider career paths. The biomedical one-health approach will build connections between student experiences of village life in rural Alaska and biomedical research. Engaging undergraduate students in research has proved one of the most successful means of increasing the persistence of minority students in science (Kuh 2008). Furthermore, RASOR will integrate high school students into community-based participatory research (Israel et al. 2005). This approach is designed to demonstrate the practicality of scientific research, that science has the ability to support community and cultural priorities and to provide career pathways for individual community members. The one-health approach will provide continuity with BLaST, an NIH-funded BUILD program that provides undergraduate biomedical students with guidance and support. RASOR will work closely with BLaST, implementing among younger (pre-BLaST) students approaches that have been successful for retaining rural Alaska students along STEM pathways and tracking of post-RASOR students. Alaska Native and rural Alaska students are a unique and diverse population underrepresented in biomedical science and STEM fields.
Recognizing that race can influence African American youths' perception of which academic disciplines and careers are available to them, this pilot study will explore how African American youths' physical and social communities can be leveraged to support the evolution of their STEM identity and their ability to recognize their potential as scientists. Unfortunately, many of these youths live in communities that are void of critical resources that research has demonstrated time and time again are critical for success in STEM disciplines and careers. This lived reality for many African American youth is the direct result of long-standing disparities in access and opportunities, fueled by racial socialization and biased institutional structures. This pilot will empower youth to recognize these disparities and use science to provide solutions. One perilous societal disparity experienced in many predominately African American communities is the lack of access to fresh produce and healthy food. As a mechanism for potential resolution, this project will consider the utility of community gardens to address this important community need and as a strategy to engage youth in STEM content and skill development. While this notion is not novel to NSF, the intent to utilize an augmented reality (AR) storytelling platform for data collection and project experiences is innovative. This technology will also provide a space for participants to share their work with each other and their broader communities. To our knowledge, this pioneering approach has not been previously piloted in this context. In addition, the pilot will engage multiple youth serving community-based organizations such as park and recreation centers and faith-based organizations in this work, which is also innovative. This is significant, as youth serving community-based organizations are often play important role in the social, educational, and cultural lives of youth and their families in communities. These organizations are often at the heart of the community, figuratively and literally. If successful, this pilot could be transformative and provide a strong basis to support similar work in other communities.
Over the two-year project duration, eighty African American youth ages 11 -14 will participate in the year-long program, across three youth-serving, community-based organizations at four sites. They will be exposed to relevant agricultural, geological, engineering and technological content through a newly developed curriculum called "Cultivating My Curriculum." Community mentors and undergraduate role models will facilitate the instruction and hands-on experiences in the garden and with the AR platform. A capstone event will be a held for the participants and community to convene to learn more about the results of the pilot and share recommendations with community leaders for improving the disparities identified during the pilot. The research component will focus on: (a) the impact of the sociocultural theoretical framework grounding the work on youths' STEM identities, (b) the integration of the AR tool, and (c) mentorship. Formative and summative evaluation will take place through focus groups, surveys, journals, and youth storytelling. Ultimately, the project endeavors to advance the narrative that African Americans are scientists and that science can be used to improve the lives of African Americans and other groups challenged by structural and racial disparities.
This pilot study is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Harrison PinckneyDavid BoyerBarry GarstDilrukshi Thavarajah
This NSF INCLUDES Design and Development Launch Pilot, "Expanding Diversity in Energy and Environmental Sustainability (EDEES)", will develop a network of institutions in the United States mid-Atlantic region to recruit, train, and prepare a significant number of underrepresented, underserved, and underprivileged members of the American society in the areas of alternative energy generation and environmental sustainability. Researchers from Delaware State University (DSU) will lead the effort in collaboration with scientists and educators from the University of Delaware, Delaware Technical Community College, University of Maryland, and Stony Brook University. The program comprises a strong educational component in different aspects of green energy generation and environmental sciences including the development of a baccalaureate degree in Green Energy Engineering and the further growth of the recently established Renewable Energy Education Center at our University. The program comprises an active involvement of students from local K-12 institutions, including Delaware State University Early College High School. The character of the University as a Historically Black College (HBCU) and the relatively high minority population of the region will facilitate the completion of the goal to serve minority students. The program will also involve the local community and the private sector by promoting the idea of a green City of Dover, Delaware, in the years to come.
The goal of EDEES-INCLUDES pilot comprises the enrollment of at least twenty underrepresented minority students in majors related to green energy and environmental sustainability. It also entails the establishment of a baccalaureate degree in Green Energy Engineering at DSU. The program is expected to strengthen the pathway from two-year energy-related associate degree programs to four-year degrees by ensuring at least five students/year transfer to DSU in energy-related programs. The pilot is also expected to increase the number of high school graduates from underrepresented groups who choose to attend college in STEM majors. Based on previous experience and existing collaborations, the partner institutions expect to grow as an integrated research-educational network where students will be able to obtain expertise in the competitive field of green energy. The pilot program comprises a deep integration of education and research currently undergoing in the involved institutions. In collaboration with its partner institutions, DSU plans to consistently and systematically involve students from the K-12 system to nurture the future recruitment efforts of the network. A career in Green Energy Engineering is using and expanding up existing infrastructure and collaborations. The program will involve the local community through events, workshops and open discussions on energy related fields using social networks and other internet technology in order to promote energy literacy.
DATE:
-
TEAM MEMBERS:
Aristides MarcanoMohammed KhanGulnihal OzbayGabriel Gwanmesia
The University of Guam (UOG) NSF INCLUDES Launch Pilot project, GROWING STEM, addresses the grand challenge of increasing Native Pacific Islander representation in the nation's STEM enterprise, particularly in environmental sciences. The project addresses culturally-relevant and place-based research as the framework to attract, engage, and retain Native Pacific Islander students in STEM disciplines. The full science, technology, engineering and mathematics (STEM) pathway will be addressed from K-12 to graduate studies with partnerships that include the Guam Department of Education, Humatak Community Foundation, Pacific Post-Secondary Education Council, the Guam Science and Discovery Society, the Society for the Advancement of Chicanos/Hispanics and Native Americans in Science (SACNAS) and the University of Alaska-Fairbaanks. As the project progresses, the project anticipates further partnerships with the current NSF INCLUDES Launch Pilot project at the University of the Virgin Islands.
Pilot activities include summer internships for high school students, undergraduate and graduate research opportunities through UOG's Plant Nursery and the Humatak Community Foundation Heritage House. STEM professional development activities will be offered through conference participation and student research presentations in venues such as the Guam Science and Discovery Society's Guam Island-wide Science Fair and SACNAS. Faculty will be recruited to develop a mentoring protocol for the project participants. Community outreach and extension services will expand public understanding in environmental sciences from the GROW STEM project. Project metrics will include monitoring the diversity of partners, increases in community engagement, Native Pacific Islander participation in STEM activities, the number of students who desire to attain terminal STEM degrees and the number of community members reached by pilot STEM extension and outreach activities. Dissemination of the GROWING STEM pilot project results will occur through the NSF INCLUDES National Network, partner annual conferences, and local, regional and national STEM conferences.
DATE:
-
TEAM MEMBERS:
John PetersonCheryl SanguezaElse DemeulenaereAustin Shelton
This project is a Design and Development Launch Pilot (DDLP) of the NSF INCLUDES program. The goal of the project is to enhance the knowledge and applicability of science, technology, engineering, and mathematics (STEM) for a broad cross-section of people living in the U.S,-Affiliated Pacific Islands. The focus will be on water resources, which is an extremely important topic for this region and equally relevant nationally. The project will engage local community groups and schools in water monitoring, sampling, and analysis, in order to promote the benefits of science education and careers among a population that is underrepresented in these areas. Moreover, the project will improve the capabilities of the island residents for making decisions about sustainable use and protection of these scarce resources. A functioning network will be established among the islands that will have a positive impact on the health and well-being of the residents.
This project will use water as a highly relevant topic in order to involve a wide range of individuals in both general STEM learning and the basic scientific principles as applied to water resources. Specific aspects include engaging K-12, higher education, informal educators and community members to manage water resources in a sustainable fashion that will reduce disaster risk. In addition, the project will empower local communities through water literacy to make better informed, evidence-based decisions that balance the needs of diverse stakeholder groups. The overarching goal is to further advance the inclusion of underrepresented learners in STEM fields. Benefits to society will accrue by: increasing STEM learning opportunities for ~6,500 students from underserved and underrepresented Indigenous Pacific Islanders that will enhance their eligibility for STEM careers; building community resiliency through a collective impact network to resolve emerging water crises; and fostering collaboration among different constituencies in remote communities to make better-informed decisions that reflect the needs and constraints of diverse interests.