This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Green Bank Observatory organized a community workshop on research experiences for high school students in disciplines supported by NSF’s Directorate for Mathematical and Physical Sciences (MPS). The workshop was intended as a forum for sharing, gathering community input, and illuminating best practices in providing research experiences to high school students and organizing such research activities across universities, labs, and observatories. The input gathered from the workshop may be useful to others wanting to support K-12 research activities.
It is often stated that solving the global challenges presented by the 21st century requires a United States workforce with training in STEM fields, and that the STEM workforce may be insufficient to fill that need. Education research literature in STEM suggests that engaging students early and often in authentic research experiences enhances STEM identity, STEM self-efficacy, and STEM career interest: three personal attributes that are linked to entry into and persistence on a STEM career pathway. Much of this literature is focused on college students, however. This workshop convened people and organizations who have designed and implemented research experiences for high school students, and who will examine the role such experiences can play in the development of a student’s interest and STEM identity.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
The Montana Natural History Center, in collaboration with the University of Montana, will develop an exhibit to showcase a selection of the university's extensive fossil collection. This new exhibit will help create inclusive, inquiry-based, educational opportunities for preschoolers through adults. University faculty will guide specimen interpretation and story development. The exhibit will explore modern research into evolution in a time of climate change, sharing ongoing university research and highlighting STEM careers and citizen science work. The project is based on interests identified through surveys, museum visitor recommendations, and a member focus group.
DATE:
-
TEAM MEMBERS:
Drew Lefebvre
resourceevaluationProfessional Development, Conferences, and Networks
This report presents summative evaluation results for a National Science Foundation funded project entitled Grounding Institutional Partnerships in Structures for Broader Impacts Design (BID). The project represents a collaboration between five institutions: Institute for Learning Innovation, The STEM Research Center at Oregon State University, Scicenter, University of Washington-Bothell, and University of Wisconsin-Madison. BID aimed at creating an inter-institutional structure and toolkit to assist higher education institutions (HEIs) and informal science education organizations (ISEs) in
An independent evaluator and a group of investigators from three AISL projects focused on public engagement with science (PES) collaborated on a paper about research-practice partnerships for PES. This two-page brief summarizes their key points.