This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Informal STEM learning experiences (ISLEs), such as participating in science, computing, and engineering clubs and camps, have been associated with the development of youth’s science, technology, engineering, and mathematics interests and career aspirations. However, research on ISLEs predominantly focuses on institutional settings such as museums and science centers, which are often discursively inaccessible to youth who identify with minoritized demographic groups. Using latent class analysis, we identify five general profiles (i.e., classes) of childhood participation in ISLEs from data
DATE:
TEAM MEMBERS:
Remy DouHeidi CianZahra HazariPhilip SadlerGerhard Sonnert
The project team published a research synopsis article with Futurum Science Careers in Feb 2023 called “How Can Place Attachment Improve Scientific Literacy?”
The Green Bank Observatory organized a community workshop on research experiences for high school students in disciplines supported by NSF’s Directorate for Mathematical and Physical Sciences (MPS). The workshop was intended as a forum for sharing, gathering community input, and illuminating best practices in providing research experiences to high school students and organizing such research activities across universities, labs, and observatories. The input gathered from the workshop may be useful to others wanting to support K-12 research activities.
It is often stated that solving the global challenges presented by the 21st century requires a United States workforce with training in STEM fields, and that the STEM workforce may be insufficient to fill that need. Education research literature in STEM suggests that engaging students early and often in authentic research experiences enhances STEM identity, STEM self-efficacy, and STEM career interest: three personal attributes that are linked to entry into and persistence on a STEM career pathway. Much of this literature is focused on college students, however. This workshop convened people and organizations who have designed and implemented research experiences for high school students, and who will examine the role such experiences can play in the development of a student’s interest and STEM identity.
Gateway to Science will partner with the University of Mary Early Childhood Education Program to develop interpretive materials for a new Science First exhibition. Science First will serve young children up to age 5 and their parents, caregivers, and educators. It will increase adults’ knowledge and confidence to facilitate children’s science learning experiences in their daily lives. Adult visitors will gain an increased understanding of how children learn science. The program will equip them to engage young children in science inquiry and to build 21st century skills.
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This Innovations in Development project explores radical healing as an approach to create after-school STEM programming that welcomes, values and supports African American youth to form positive STEM identities. Radical healing is a strength-based, asset centered approach that incorporates culture, identity, civic action, and collective healing to build the capacity of young people to apply academic knowledge for the good of their communities. The project uses a newly developed graphic novel as a model of what it looks like to engage in the radical healing process and use STEM technology for social justice. This graphic novel, When Spiderwebs Unite, tells the true story of an African American community who used STEM technology to advocate for clean air and water for their community. Youth are supported to consider their own experiences and emotions in their sociopolitical contexts, realize they are not alone, and collaborate with their community members to take critical action towards social change through STEM. The STEM Club activities include mentoring by African American undergraduate students, story writing, conducting justice-oriented environmental sciences investigations, and applying the results of their investigations to propose and implement community action plans. These activities aim to build youth’s capacity to resist oppression and leverage the power of STEM technology for their benefit and that of their communities.
Clemson University, in partnership with the Urban League of the Upstate, engages 100 predominantly African American middle school students and 32 African American undergraduate students in healing justice work, across two youth-serving, community-based organizations at three sites. These young people assume a leadership role in developing this project’s graphic novel and curriculum for a yearlong, after-school STEM Club, both constructed upon the essential components of radical healing. This project uses a qual→quant parallel research design to investigate how the development and use of a graphic novel could be used as a healing justice tool, and how various components of radical healing (critical consciousness, cultural authenticity, self knowledge, radical hope, emotional and social support, and strength and resilience) affect African American youths’ STEM identity development. Researchers scrutinize interviews, field observations, and project documents to address their investigation and utilize statistical analyses of survey data to inform and triangulate the qualitative data findings. Thus, qualitative and quantitative data are used to challenge dominant narratives regarding African American youth’s STEM achievements and trajectories. The project advances discovery and understanding of radical healing as an approach to explicitly value African Americans’ cultures, identities, histories, and voices within informal STEM programming.
DATE:
-
TEAM MEMBERS:
Renee LyonsRhondda ThomasCorliss Outley
Access & opportunity in STEM remain limited for youth from historically underrepresented backgrounds in the US & UK. We present findings grounded in Participatory Ethnographies into STEM pathways, highlighting how youth participate in ISL across time and settings in equitable and transformative ways, and practices that ISL practitioners engage in towards supporting pathway authoring. We take a pathways lens to highlight the multiple directions one may take through a particular ecology towards a wide range of outcomes beyond the STEM career, such as STEM agency and identities. Our study