Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This Innovations in Development project explores radical healing as an approach to create after-school STEM programming that welcomes, values and supports African American youth to form positive STEM identities. Radical healing is a strength-based, asset centered approach that incorporates culture, identity, civic action, and collective healing to build the capacity of young people to apply academic knowledge for the good of their communities. The project uses a newly developed graphic novel as a model of what it looks like to engage in the radical healing process and use STEM technology for social justice. This graphic novel, When Spiderwebs Unite, tells the true story of an African American community who used STEM technology to advocate for clean air and water for their community. Youth are supported to consider their own experiences and emotions in their sociopolitical contexts, realize they are not alone, and collaborate with their community members to take critical action towards social change through STEM. The STEM Club activities include mentoring by African American undergraduate students, story writing, conducting justice-oriented environmental sciences investigations, and applying the results of their investigations to propose and implement community action plans. These activities aim to build youth’s capacity to resist oppression and leverage the power of STEM technology for their benefit and that of their communities.
Clemson University, in partnership with the Urban League of the Upstate, engages 100 predominantly African American middle school students and 32 African American undergraduate students in healing justice work, across two youth-serving, community-based organizations at three sites. These young people assume a leadership role in developing this project’s graphic novel and curriculum for a yearlong, after-school STEM Club, both constructed upon the essential components of radical healing. This project uses a qual→quant parallel research design to investigate how the development and use of a graphic novel could be used as a healing justice tool, and how various components of radical healing (critical consciousness, cultural authenticity, self knowledge, radical hope, emotional and social support, and strength and resilience) affect African American youths’ STEM identity development. Researchers scrutinize interviews, field observations, and project documents to address their investigation and utilize statistical analyses of survey data to inform and triangulate the qualitative data findings. Thus, qualitative and quantitative data are used to challenge dominant narratives regarding African American youth’s STEM achievements and trajectories. The project advances discovery and understanding of radical healing as an approach to explicitly value African Americans’ cultures, identities, histories, and voices within informal STEM programming.
DATE:
-
TEAM MEMBERS:
Renee LyonsRhondda ThomasCorliss Outley
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Do you want to implement projects and develop strong collaborations in diverse or “underserved” communities? This workbook is a product of research conducted by community-based organizations and the Cornell Lab of Ornithology over three years, focused on how to create equitable partnerships between informal science institutions and community-based organizations in underrepresented communities. The objective is to improve equity, diversity, and inclusion in STEM (Science, Technology, Engineering, and Mathematics). The research comes from questions asked by community researchers to more than 30
The Apsáalooke (Crow Indian) Nation in Montana, as well as other Indigenous communities across the United States, disproportionally experience negative consequences from water-related environmental hazards, such as contaminated water. In this project, fifth- and sixth-grade Apsáalooke youth will act as change agents through investigating water issues in their communities and presenting findings to their communities. They will conduct this water-related research in the context of an informal summer program designed to integrate Indigenous and Western perspectives on science. For example, youth will learn the cultural significance of water sites while also practicing methods for collecting and analyzing data relative to those sites, guided by Apsáalooke elders and science professionals. During the summer program, Indigenous high school students and tribal college students will mentor the youth. To develop this program, the project team will conduct interviews with elders and Apsáalooke community members in scientific fields to determine the desired features of a program that integrates Indigenous and Western science. They will use the findings from these interviews to develop a multimedia toolkit, which includes a set of comprehensive materials that will enable other researchers and informal educators to implement similar programs. This toolkit will include information about water science and water quality, lesson plans and related resources for the summer program, professional development materials to prepare the high school youth to act as mentors, handouts for family members to facilitate at-home engagement with their children, and more. The project team will research how the implementation of the toolkit influences the participants' water-related knowledge and attitudes toward science. The toolkit, and the associated empirical findings, will be disseminated widely through local, regional, and national professional networks that serve American Indians.
Montana State University, in partnership with Little Big Horn College, will implement and research an informal summer program for Apsáalooke youth in the fifth and sixth grades, as well as a mentorship program for Indigenous high school students and tribal college students. The older students will participate in a four-week internship program in which they learn about conducting water research and facilitating science activities that foreground Apsáalooke perspectives and cultural practices. The high school and tribal college students will partner with Apsáalooke elders and science professionals to facilitate and implement a two-week summer program for the fifth- and sixth-grade youth. This program will use the toolkit materials that were previously developed in consultation with elders and other community stakeholders. Regression analyses of validated pre- and post-surveys, as well as inductive analyses of interviews with stakeholders, will be used to study how the mentoring program affects the high school and tribal college students' attitudes toward science and career interests, and how the summer program affects the fifth- and sixth-graders' water-related knowledge. The research team will also study how youth participation in the program affects their family and community members' water-related knowledge. This project will result in a multimedia toolkit, freely available to the public and widely disseminated through professional networks, which specifies how other informal educators and researchers can implement similar mentorship programs and summer programs for Indigenous youth. Ultimately, this project will broaden participation through resulting in empirically-tested materials that advance practice in informal education for Indigenous youth and their communities. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (science, technology, engineering, and mathematics) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck