In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
Making as a term has gained attention in the educational field. It signals many different meanings to many different groups, yet is not clearly defined. This project’s researchers refer to making as a term that bears social and cultural impact but with a broader more sociocultural association than definitions that center making in STEM learning. Using the theoretical lenses of critical relationality and embodiment, our research team position curriculum as a set of locally situated activities that are culturally, linguistically, socially, and politically influenced. We argue that curriculum
DATE:
TEAM MEMBERS:
Veronica OguilveWen WenEm BowenYousra AbourehabAmanda BermudezElizabeth GaxiolaJill Castek
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
resourceresearchProfessional Development, Conferences, and Networks
This poster was presented at the 2021 National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) Awardee Meeting.
The goal of this two-year project is to examine systemic issues within learning spaces and provide educators with anti-racist approaches that validate and uplift Black learners. Through a combination of media, educator and role model professional development, and intentional outreach, Black SciGirls will create more gender-equitable and anti-racist informal STEM learning environments for Black girls.
DATE:
TEAM MEMBERS:
Rita KarlAdrienne StephensonLataisia JonesRonda Taylor BullockAngel Miles NashJohnavae Campbell
The U.S. urgently needs the perspective and knowledge of females who are Latinx and African American in STEM fields. Providing early STEM interest pathways for these populations that are historically underrepresented in STEM fields is critical to creating gender equity in the STEM workforce. There are profound inequities in STEM fields for women of color that impact their interest and persistence in these fields. This Research in Service to Practice project will build important knowledge about early pathways for reducing these inequities by developing early interest in STEM. Gender stereotypes around who can do STEM are one of the sociocultural barriers that contributes to girls’ loss of interest in STEM. These stereotypes emerge early and steer young women away from STEM studies and pursuits. Exposing girls to role models is an effective strategy for challenging stereotypes of who belongs and succeeds in STEM. This project will explore how an afterschool program that combines narrative and storytelling approaches, STEM role models, and family supports, sparks elementary-age girls’ interest in STEM and fosters their STEM identity. The project targets K-5 students and families from underrepresented groups (e.g., Latinx and African American) living in poverty. The project will evaluate an inquiry-based, afterschool program that serves both elementary school girls and boys and explores if adding storytelling components to the out-of-school time (OST) learning will better support girls’ interest in STEM. The storytelling features include: 1) shared reading of books featuring females in STEM; 2) students’ own narratives that reminisce about their STEM experiences; and 3) video interviews of female parents and community members with STEM careers. A secondary aim of this project is to build capacity of schools and afterschool providers to deliver and sustain afterschool STEM enrichment experiences. Museum-based informal STEM experts will co-teach with afterschool providers to deliver the Children’s Museum Houston (CMH) curriculum called Afterschool Science, Technology, Engineering, Arts and Math (A’STEAM). Although A’STEAM has been implemented in over 100 sites and shows promise, to scale-up this and other promising afterschool programs, the team will evaluate how professional development resources and the co-facilitation approach can build afterschool educators' capacity to deliver the most promising approaches.
Researchers at the Children’s Learning Institute (CLI) at UTHealth will partner with Museum-based informal STEM educators at CMH, YES Prep, a high performing charter school serving >95% of underrepresented groups, and other afterschool providers serving mostly underrepresented groups experiencing poverty. Storytelling components that highlight females in STEM will be added to an existing afterschool program (A'STEAM Basic). This derivative program is called A’STEAM Stories. Both instantiations of the afterschool programs (Basic and Stories) include an afterschool educator component (ongoing professional development and coaching), a family component (e.g., home extension activities, in-person, and virtual family learning events), and two age-based groups (K-G2 and G3-G5). Further, the A’STEAM Stories professional development for educators includes training that challenges STEM gender stereotypes and explains how to make science interesting to girls. The 4-year project has four phases. In Phase 1, researchers, CMH, and afterschool educators will adapt the curriculum for scalability and the planned storytelling variation. During Phase 2, the research team will conduct an experimental study to evaluate program impacts on increasing STEM interest and identity and reducing STEM gender stereotypes. To this end, the project’s team will recruit 36 sites and 1200 children across Kindergarten through Grade 5. This experimental phase is designed to produce causal evidence and meet the highest standards for rigorous research. The researchers will randomly assign sites to one of three groups: control, A’STEAM Basic, or A’STEAM Stories. During Phase 3, researchers will follow-up with participating sites to understand if the inclusion of afterschool educators as co-facilitators of the program allowed for sustainability after Museum informal science educator support is withdrawn. In Phase 4, the team will disseminate the afterschool curriculum and conduct two training-of-trainers for local and national afterschool educators. This study uses quantitative and qualitative approaches. Data sources include educator and family surveys, focus groups, and interviews as well as observations of afterschool program instructional quality and analysis of parent-child discourse during a STEM task. Constructs assessed with children include STEM interest, STEM identity, and STEM gender stereotype endorsement as well as standardized measures of vocabulary, science, and math. Findings will increase understanding of how to optimize OST STEM experiences for elementary-age girls and how to strengthen STEM interest for all participants. Further, this project will advance our knowledge of the extent to which scaffolded, co-teaching approaches build capacity of afterschool providers to sustain inquiry-based STEM programs.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Increasing greater diversity, equity, and inclusion in science not only presents a social justice goal, but is also vital to the financial and social success of the nation. The stereotype of the older white male scientist has obscured the contributions of women and people of color. This project seeks to remedy these perceptions which are barriers to entry into STEM fields. The project will create a large-scale hub for STEM themed video content on YouTube and other social media platforms, featuring 100+ original STEM videos produced by PBS partners. This hub and accompanying research seeks to identify the characteristics of online STEM content that attract (or fail to attract) underrepresented groups, specifically Black and Hispanic communities as well as women of all races. The objectives of this project are to 1) provide a unified online science-themed hub, PBS Terra, on YouTube and other platforms for hosting, sharing, and distributing digital STEM series from diverse producers from across the PBS system; 2) conduct surveys and focus groups to examine and understand the needs and expectations of women, Black and Hispanic communities and their consumption of STEM video content online and 3) test hypotheses about the communicative strategies of STEM videos that feature Black and Hispanic female scientists. Project collaborators include PBS, researchers at the University of Utah and the University of Georgia, and consultants and advisors with expertise in broadening participation and inclusion in STEM.
Little is known about how or why adult Americans seek science content on YouTube, especially the motivations of adults from underrepresented minorities and females. The key research questions in this project are: 1) Why do Black and Hispanic audiences and women of all races seek science video content online? 2) How does showing Black and Hispanic female scientists in science video content on YouTube impact viewers’ identification with and sense of belonging in STEM? 3) How does the use of humor by Black and Hispanic scientists in YouTube science content affect viewers’ perceptions of the communicator and their engagement with STEM content? 4) How does the appearance and manner of dress of Black and Hispanic scientists in YouTube science content affect viewers’ perceptions in the aforementioned areas? A nationally representative baseline survey will be conducted. A probability sample of 2000 respondents will be obtained including oversampling of Black and Hispanic audiences. To complement findings from the survey, focus groups will be conducted in eight different regions of the country to learn why these targeted audiences do or do not seek science content on YouTube and what motivates them to share the content with their social media network. In addition, an experiment embedded in an online survey will test the hypothesis that greater on-screen representation of women and scientists of color will broaden existing perceptions about scientists. The experiment will consist of a 3 (scientist’s race: Black/Hispanic/White) × 2 (science issue: controversial/non-controversial) × 2 (style: casual/professional) between-subjects design. Survey participants will be randomly assigned to the experimental conditions. These factors (science issue and host appearance) can be altered by content producers to better reach and engage the targeted audiences. The project not only investigates theoretical questions at the intersection of STEM stereotypes and race, but findings related to these experimental conditions will offer practical insight into strategies that can be used by science communication practitioners.
DATE:
-
TEAM MEMBERS:
Adam DylewskiSara YeoMichael Cacciatore
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.
A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.
This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
This research extends the investigator's prior NSF supported work to develop theoretical and empirical understanding of the double bind faced by women of color in STEM fields. That is, their race and gender present dual dilemmas as they move through STEM educational and career paths. The proposed study will identify gaps in our understanding, and identify some of the methodological problems associated with answering outstanding questions about the double bind. The major research question is: What strategies work to enable women of color to achieve higher levels of advancement in STEM academia and professions? The goal is to bring a clearer understanding of the issues which confront women of color as they pursue study of science and engineering, and what factors influence whether they leave or remain in STEM.
The work will employ a highly structured narrative analysis process to identify and quantify factors that have been successful in broadening the participation of minority women in STEM. The research design involves two separate tracks of work: 1) to conduct narrative analysis of primary documents associated with women of color in science; and 2) to conduct site visits and interviews to understand features of programs associated with successful support of women of color in undergraduate and graduate education. The first part is designed to inform the second, with the narrative analysis helping to identify features to look for in site visits and to use in development of interview protocols.
This research will focus on individual and programmatic factors that sustain women of color as they confront barriers to their career goals. It examines institutional strategies and support structures that help women of color ultimately to succeed, and social and pedagogic elements that influence their educational experiences. Although women of color have made some progress over the last three decades towards more equitable participation in STEM fields, the major efforts made to address this issue have not produced the desired outcomes; minority women continue to be underrepresented relative to white women and non-minority men. The factors that account for continued lower participation rates are not yet fully understood.
Beyond the Double Bind is designed to transform the intellectual basis for building future programs that will better enable women of color to be successful in STEM. While focused on women of color, the results will ultimately inform strategies and programs to expand the presence of all women and minorities in STEM.