In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
The Field Museum of Natural History will present “Changing Face of Science,” an exhibition series targeting pre-teens and teenagers and featuring Field Museum scientists and science educators who are women or people of color. Over three years, the museum will mount six exhibitions that highlight the experiences and work of museum scientists from diverse backgrounds in a range of disciplines. Programming will include on-site field trips and virtual events during which students and educators will interact with featured researchers. By presenting the stories of individuals from groups traditionally underrepresented in scientific fields, the museum will provide role models who will show that science is accessible and inspire a diverse group of future scientists.
RK&A conducted prototype testing for the Game Changers exhibition with three audiences: adults, female youth 10-17 years old, and male youth 13-14 years old. The Game Changers exhibition is being developed by the Lemelson Center for the Study of Invention and Innovation at the National Museum of American History.
The Da Vinci Science Center will expand its Women in Science and Engineering Network by partnering with community organizations, colleges, and universities to enhance the STEM learning and support ecosystem for women and girls in the Lehigh Valley and surrounding communities in eastern Pennsylvania. The museum will assess the needs of K-12 girls, undergraduate women, and women in STEM employment, and map opportunities for cross-sector collaborations to support them. The project team will identify marketing and recruitment messages that encourage STEM-interested girls and women to participate in programs and follow developmental pathways within a STEM learning ecosystem. Based on identified needs and messages, the museum will pilot and evaluate new STEM programs for girls and women, and train educators and mentors to sustain this work.
Identity development frameworks provide insight into why and to what extent individuals engage in STEM related activities. While studies of “STEM identity” often build off previously validated disciplinary and/or science identity frameworks, quantitative analyses of constructs that specifically measure STEM identity and its antecedents are scarce, making it challenging for researchers or practitioners to apply a measurement-based perspective of participation in opportunities billed as “STEM.” In this study, we tested two expanded structural equation models of STEM identity development
An individual's sense of themselves as a “STEM person” is largely formed through recognition feedback. Unfortunately, for many minoritized individuals who engage in STEM (science, technology, engineering, and mathematics) in formal and informal spaces, this recognition often adheres to long-standing exclusionary expectations of what STEM participation entails and institutionalized stereotypes of what it means to be a STEM person. However, caregivers, who necessarily share cultural backgrounds, norms, and values with their children, can play an important role in recognizing their children's
DATE:
TEAM MEMBERS:
Heidi CianRemy DouSheila CastroElizabeth Palma-D'souzaAlexandra Martinez
The U.S. urgently needs the perspective and knowledge of females who are Latinx and African American in STEM fields. Providing early STEM interest pathways for these populations that are historically underrepresented in STEM fields is critical to creating gender equity in the STEM workforce. There are profound inequities in STEM fields for women of color that impact their interest and persistence in these fields. This Research in Service to Practice project will build important knowledge about early pathways for reducing these inequities by developing early interest in STEM. Gender stereotypes around who can do STEM are one of the sociocultural barriers that contributes to girls’ loss of interest in STEM. These stereotypes emerge early and steer young women away from STEM studies and pursuits. Exposing girls to role models is an effective strategy for challenging stereotypes of who belongs and succeeds in STEM. This project will explore how an afterschool program that combines narrative and storytelling approaches, STEM role models, and family supports, sparks elementary-age girls’ interest in STEM and fosters their STEM identity. The project targets K-5 students and families from underrepresented groups (e.g., Latinx and African American) living in poverty. The project will evaluate an inquiry-based, afterschool program that serves both elementary school girls and boys and explores if adding storytelling components to the out-of-school time (OST) learning will better support girls’ interest in STEM. The storytelling features include: 1) shared reading of books featuring females in STEM; 2) students’ own narratives that reminisce about their STEM experiences; and 3) video interviews of female parents and community members with STEM careers. A secondary aim of this project is to build capacity of schools and afterschool providers to deliver and sustain afterschool STEM enrichment experiences. Museum-based informal STEM experts will co-teach with afterschool providers to deliver the Children’s Museum Houston (CMH) curriculum called Afterschool Science, Technology, Engineering, Arts and Math (A’STEAM). Although A’STEAM has been implemented in over 100 sites and shows promise, to scale-up this and other promising afterschool programs, the team will evaluate how professional development resources and the co-facilitation approach can build afterschool educators' capacity to deliver the most promising approaches.
Researchers at the Children’s Learning Institute (CLI) at UTHealth will partner with Museum-based informal STEM educators at CMH, YES Prep, a high performing charter school serving >95% of underrepresented groups, and other afterschool providers serving mostly underrepresented groups experiencing poverty. Storytelling components that highlight females in STEM will be added to an existing afterschool program (A'STEAM Basic). This derivative program is called A’STEAM Stories. Both instantiations of the afterschool programs (Basic and Stories) include an afterschool educator component (ongoing professional development and coaching), a family component (e.g., home extension activities, in-person, and virtual family learning events), and two age-based groups (K-G2 and G3-G5). Further, the A’STEAM Stories professional development for educators includes training that challenges STEM gender stereotypes and explains how to make science interesting to girls. The 4-year project has four phases. In Phase 1, researchers, CMH, and afterschool educators will adapt the curriculum for scalability and the planned storytelling variation. During Phase 2, the research team will conduct an experimental study to evaluate program impacts on increasing STEM interest and identity and reducing STEM gender stereotypes. To this end, the project’s team will recruit 36 sites and 1200 children across Kindergarten through Grade 5. This experimental phase is designed to produce causal evidence and meet the highest standards for rigorous research. The researchers will randomly assign sites to one of three groups: control, A’STEAM Basic, or A’STEAM Stories. During Phase 3, researchers will follow-up with participating sites to understand if the inclusion of afterschool educators as co-facilitators of the program allowed for sustainability after Museum informal science educator support is withdrawn. In Phase 4, the team will disseminate the afterschool curriculum and conduct two training-of-trainers for local and national afterschool educators. This study uses quantitative and qualitative approaches. Data sources include educator and family surveys, focus groups, and interviews as well as observations of afterschool program instructional quality and analysis of parent-child discourse during a STEM task. Constructs assessed with children include STEM interest, STEM identity, and STEM gender stereotype endorsement as well as standardized measures of vocabulary, science, and math. Findings will increase understanding of how to optimize OST STEM experiences for elementary-age girls and how to strengthen STEM interest for all participants. Further, this project will advance our knowledge of the extent to which scaffolded, co-teaching approaches build capacity of afterschool providers to sustain inquiry-based STEM programs.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
Exhibit Design for Girls’ Engagement (EDGE) began as an NSF-funded research project led by the Exploratorium to learn how science museums can better engage girls aged 8–13 with STEM exhibits. Over the course of the research, we identified nine design attributes that were consistently positively related to girls’ engagement with these exhibits. The Exploratorium then went on a three-year journey funded by the Gordon & Betty Moore Foundation to explore ways to fold the EDGE design attributes into our exhibits, with a focus on existing exhibits. This was an exciting opportunity to put the EDGE
With support from the National Science Foundation, the STEM Effect project was undertaken in partnership by staff from the Education Development Center, the National Girls Collaborative Project (NGCP) and the Intrepid Sea, Air & Space Museum. Through a variety of methods, the project convened representatives from cultural institutions (museums, science centers, zoos, botanical gardens and aquaria) from across the country which provide STEM programming aimed at increasing the participation of girls and women in science, technology, engineering and mathematics (STEM), along with researchers, and