In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Since 2006, the National High Magnetic Field Laboratory (MagLab) through the Center for Integrating Research and Learning (CIRL) has offered a SciGirls Summer Camp to introduce middle school girls to various fields of science. Code: SciGirls was created in 2017 to increase the engagement in computer science studies and career paths for girls. This consistent commitment to girls in STEM led the SciGirls creators at Twin Cities Public Television (TPT) to invite CIRL to be a partner with them. In the summer of 2021, CIRL & TPT
This poster was presented at the 2021 National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) Awardee Meeting.
The goal of this two-year project is to examine systemic issues within learning spaces and provide educators with anti-racist approaches that validate and uplift Black learners. Through a combination of media, educator and role model professional development, and intentional outreach, Black SciGirls will create more gender-equitable and anti-racist informal STEM learning environments for Black girls.
DATE:
TEAM MEMBERS:
Rita KarlAdrienne StephensonLataisia JonesRonda Taylor BullockAngel Miles NashJohnavae Campbell
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Background. STEM identity has emerged as an important research topic and a predictor of how youth engage with STEM inside and outside of school. Although there is a growing body of literature in this area, less work has been done specific to engineering, especially in out-of-school learning contexts.
Methods. To address this need, we conducted a qualitative investigation of five adolescent youth participating in a four-month afterschool engineering program. The study focused on how participants negotiated engineering-related identities through ongoing interactions with activities, peers
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm Knight Williams, Inc. administered an online survey to educators from 16 SciGirls CONNECT2 partner organizations to gather information about their anticipated use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the original SciGirls Seven strategies – to complete the survey about the draft updated strategies after they were shared by TPT in March 2018 via an online webinar and a
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed