In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
Making as a term has gained attention in the educational field. It signals many different meanings to many different groups, yet is not clearly defined. This project’s researchers refer to making as a term that bears social and cultural impact but with a broader more sociocultural association than definitions that center making in STEM learning. Using the theoretical lenses of critical relationality and embodiment, our research team position curriculum as a set of locally situated activities that are culturally, linguistically, socially, and politically influenced. We argue that curriculum
DATE:
TEAM MEMBERS:
Veronica OguilveWen WenEm BowenYousra AbourehabAmanda BermudezElizabeth GaxiolaJill Castek
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
Communities with the highest risk of climate change impacts may also be least able to respond and adapt to climate change, which highlights a specific need for inclusive Science, Technology, Engineering, and Mathematics (STEM) strategies. This Pilot and Feasibility project builds on the success of US Cooperative Extension Service programs that empower volunteers to conduct outreach in their own communities. It focuses on climate change, and seeks to co-design an informal STEM climate science curriculum, called Climate Stewards, in collaboration with community members from groups often underrepresented in STEM, including indigenous and Latinx communities, as well as rural women. The project is designed to strengthen community awareness as well as prioritize community voices in climate change conversations. The knowledge and skills obtained by Climate Stewards and their communities will allow for more involvement in decisions related to climate adaptation and mitigation in their communities and beyond. After establishing a proof of concept, the project seeks to expand this work to more rural and urban communities, other communities of color, and additional socioeconomically disadvantaged communities.
Grounded in the theory of diffusion of innovation as a means for volunteers to communicate information to members of a social system, this project seeks co-create a retooled Climate Stewards curriculum using inclusive and adaptive strategies. Community collaboration and involvement through new and existing partnerships, focus groups, and meetings will determine what each community needs. During the program design phase, community members can share their concerns regarding climate change as well as the unique characteristics and cultural perspectives that should be addressed. The collaboration between extension and education leverage resources that are important for developing a robust implementation and evaluation process. This project is expected to have a significant influence on local and national programs that are looking to incorporate climate change topics into their programming and/or broaden their reach to underrepresented communities. The hypotheses tested in this project describe how inclusion-based approaches may influence competencies in STEM topics and their impact on communities, specifically willingness to take action. Hypothesis 1: STEM competencies in climate issues increase with interactive and peer learning approaches. Hypothesis 2: Community participation in the co-creation of knowledge about climate change, by integrating their values and objectives into the climate change education program, increases people's motivation to become engaged in climate change adaptation and mitigation strategies.
This Pilot and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Patricia TownsendRoslynn McCannMelissa KreyeArthur Nash
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
Overlaying Computer Science (CS) courses on top of inequitable schooling systems will not move us toward “CS for All.” This paper prioritizes the perspectives of minoritized students enrolled in high school CS classrooms across a large, urban school district in the Western United States, to help inform how CS can truly be for all.
DATE:
TEAM MEMBERS:
Jean RyooTiera TanksleyCynthia EstradaJane Margolis
Free-choice and interest-driven learning activities are a highly significant source of STEM (science, technology, engineering, and mathematics) learning for adults through their lifespans. Gardening is one such activity that is widespread across communities with one in every fifty American adults reporting an interest in gardening/plants and who associate that interest/hobby with science. While the terms interest and hobby are related, the latter refers to something one actively does, not just thinks about doing. Adults who seek out learning and participation opportunities in highly visible community spaces (e.g., gardening clubs, science centers, botanical gardens) are likely to be White and well-educated. Further understanding is needed of when and how community members from other demographic groups access different resources (people, organizations, and places) for information and opportunities, and what influences them to do so. This Pilot and Feasibility Study will explore informal learning networks in Alameda County, California, specifically around gardeners and gardening. Researchers will use surveys, focus groups, and program observations to gather data on how those who pursue self-directed scientific learning about gardening access information. Of interest is how the differential access to and pursuit of information occurs among diverse community members, especially those outside of more established Master Gardener and other organized gardening programs. This research will: 1) contribute to understanding of the resources that interest-driven adult STEM learners access, describing the barriers they perceive and how/if the accessed resources differ by gender, race, or socioeconomics; 2) determine the feasibility of a sampling approach to gather data from individuals in demographic groups who may not have been reached in prior research efforts; and 3) generate insights for informal science education practitioners and researchers about how to better support diverse interest-driven STEM learners. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
It is hypothesized that there is a large percentage of individuals from non-dominant populations engaged in free-choice STEM learning; past efforts have likely under-counted the participation of individuals from these communities. To achieve the research aims the research team will utilize respondent-driven sampling, engaging gardening hobbyists' social contacts to recruit participants, and collect data from diverse (gender, race, socioeconomics) urban gardeners who may be differently connected to STEM learning ecosystem resources/organizations than their highly visible peers. This approach will be used to investigate the behaviors, perceptions, and outcomes related to STEM learning such as development of self-efficacy and science identity. Focus groups will provide context for themes that arise in the survey data and clarify hobbyists' participation preferences and experiences. In situ observations of learning environments comprise the third mechanism for collecting data. All three data sources will support triangulation of results and contribute to the findings. Key outcomes of this project will be to determine if the target population has been reached through the sampling approach, to identify methodological guidelines for sampling with an intent to reach those from populations under-represented in STEM-related free-choice activities, and to clarify which network variables are most useful to study. This research lays the foundation for future work. It is anticipated that the approach developed and tested in this research may be adapted by others in the future and will have the potential to serve as a model for community-based organizations and researchers interested in studying the learning ecosystems of previously hidden populations of participants, including how these individuals perceive and access resources to support their STEM learning.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.