In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The project will develop and research an after-school program designed to engage rural, Latinx youth in design thinking and math through making. Making is a learner-centered environment where participants design, create, and develop projects. Latinx individuals are underrepresented in the STEM workforce. The project will engage Latinx youth during the critical middle school years when young people make choices that affect their futures. The project will work with community members, after school staff, and youth as co-designers to develop and pilot the complete after school program. The program will involve Latinx youth who live in the agricultural regions of the Southwest United States with the goal of developing agency and positive identity, as makers, mathematical doers and users, and active community members. They will engage in developmentally appropriate mathematics, such as the volume and surface area of geometric shapes, within the context of informal learning projects. The program will comprise four semester-long after school projects, involving participants for 2-4 hours each week, during which time youth will design and create objects to address typical community challenges. Each project will incorporate smaller modules to enable youth with different attendance needs to participate. Real community problems (e.g., drought) and solution paths (e.g., water catchment system) will motivate the making and the mathematics. The program, co-designed in partnership with the Cesar Chavez Foundation, promises to reach 100,000 youth over the next decade. Because the program can serve as a model for others with similar goals, this reach has the potential to be expanded in many other communities.
Project research will address a gap in the current literature on mathematics, making, and community membership. The project connects community mathematics—the rich mathematical knowledge and practices drawn from communities—to educational making to both enrich understanding of school mathematics and aid in developing students’ positive mathematical and cultural identities. The project will also result in a model of professional development that can be used and studied by after school programs and researchers, contributing to the limited body of knowledge of professional development on STEM making for after school facilitators. The research design for this project will follow a mixed methods approach where quantitative and qualitative data collection and analysis will occur simultaneously. Results of both strands will be brought together at the interpretation and reporting level to compare and bring out the convergence, divergence, or complementarity of findings. The research will take place in two stages (co-design and pilot) over 3 years, with an additional half year for developing communications of the findings. Research will address the following questions: (1) What are the key features of projects for integrating community mathematics, school mathematics understanding, and design/making? (2) How do facilitators support the youth in engaging in program activities? (3) What math content and practices do youth learn through participation in program activities? and (4) How do youth’s agency and identity as makers, mathematics doers and users, and community members change with participation in the program? Program research and resources will be disseminated nationally through the Cesar Chavez Foundation and by sharing project research and resources through publications and conference presentations reaching researchers, educators, and program developers.
The Dunes Center will provide in-class instruction and field trip activities focused on coastal restoration and community education on water quality for over 300 5th-graders at Guadalupe’s Kermit McKenzie Intermediate School. Through science experiments and hands-on experiences, students will learn how ecosystems function and explore watershed characteristics. Intended to supplement current local science education and reach underserved, rural, Latinx students, the “Explore the Coast” program will help students understand how human actions can affect the environment, promote pollution prevention in the community, and aspire to higher education in the field of science.
With support from rural communities and their libraries in the Four Corners Region in the Southwestern U.S., We are Water creates a place to meet and share stories about water, and explore and learn about water together. Designed for rural, Indigenous, and Latinx communities, stories, community voices and multiple ways of knowing are highlighted and woven throughout the exhibit and programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Project Harvest is a co-created citizen science project that investigates the quality of household environments in Arizona communities neighboring active or legacy mining and/or toxic release. Project Harvest is a response to the community-driven questions, “Are there pollutants in harvested rainwater? Can I use the harvested rainwater for my garden?"
Communities with the highest risk of climate change impacts may also be least able to respond and adapt to climate change, which highlights a specific need for inclusive Science, Technology, Engineering, and Mathematics (STEM) strategies. This Pilot and Feasibility project builds on the success of US Cooperative Extension Service programs that empower volunteers to conduct outreach in their own communities. It focuses on climate change, and seeks to co-design an informal STEM climate science curriculum, called Climate Stewards, in collaboration with community members from groups often underrepresented in STEM, including indigenous and Latinx communities, as well as rural women. The project is designed to strengthen community awareness as well as prioritize community voices in climate change conversations. The knowledge and skills obtained by Climate Stewards and their communities will allow for more involvement in decisions related to climate adaptation and mitigation in their communities and beyond. After establishing a proof of concept, the project seeks to expand this work to more rural and urban communities, other communities of color, and additional socioeconomically disadvantaged communities.
Grounded in the theory of diffusion of innovation as a means for volunteers to communicate information to members of a social system, this project seeks co-create a retooled Climate Stewards curriculum using inclusive and adaptive strategies. Community collaboration and involvement through new and existing partnerships, focus groups, and meetings will determine what each community needs. During the program design phase, community members can share their concerns regarding climate change as well as the unique characteristics and cultural perspectives that should be addressed. The collaboration between extension and education leverage resources that are important for developing a robust implementation and evaluation process. This project is expected to have a significant influence on local and national programs that are looking to incorporate climate change topics into their programming and/or broaden their reach to underrepresented communities. The hypotheses tested in this project describe how inclusion-based approaches may influence competencies in STEM topics and their impact on communities, specifically willingness to take action. Hypothesis 1: STEM competencies in climate issues increase with interactive and peer learning approaches. Hypothesis 2: Community participation in the co-creation of knowledge about climate change, by integrating their values and objectives into the climate change education program, increases people's motivation to become engaged in climate change adaptation and mitigation strategies.
This Pilot and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Patricia TownsendRoslynn McCannMelissa KreyeArthur Nash
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley