In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
DATE:
TEAM MEMBERS:
Ciera Pagud Rachelle Chauhan
resourceresearchMuseum and Science Center Exhibits
An adapted three-dimensional model of place attachment is proposed as a theoretical framework from which place-based citizen science experiences and outcomes might be empirically examined in depth.
DATE:
TEAM MEMBERS:
Julia ParrishYurong HeBenjamin Haywood
The University of Montana will create “Transforming Spaces” to foster a more inclusive, culturally responsive space for Missoula’s urban Indian population and to better meet the community’s needs. The project will explore cross-cultural, collaborative approaches to STEM and Native Science. In collaboration with Montana’s tribal communities, the museum’s education team and advisory groups will design and implement hands-on activities that engage visitors with Native Science. The project will engage tribal role models and partner with tribal elders to create a library of videos for tribal partners, K–12 schools, and organizations. The project will offer teachers professional development designed to fulfill the statewide mandate of Indian Education for All. The exhibit will connect Native and non-Native museum visitors, close opportunity and achievement gaps, and ensure that all Missoula children feel a sense of belonging in museums, higher education, and STEM.
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
This project engages pre-college Latinx, Black, and Indigenous learners, educators, and collaborating undergraduates in an international, project-based learning and media-making community in areas of science, technology, engineering, and mathematics (STEM). The project addresses key challenges including broadening participation in informal STEM learning, developing capacity for leading informal STEM programs, and building stronger connections between STEM learning and personal and social identity formation during adolescence. The project’s community of participants is an asset-based learning environment that treats each participant, their background, skills, and interests as uniquely beneficial to the whole. Led by mentors at each hub (teachers, leaders from science organizations, or other out-of-school learning environments), participants collaborate with peers from the US and from other countries. The collaborations encompass a broad spectrum of STEM projects. Participants also create digital media to communicate their projects. The project activities reflect a focus on STEM content, collaboration, and communication, in a global context that includes school-age learners from the US and peers from Central and South America, the Middle East, Asia, and Sub-Sahara. The combination of the sophisticated STEM competencies skills for collaborating across international and cultural boundaries, and media-savvy communication abilities are essential to the nation’s future STEM workforce and to building a scientifically vibrant citizenry.
The project addresses two primary research questions co-developed with teachers and other informal science providers. The first research question involves understanding and optimizing conditions for broadening participation through this type of distributed or virtual collaboration across boundaries of culture, race, gender, ability, nationality, and socioeconomic status. The project features a design experiment by which the overall community of participants comprises four separate hubs, each hosted by the different project partners (primarily teachers). Educators devise, test, and revise alternative designs for organizing STEM collaborations. Publication of these teacher-led designs and their evaluation are among the primary outputs of the project. The designs modify and improve a template developed under this project’s proof-of-concept precursor (NSF1612824). The second research question addresses how growth in STEM abilities, collaboration, and communication mutually reinforce adolescent personal and social identity formation. Participating students in the US will intentionally reflect heterogeneous backgrounds. The project analysis will focus on whether cultural and national cross-boundary collaboration can strengthen the development of learners' personal identity and academic performance. The project methodology relies heavily on quantitative ethnography and epistemic network analysis. This approach enables the creation of visual models that highlight the presence or absence of connections between constructs relevant to each research question, along with changes between and within groups. The constructs include variations of autonomy, competence, and connection (pillars of self-determination theory) in tracing identity formation and STEM abilities. The quantitative ethnography approach provides statistically reliable scaffolding and insights about the hub designs and their efficacy in promoting goals of broadening participation and fostering mutually reinforcing STEM competencies and identity formation. This type of virtual collaboration, crossing boundaries of culture, nationality, ethnicity, age, gender, economic strata, or ability, can realistically be expected to play a significant role in next-generation learning environments, especially through out-of-school activities. The project is expected to reach 120 U.S. and 80 non-U.S. students annually. Research findings, design principles and curricula will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
DATE:
-
TEAM MEMBERS:
Eric HamiltonNastassia JonesDanielle EspinoSeung Lee
resourceprojectProfessional Development, Conferences, and Networks
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
The Hands On Children's Museum will build on two of its most distinctive features-an Outdoor Discovery Center and a Young Makers program-to create a Nature Makers program. The interdisciplinary project will link nature-based learning with maker activities that use natural materials. Partnerships with Native American tribes, scientists, maker groups, and others will enrich the staff-led offerings. Nature Makers addresses two of the most significant needs in early learning-inspiring early STEM education and connecting children with the outdoors. Nature Makers will increase children's exposure to outdoor tinkering to build the foundation for STEM success in school; educate parents, caregivers, and teachers about the important role outdoor exploration plays in STEM achievement; and stimulate children's curiosity about the natural world and increase the time they spend outside. Evaluation findings will be shared internally to inform continuous improvement of program offerings, and externally to serve as a model for outdoor making activities.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The archaeology after-school program, geared towards rural middle school students, explores the ability to teach STEM through archaeology. The multidisciplinary nature of archaeology makes it a useful vehicle for teaching a variety of STEM disciplines (e.g., biology, geology, ecology, zoology, physics, chemistry, mathematics, etc.). Its compatibility with hands-on activities, deep thinking skills, and scientific reasoning matches STEM learning goals.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
Counterspaces in science, technology, engineering, and mathematics (STEM) are often considered “safe spaces” at the margins for groups outside the mainstream of STEM education. The prevailing culture and structural manifestations in STEM have traditionally privileged norms of success that favor competitive, individualistic, and solitary practices—norms associated with White male scientists. This privilege extends to structures that govern learning and mark progress in STEM education that have marginalized groups that do not reflect the gender, race, or ethnicity conventionally associated with