In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
The Institute for Native Pacific Education and Culture will address low science and math proficiency achievement rates for Native Hawaiian students by designing more relevant STEM learning activities. The INPEACE Indigenous Science Center’s Mahina Exhibit Project will create three exhibit designs with learning objectives targeted for students ages 4-14. Focused on the Mahina (moon), the exhibits and related activities will be designed to be enjoyable and thought-provoking for Native Hawaiian communities to engage in STEM learning through a framework that is familiar. Through consultation with experienced exhibit designers, the science center’s staff will gain a stronger understanding of best practices in exhibit design, and indigenous communities will benefit from approaches that translate their own histories into relevant and fun STEM learning experiences.
The Institute for Native Pacific Education and Culture (INPEACE) will create a mobile science exhibit to support improved academic outcomes in science and math for students from pre-school to eighth grade. With the collaboration of science experts, teachers, students, and cultural practitioners, the project team will identify and design three core exhibits using a culture-based educational approach. The project will link indigenous knowledge and practices with scientific theory, providing hands-on experiences designed to engage youth in STEM learning. The 'Ike Hawai'i Science Center Exhibit will visit rural Native Hawaiian communities on O'ahu and at least one other island. It will be available to public audiences of all ages.
This Innovations in Development project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Specifically, this project connects Native Hawaiian youth ages 12-17 and their family members to STEM by channeling their cultural relationship with ʻāina, the sustaining elements of the natural world including the land, sea, and air. This project seeks to: broaden participation of Native Hawaiian youth who have been historically underrepresented in STEM; actively uphold Native Hawaiian ways of knowing and traditional knowledge; articulate the science rooted in cultural wisdom; and bring STEM into the lives of participants as they connect to the ʻāina. In partnership with six ʻāina-based community organizations across Hawaiʻi, this project will develop, implement, and study ʻāina-centered environmental education activities that explore solutions to local environmental problems. For example, in one module youth and their families will explore of a section of a nearby stream; identify and discuss the native, non-native, and invasive species; remove invasive species from a small section of the stream and make observations leading to discussions of unintended consequences and systemic impacts; ultimately, learners will meet at additional local waterways to engage in similar explorations and discussions, transferring their knowledge to understanding the impacts of construction on local streams and coral reefs. To this effort, the community-based organizations bring their expertise in preserving Hawaiian culture and sustainable island lifestyle, including rural and urban systems such as farming and irrigation traditions and the restoration of cultural sites. University of Hawai’i faculty and staff bring expertise in Environmental Science, Biology, Hawaiian Studies and Problem-Based Learning Curriculum Development. This project further supports organizational learning and sharing among the six community-based organizations. Grounded in Hawaiian ʻAʻo, where learning and teaching are the same interaction, community-based organizations will create a Community of Practice that will co-learn Problem-Based Learning pedagogy; co-learn and engage in research and evaluation methods; and share experiential and traditional knowledge to co-develop the ʻāina-based environmental education activities.
This project is uniquely situated to study the impact of community-led culturally relevant pedagogy on Hawaiian learners’ interests and connections to environmental science, and to understand ʻāina-based learning through empirical research. Research methods draw on Community-Based Participatory Research and Indigenous Research Methods to develop a collaborative research design process incorporated into the project’s key components. Community members, researchers, and evaluators will work together to examine the following research questions: 1) How does environmental Problem-Based Learning situate within ʻāina-based informal contexts?; 2) What are the environmental education learning impacts of ʻāina-based activities on youth and family participants?; and 3) How does the ʻāina-centered Problem-Based Learning approach to informal STEM education support STEM knowledge, interest and awareness? The evaluation will employ a mixed-methods participatory design to explore program efficacy, fidelity, and implementation more broadly across community-based sites, as well as program sustainability within each community-based site. Anticipated project outcomes are a 15-week organizational learning and sharing program with six ʻāina-based community organizations and 72 staff; the design and implementation of 18 activities to reach 360 youth and at least one of their family members; and the launch of an ʻāina-based STEM Community of Practice. The project’s research and development process for ʻāina-centered environmental education activities will be shared broadly and provide a useful example for other organizations locally and nationally working in informal settings with Native or Indigenous populations.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
For thousands of years, Native Hawaiian/Pacific Islander (NHPI) seafarers have successfully utilized systemic observation of their environment to traverse vast expanses of open ocean and thrive on the most remote islands on earth. Developing NHPI trust in the scientific enterprise requires building connections that bridge the values and concepts of 'ike kupuna (traditional knowledge) with scientific knowledge systems and contemporary technology. This project will develop and research a pop-up science exhibit that connects indigenous Hawaiian knowledge with contemporary Western science concepts. The exhibit will show how community knowledge (that is consistent with underlying scientific principles and natural laws) has informed innovation by indigenous peoples. This community-initiated and developed project will begin with a single pop-up exhibit designed to incorporate several hands-on culture-based STEM activities that integrate traditional and modern technologies. For example, the exhibit may cover indigenous systems of star navigation for ocean voyaging, systems of netting for food and water containers, or systems of home design with local and natural materials. This project seeks to develop preliminary evidence of the effectiveness of such an approach for supporting rural Hawaiian youths' STEM engagement, understanding, and personal connections to Native Hawaiian STEM knowledge. Findings from this pilot and feasibility study will inform the development of a larger pop-up science center grounded in indigenous Hawaiian STEM knowledge, and advance intellectual knowledge around culturally sustaining pedagogy by helping informal STEM education practitioners understand community initiated and developed STEM exhibits.
This pop-up science center pilot will be led by a local Hawaiian community organization, INPEACE, in collaboration with several local community members and other community-based organizations. The preliminary research will iteratively explore whether and how an existing Hawaiian culture-based framework can be used to design hands-on STEM exhibits to enhance rural learner engagement, depth of STEM knowledge, and connection to Native Hawaiian STEM knowledge. Research efforts led by Kamehameha Schools, which has a long history of conducting research from an indigenous worldview, will engage 120 learners from various rural communities across Hawaii, from which 40 will be pre-selected middle-school youth, and 80 individuals will be from public audiences of learners ages 12 and up. Through a series of observations, interviews, pre and post surveys with validated instruments, and focus groups, the research will probe: (1) The learners' thoughts on the science practice and its relevance to old and new Hawaii and modern society. (2) The level at which related STEM topics have been understood, and (3) The learners' perceptions about their connection to Native Hawaiian STEM knowledge. Results from this pilot study will inform a future pop-up science center development project, and add to the scarce literature on community-driven, culturally sustaining exhibition development.
This Pilots and Feasibility Studies project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This pilot study, Akeakamai (Hawaiian, literally lover of wisdom, scientist, scholar), will explore the convergence of contemporary Western science topics with indigenous Hawaiian culture-based science experiences as a mechanism to strengthen STEM perceptions, cross-cultural science collaboration, and multi-generational community engagement with STEM. The work is grounded in the notion that STEM learning within the context of local informal indigenous community settings should be culturally responsive and culturally sustaining, and should privilege indigenous epistemologies. If successful, the results of this pilot could provide valuable insights on effective approaches to developing and implementing culturally consistent and sustainable multigenerational STEM engagement among Native Hawaiians and Pacific Islanders, and across the Pacific region.
Over a two-year duration, the study will address three research questions. (1) To what extent does inclusion of culture into curriculum designed for informal Culture-Science Explorations mitigate perceived barriers to participation in science? (2) What barriers do community members perceive to limit their participation in science? (3) What are the areas of consonance between Native Hawaiian and Western scientific approaches to knowledge and learning? Approximately 200 predominantly Native Hawaiian and Pacific Islanders, ranging in age from 8 - 85 years old, will participate in the pilot. The research team will collect participant data during all phases of the social intervention, a suite of culture-science exploration experiences held at the Halau Inana, a Native Hawaiian community collaboration space. The intervention will employ pedagogical methods that are responsive to Hawaiian cultural norms to deliver content that integrates across the interfaces of Western science and technology and indigenous knowledge, and incorporates Hawaiian language. A rigorous external evaluation will also be conducted. The results of the research and evaluation will be broadly disseminated. Ultimately, the project aims to develop a conceptual and practical cross-cultural, multi-generational framework for community-based science learning in Hawai'i that can serve as a model for future research and programs that extend into and beyond indigenous communities of the Pacific region.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Helen TurnerJonathan BakerChrystie Naeole
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The University of Guam (UOG) NSF INCLUDES Launch Pilot project, GROWING STEM, addresses the grand challenge of increasing Native Pacific Islander representation in the nation's STEM enterprise, particularly in environmental sciences. The project addresses culturally-relevant and place-based research as the framework to attract, engage, and retain Native Pacific Islander students in STEM disciplines. The full science, technology, engineering and mathematics (STEM) pathway will be addressed from K-12 to graduate studies with partnerships that include the Guam Department of Education, Humatak Community Foundation, Pacific Post-Secondary Education Council, the Guam Science and Discovery Society, the Society for the Advancement of Chicanos/Hispanics and Native Americans in Science (SACNAS) and the University of Alaska-Fairbaanks. As the project progresses, the project anticipates further partnerships with the current NSF INCLUDES Launch Pilot project at the University of the Virgin Islands.
Pilot activities include summer internships for high school students, undergraduate and graduate research opportunities through UOG's Plant Nursery and the Humatak Community Foundation Heritage House. STEM professional development activities will be offered through conference participation and student research presentations in venues such as the Guam Science and Discovery Society's Guam Island-wide Science Fair and SACNAS. Faculty will be recruited to develop a mentoring protocol for the project participants. Community outreach and extension services will expand public understanding in environmental sciences from the GROW STEM project. Project metrics will include monitoring the diversity of partners, increases in community engagement, Native Pacific Islander participation in STEM activities, the number of students who desire to attain terminal STEM degrees and the number of community members reached by pilot STEM extension and outreach activities. Dissemination of the GROWING STEM pilot project results will occur through the NSF INCLUDES National Network, partner annual conferences, and local, regional and national STEM conferences.
DATE:
-
TEAM MEMBERS:
John PetersonCheryl SanguezaElse DemeulenaereAustin Shelton
This project is a Design and Development Launch Pilot (DDLP) of the NSF INCLUDES program. The goal of the project is to enhance the knowledge and applicability of science, technology, engineering, and mathematics (STEM) for a broad cross-section of people living in the U.S,-Affiliated Pacific Islands. The focus will be on water resources, which is an extremely important topic for this region and equally relevant nationally. The project will engage local community groups and schools in water monitoring, sampling, and analysis, in order to promote the benefits of science education and careers among a population that is underrepresented in these areas. Moreover, the project will improve the capabilities of the island residents for making decisions about sustainable use and protection of these scarce resources. A functioning network will be established among the islands that will have a positive impact on the health and well-being of the residents.
This project will use water as a highly relevant topic in order to involve a wide range of individuals in both general STEM learning and the basic scientific principles as applied to water resources. Specific aspects include engaging K-12, higher education, informal educators and community members to manage water resources in a sustainable fashion that will reduce disaster risk. In addition, the project will empower local communities through water literacy to make better informed, evidence-based decisions that balance the needs of diverse stakeholder groups. The overarching goal is to further advance the inclusion of underrepresented learners in STEM fields. Benefits to society will accrue by: increasing STEM learning opportunities for ~6,500 students from underserved and underrepresented Indigenous Pacific Islanders that will enhance their eligibility for STEM careers; building community resiliency through a collective impact network to resolve emerging water crises; and fostering collaboration among different constituencies in remote communities to make better-informed decisions that reflect the needs and constraints of diverse interests.
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that