In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
In this participatory research project, a partnership between the Kitty Andersen Youth Science Center (KAYSC) and the Department of Evaluation and Research in Learning at the Science Museum of Minnesota, participants are working to rename and reclaim theory and research methods so as to foster relevance and equity. We have renamed the theory of science capital: "science capitxl" signals its roots in equity work and invites questioning. We are using what we have called "embedded research practices" for data generation and analysis. This poster was shared at the 2019 AISL PI meeting.
Slides from the January 30, 2018 Webinar present information for preparing proposals for the NSF INCLUDES Alliance Solicitation (NSF 18-529). Includes a brief description of NSF INCLUDES, an explanation of Collaborative Change strategies and the NSF INCLUDES 5 elements of collaborative change, proposal recommendations, details on the NSF cooperative agreements and the NSF Merit Review criteria, and provides useful resources.
The University of Guam (UOG) NSF INCLUDES Launch Pilot project, GROWING STEM, addresses the grand challenge of increasing Native Pacific Islander representation in the nation's STEM enterprise, particularly in environmental sciences. The project addresses culturally-relevant and place-based research as the framework to attract, engage, and retain Native Pacific Islander students in STEM disciplines. The full science, technology, engineering and mathematics (STEM) pathway will be addressed from K-12 to graduate studies with partnerships that include the Guam Department of Education, Humatak Community Foundation, Pacific Post-Secondary Education Council, the Guam Science and Discovery Society, the Society for the Advancement of Chicanos/Hispanics and Native Americans in Science (SACNAS) and the University of Alaska-Fairbaanks. As the project progresses, the project anticipates further partnerships with the current NSF INCLUDES Launch Pilot project at the University of the Virgin Islands.
Pilot activities include summer internships for high school students, undergraduate and graduate research opportunities through UOG's Plant Nursery and the Humatak Community Foundation Heritage House. STEM professional development activities will be offered through conference participation and student research presentations in venues such as the Guam Science and Discovery Society's Guam Island-wide Science Fair and SACNAS. Faculty will be recruited to develop a mentoring protocol for the project participants. Community outreach and extension services will expand public understanding in environmental sciences from the GROW STEM project. Project metrics will include monitoring the diversity of partners, increases in community engagement, Native Pacific Islander participation in STEM activities, the number of students who desire to attain terminal STEM degrees and the number of community members reached by pilot STEM extension and outreach activities. Dissemination of the GROWING STEM pilot project results will occur through the NSF INCLUDES National Network, partner annual conferences, and local, regional and national STEM conferences.
DATE:
-
TEAM MEMBERS:
John PetersonCheryl SanguezaElse DemeulenaereAustin Shelton
Educational approaches that provide meaningful, relevant opportunities for place-based learning have been shown to be effective models for engaging indigenous students in science. The Laulima A ‘Ike Pono (LAIP) collaboration was developed to create a place-based inclusive learning environment for engaging local community members, especially Native Hawaiians and Pacific Islanders, in scientific research at a historically significant ancient Hawaiian fishpond. The LAIP internship focused on problem-solving activities that were culturally relevant to provide a holistic STEM research experience
The Water for Life project has been an effective, and in some cases an essential vehicle for addressing issues around water quality and retention in island settings where water security is an on-going challenge. The focus on local partnerships was a highly valued attribute of the WfL project, and the informal science and conservation education resources produced and disseminated by the project have had a significant impact on these populations
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.