The Ka Makaiwa: Strengthening Digital Access for Native Hawaiian Futures project will develop an approach to producing online exhibits and related programming for the Bishop Museum. The project will address barriers to physical access to collections expected to continue beyond the pandemic by expanding access to information by developing a high-quality, thoughtfully designed, and user-friendly online exhibit platform. The museum will capture photographs, video footage, and other content from the (Re)Generations: Challenging Scientific Racism in Hawaii exhibition, which explores racism and bias in scientific research while celebrating Native Hawaiian voices and collaborative endeavors. The project team will test a beta version internally and conduct a thorough internal review before launching the online exhibit publicly.
The McWane Science Center (MWSC) will create a new exhibition experience entitled “Dropping Science: Hip-Hop Interactive” that will capture the elements of the popular music genre using interpretive experiences. Project activities include exhibit content development; development of a formal evaluation plan; exhibit prototyping; remedial evaluation, and a final exhibit design plan. An important project goal is to develop the process for creating lasting, reciprocal relationships with the local African American community and throughout the region, thus creating an exhibit space that connects underrepresented audiences to STEM and establishes MWSC as a true community partner. The outcome of this project will be a new interactive experience that was co-developed with and representative of MWSC’s local community that helps MWSC connect with and engage local visitors in science through a more culturally and personally relevant lens.
Many urgent environmental challenges, from soil degradation and water pollution to global climate change, have deep roots in how complex systems impact human well-being, and how humans relate to nature and to each other. Learning In and From the Environment through Multiple Ways of Knowing (LIFEways) is based on the premise that Indigenous stewardship has sustained communities on these lands since time immemorial. This project is collaboratively led by the Indigenous Education Institute and Oregon State University’s STEM Research Center, in partnership with Native Pathways and the Reimagine Research Group, Swinomish Indian Tribal Community, Oregon Museum of Science and Industry, World Forestry Center, and a national park network in the Pacific Northwest. The aim of this partnership is to deepen the informal learning field’s understanding of how Indigenous ways of knowing are currently or can be included in outdoor learning environments such as parks, nature preserves, and tribal lands. The project will share practices that center Indigenous worldviews to build awareness of their value and enhance STEM learning in outdoor settings. These approaches engage Native community members in continuing their traditional knowledge and practices, and help non-Native audiences learn from the dynamic interrelationships of the environment in authentic, respectful ways.
Conventional outdoor education is mostly grounded in Western concepts of “conservation” and “preservation” that position humans as acting separately from nature. This Research in Service to Practice project will identify “wise practices” that honor Indigenous ways of knowing, and investigate current capacities, barriers and opportunities for amplifying Indigenous voices in outdoor education. A team of Native and non-Native researchers and practitioners will draw upon Indigenous and Western research paradigms. Methods include Talk Story dialogues, a landscape study using national surveys, case studies, and a Circle of Relations to interpret and disseminate research findings. LIFEways will also document partnership processes to continue to build on the Collaboration with Integrity framework between tribal and non-tribal organizations (Maryboy and Begay, 2012). Findings from the LIFEways project will be shared broadly through a series of webinars, local and national meetings, conferences, and publications.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
Data science is ever-present in modern life. The need to learn with and about data science is becoming increasingly important in a world where the quantity of data is constantly growing, where one’s own data are often being harvested and marketed, where data science career opportunities are rapidly increasing, and where understanding statistics, data sources, and data representation is integral to understanding STEM and the world around us. Museums have the opportunity to play a critical role in introducing the public to data science concepts in ways that center personal relevance, social connections and collaborative learning. However, data science and statistics are difficult concepts to distill and provide meaningful engagement with during the brief learning experiences typical to science museums. This Pilot and Feasibility study brings together data scientists, data science educators, and museum exhibit designers to consider these questions:
What are the important data science concepts for the public to explore and understand in museum exhibits?
How can museum exhibits be designed to support visitors with diverse backgrounds and experiences to engage with these data science concepts?
What principles can shape these designs to promote broadening participation in data science specifically and STEM more broadly?
This Pilot and Feasibility project combines multidisciplinary expert convening, feasibility testing, and early exploratory prototyping around the focal topic of data science exhibits. Project partners, TERC, the Museum of Science, Boston, and The Tech Interactive in San Jose will engage in an iterative process to develop a theoretical grounding and practical guidance for museum practitioners. The project will include two convenings, bringing together teams of experts from the fields of data science, data science education and museum exhibit design. Prior to the first convening, an initial literature summary and a survey of convening participants will be conducted, culminating in a preliminary list of big ideas about data science. Periodically, participants will have the opportunity to rank, annotate and expand this list, as a form of ongoing data collection. During the convenings, participants will explore the preliminary list, share related work from the three disciplines, engage with related data science activities in small groups, and work together to build consensus around promising data science topics and approaches for exhibits. Participant evaluation will allow for iterative improvement of the convenings and the capture of missed points or overlooked topics. After each convening, museum partners will create prototypes that respond to the convening conversations. Prototypes will be pilot tested (evaluated) with an intentionally recruited group of families that includes both frequent visitors and those who are less likely to visit the museum; diversity in terms of race, languages and dis/ability will be reflected in selection. Pilot data collection will consist of structured observations and interviews. Results from the first round of prototyping will be shared with convening participants as a way to modify the list of big ideas and to further interrogate the feasibility of communicating these ideas in an exhibit format. Results from the convenings and from both rounds of prototyping will be combined in a guiding document that will be shared on all three partner websites, and more broadly with the informal STEM learning field. The team will also host a workshop for practitioners interested in designing data science exhibits, and present at a conference focused on museum exhibits and their design.
The Science Museum of Minnesota (SMM) will collaborate with four community organizations serving Black, Indigenous, and People of Color (BIPOC) audiences to research and develop a novel outdoor makerspace that engages families in STEM learning. A makerspace is a place where people work together on creative, interest driven projects. In working with BIPOC families, the project addresses three forms of historical (and present day) exclusion of community participants, including participation in the design of informal learning experiences, participation in such activities, and overall engagement in STEM. The project aims to develop activities that foster STEM learning using natural materials in an outdoor makerspace, informed through robust collaboration with local communities. This project will result in an outdoor makerspace at SMM that will include 3-4 settings (approximately 2500 square feet total) that house and support multiple making activities in an outdoor context. The proposed work will contribute to advancing knowledge through exploring how BIPOC families define learning in makerspaces and how younger children can be fully engaged in family learning. The project will share the inclusive design and community collaboration practices developed through this work with other museums, maker educators, and other community organizations that can develop or expand their own outdoor makerspaces in ways that will respect and reflect BIPOC families’ perspectives.
BIPOC families will join museum staff as contributors in the development and iteration of an outdoor makerspace and collaborators in the development of generalized design principles and dissemination of the research. Visitor-captured video of engagement in the outdoor makerspace, surveys, and memos from design meetings with community partners serve as the foundation for the process of aligning design and development of outdoor informal science education spaces with community needs and values. All research activities will be guided by a culturally responsive research framework and use strategies to ensure the multicultural validity such as video meaning-making with family research participants and member-checking instruments, data analyses, and findings with Design Partners. Project research will address three questions: (1) What are the characteristics of family learning in an outdoor nature-situated makerspace, including how BIPOC families identify and describe STEM learning and how outdoor spaces can be built to support BIPOC families’ perspectives? (2) How can the space be built to support multi-age families to engaged in making, including a focus on what design elements support preschool learner’s engagement and sustained participation by other family members? and (3) How do the design principles for making with widely available materials translate from indoor to outdoor spaces and materials? Research findings, design principles and community engagement guides will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
The Field Museum of Natural History will present “Changing Face of Science,” an exhibition series targeting pre-teens and teenagers and featuring Field Museum scientists and science educators who are women or people of color. Over three years, the museum will mount six exhibitions that highlight the experiences and work of museum scientists from diverse backgrounds in a range of disciplines. Programming will include on-site field trips and virtual events during which students and educators will interact with featured researchers. By presenting the stories of individuals from groups traditionally underrepresented in scientific fields, the museum will provide role models who will show that science is accessible and inspire a diverse group of future scientists.
Three-dimensional digital models are increasingly prevalent in preserving tangible and intangible aspects of Indigenous material heritage. Yet, there are no comprehensive, clearly laid-out best practices that can guide researchers, Indigenous communities, and museum personnel in designing ethically sound and socially engaged 3D heritage preservation projects. The use of 3D technologies for heritage preservation and providing public access to digital 3D collections is well-established in the European context. While there have been several robust efforts on digitizing European national heritage, in the U.S. context, the focus often involves work with Indigenous heritage, instantly placing 3D projects into a post-colonial research paradigm with a complex set of ethical ramifications. This research examines emerging thoughts from the European context and connects them with best practices in digital Indigenous data management to identify practices that contribute to cultures of academic integrity that are inclusive of all stakeholder voices. This work fosters ethical cultures of STEM through the development of a comprehensive Responsible Conduct of Research guiding document that can be adapted to address culture-specific Indigenous perspectives as well as project-specific challenges in future 3D heritage preservation endeavors.
Project goals are accomplished through workshops and virtual collaborations that bring together researchers, Indigenous community members, and heritage preservation professionals with previous experience in the responsible management, protection, and sharing of Indigenous digital data and the use of 3D technology for heritage preservation. The collaboratively produced guidelines outline ethical considerations that can be used in developing: 1) partnerships with origin/descendant communities, 2) institution- and collection-specific museum policies on using 3D technology, 3) Tribal policies for culturally appropriate use of 3D technologies, and 4) training material and curriculum that integrates with other research compliance regulations pertaining to heritage preservation. The project explores the questions that have emerged through previous experiences using 3D technologies to preserve Indigenous ancestral heritage. These questions include the factors contributing to developing ethically sound 3D heritage preservation projects; the practices useful in 3D projects to foster a culture of integrity that equally engages academic and Indigenous perspectives; consideration for what constitutes Responsible Conduct of Research in using 3D technologies to preserve Indigenous cultural heritage; and addressing practice-based questions that contribute to understanding ethical challenges in digitally preserving and presenting Indigenous heritage. The project situates 3D modeling and heritage representation as part of the larger discourse on decolonizing core methodologies in museum management and anthropological collection practices. Results from this work can be adapted to training future researchers and digital heritage management professionals and creating meaningful partnerships in heritage documentation. This research cultivates cultures of academic integrity by informing heritage management policy on the critical importance of heritage ethics for the creation and management of 3D digitization projects involving Indigenous collections. This award is funded by the Directorate of Geosciences and the Directorate of Education and Human Resources.
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.