This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
The Northwest Passage Project explored the changing Arctic through an innovative expedition aboard the Swedish Icebreaker Oden to conduct groundbreaking ocean science research, while it actively engaged 22 undergraduate and graduate students from the project’s five Minority Serving Institution (MSI) partners and 2 early career Inuit researchers in the research at sea. Over 35 hours of training in Arctic research techniques, polar science, and science communication was provided to these participants, who were engaged in the Northwest Passage expedition and worked with the onboard science team
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.
Snow: Tiny Crystals, Global Impact is a 2,500 ft traveling exhibition about: how snow shapes and sustains life on Earth, the impacts of climate change on snow, and the importance of our collective engagement to take action. The exhibition will be installed at OMSI during winter 2021-2022 for summative evaluation and learning research.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This book chapter, which describes emotional accessibility in digital learning experiences and its relation to Universal Design, was included in the book "Inclusive Digital Interactives: Best Practices + Research" published by the Smithsonian. This chapter includes a description of the Productive Struggle project, data highlights, and information on how attending to emotions can broaden our concepts of accessibility.
This poster presents findings from a study comparing the engagement, learning, and value between virtual and physical versions of the Mystery Skulls exhibit, which were designed to elicit productive struggle. Findings showed that there were no significant differences between the two versions in terms of what participants learned and valued from the exhibit, but participants who used the virtual version had longer use times than those engaged in the physical exhibit. This poster was presented to museum professionals at the Association of Science and Technology Centers (ASTC) at a virtual
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Dinosaurs of Antarctica is a giant screen film and outreach project that documents the work of NSF-funded researchers on expeditions to Shackleton Glacier during the 2017-2018 field season. This immersive film and companion television special will bring the past to life and engage the public, and particularly students in middle grades (6-9), with polar science through appealing, entertaining media experiences and informal learning programs. The film serves as a companion for the synonymous Antarctic Dinosaurs museum exhibition
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Thousands of webcams available to the public are operated by STEM organizations, such as zoos, museums, and government agencies. However, as of yet no research has quantified any aspect (cognitive, behavioral, or emotional) of viewer outcomes. Our objective is to build foundational knowledge about basic aspects of STEM webcams in the United States (US) from the perspectives of both practitioners and viewers.
Three-dimensional digital models are increasingly prevalent in preserving tangible and intangible aspects of Indigenous material heritage. Yet, there are no comprehensive, clearly laid-out best practices that can guide researchers, Indigenous communities, and museum personnel in designing ethically sound and socially engaged 3D heritage preservation projects. The use of 3D technologies for heritage preservation and providing public access to digital 3D collections is well-established in the European context. While there have been several robust efforts on digitizing European national heritage, in the U.S. context, the focus often involves work with Indigenous heritage, instantly placing 3D projects into a post-colonial research paradigm with a complex set of ethical ramifications. This research examines emerging thoughts from the European context and connects them with best practices in digital Indigenous data management to identify practices that contribute to cultures of academic integrity that are inclusive of all stakeholder voices. This work fosters ethical cultures of STEM through the development of a comprehensive Responsible Conduct of Research guiding document that can be adapted to address culture-specific Indigenous perspectives as well as project-specific challenges in future 3D heritage preservation endeavors.
Project goals are accomplished through workshops and virtual collaborations that bring together researchers, Indigenous community members, and heritage preservation professionals with previous experience in the responsible management, protection, and sharing of Indigenous digital data and the use of 3D technology for heritage preservation. The collaboratively produced guidelines outline ethical considerations that can be used in developing: 1) partnerships with origin/descendant communities, 2) institution- and collection-specific museum policies on using 3D technology, 3) Tribal policies for culturally appropriate use of 3D technologies, and 4) training material and curriculum that integrates with other research compliance regulations pertaining to heritage preservation. The project explores the questions that have emerged through previous experiences using 3D technologies to preserve Indigenous ancestral heritage. These questions include the factors contributing to developing ethically sound 3D heritage preservation projects; the practices useful in 3D projects to foster a culture of integrity that equally engages academic and Indigenous perspectives; consideration for what constitutes Responsible Conduct of Research in using 3D technologies to preserve Indigenous cultural heritage; and addressing practice-based questions that contribute to understanding ethical challenges in digitally preserving and presenting Indigenous heritage. The project situates 3D modeling and heritage representation as part of the larger discourse on decolonizing core methodologies in museum management and anthropological collection practices. Results from this work can be adapted to training future researchers and digital heritage management professionals and creating meaningful partnerships in heritage documentation. This research cultivates cultures of academic integrity by informing heritage management policy on the critical importance of heritage ethics for the creation and management of 3D digitization projects involving Indigenous collections. This award is funded by the Directorate of Geosciences and the Directorate of Education and Human Resources.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.