In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
EcoExploratorio: Museo de Ciencias de Puerto Rico’s In-STEM: An Inclusive STEM Museum Exhibition project will provide STEM educational material specifically for audiences with visual and hearing disabilities. In addition to an inclusive summer Moon to Mars exhibit, the museum will offer tours with American Sign Languages (ASL) interpreters and adaptations for the visually impaired. Accessible online, the museum will produce ten STEM activity videos. By being inclusive of people with disabilities, specifically focusing on people that are deaf or hard of hearing and blind or visually impaired, the museum seeks to promote lifelong access to STEM education.
The Habitot Children's Museum will renovate its Rocketship and Mission Control exhibition to increase functionality, making it more accessible and interactive for parents, caregivers, and children. With input from the community and a professional advisory group of museum professionals, early learning specialists, space scientists and parents, the museum will refurbish, update, and improve exhibition access for children with special needs by completing previously identified universal design requirements; adding interactive components that support young children's need for open-ended, play-based experiences to build strong STEM learning foundations; and addressing adult visitors' needs to have defined roles in exhibition spaces to better engage with their children. A customized, observation-based evaluation tool will be used to measure the identified project outcomes.
Astronomy has been an inherently visual area of science for millenia, yet a majority of its significant discoveries take place in wavelengths beyond human vision. There are many people, including those with low or no vision, who cannot participate fully in such discoveries if visual media is the primary communication mechanism. Numerous efforts have worked to address equity of accessibility to such knowledge sharing, such as through the creation of three-dimensional (3D) printed data sets. This paper describes progress made through technological and programmatic developments in tactile 3D
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Physical science and engineering remain the least diverse of all STEM fields---with regard to women, underrepresented minorities, and persons with disabilities---across all levels of STEM education and training. SCI-STEPS is an NSF INCLUDES Design and Development Launch Pilot that will address this persistent challenge by developing a complete end-to-end pipeline (or system of pathways) from the beginning of college to the PhD, and then into the workforce. Many isolated efforts to broaden participation have shown promise, but they have not produced big enough impact. SCI-STEPS represents a concerted set of coordinated interventions---consciously facilitated, systemically linked, and purposefully disseminated. SCI-STEPS represents a broad regional network among major research universities, Historically Black Colleges and Universities, comprehensive universities, community colleges, national labs, and major scientific organizations. The goal of the network is to ensure that underrepresented individuals in the physical sciences and engineering can get from their starting point in STEM higher education---freshmen at 2-year or 4-year college---through the higher education pathways leading to an appropriate terminal degree and employment in the STEM workforce.
Women, underrepresented minorities, and persons with disabilities collectively represent the majority of college-age individuals entering higher education with an expressed interest in physical science and engineering. A growing body of research indicates that academic and social integration may be even more influential than academic abilities for retention of students. Thus, interventions aimed at stemming the losses of these individuals must ultimately be aimed at changing the system---including unwelcoming institutional climates, racial/ethnic/gender stereotyping, a lack of mentors with whom to identify, and evaluation methods that emphasize conformity over individual capabilities---rather than changing the individual. The SCI-STEPS pilot focuses effort on institutional readiness for implementation of best practice interventions at four key junctures: (i) college freshman to sophomore; (ii) undergraduate to graduate; (iii) PhD to postdoc; and (iv) postdoc to workforce.The pilot will proceed in three steps: (1) a planning phase, (2) development of an initial end-to-end pathways model with four Juncture Transition teams, and (3) scale-up of the SCI-STEPS "network of networks" with all initial partners. By addressing these objectives through a collective impact framework and embedded research, this pilot will demonstrate how best-practice interventions at each pathway juncture can be dovetailed and scaled up across a broad range of institutional types and across a large but distinct geographical area. Addressing these objectives will thus also serve to advance Broadening Participation efforts at a national scale, by suggesting the forms of institutional partnerships and best-practices that may inform other alliances in other STEM disciplines and/or different regional areas.
DATE:
-
TEAM MEMBERS:
Keivan StassunNicole JosephKelly Holley-BockelmannWilliam RobinsonRoger Chalkley
The Rochester Institute of Technology's National Technical Institute for the Deaf (NTID) and Center for Computational Relativity and Gravitation (CCRG) will collaborate on a CRPA project designed to develop a dance-based performance to educate deaf and hard of hearing students on astrophysics concepts. This project seeks to address the following goals: 1) provide all audience members with access to scientific information in an inherently engaging and stimulating manner; 2) facilitate the acquisition of scientific knowledge in all audience members, including deaf and hard-of-hearing individuals, with special reference to general information and basic concepts from the fields of gravitational physics and astrophysics; and 3) stimulate general interest in STEM fields within all audience members. An extensive team of physicists, arts faculty, computer scientists, performance experts, and evaluators have assembled to translate original research on gravity-based astrophysics, including collision events between black-holes and neutron-stars, entire galaxies, and the central black-hole engine that powers active galactic nuclei, into novel educational presentations. The original science to be presented was generated in part by the scientists at the Center for Computational Relativity and Gravitation. Project deliverables include live performances and a project website with educational materials and a virtual tour of the recorded performance. The live performances will include dance and computer generated visualizations of space phenomena, supplemented with discussion and interactive components to engage audiences both before and after the presentation. The mixed-method evaluation will provide insights into how the medium of dance can be used to engage audiences in STEM fields and increase the understanding of STEM content areas which have had little previous investigation, but may be highly relevant to the engagement of underserved audiences. Performances are planned for select sites in New York, Ohio, Connecticut, Rhode Island, Washington, DC, Pennsylvania and Maryland. It is estimated that the project will directly impact 7,000 individuals, approximately half of whom will be deaf or hard or hearing. Deaf and hard of hearing populations are greatly underserved in science education. This project is an effort to bridge that gap by providing creative models for communicating to the public on contemporary science concepts. Learning outcomes for the target audience include increasing awareness and interest in STEM, acquisition of information and basic concepts from the fields of gravitational physics and astrophysics, and enhancing awareness of relationships among science and the arts. Project activities will be disseminated through the website hosted by the Rochester Institute of Technology, as well as social networking sites including Facebook, Twitter, and Google+. The project will also be promoted through science festivals and media events.
DATE:
-
TEAM MEMBERS:
Manuela CampanelliHans-Peter BischofJacob Noel-Storr
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
The proposal intends to develop software that, when combined with the OMNI device, produces a virtual touch sensation that allows the blind to "touch" surfaces such as Mars, Earth's Moon, etc. The experience is multimedia as users can get sight, sound, and touch at the same time. The proposal does a solid job of describing a well-constructed and well-designed plan. The collaborative group works to bring together a strong body of STEM material, a highly skilled project team, and a diverse audience to assess the material. The team brought together to implement the proposal is a good one and includes the Institute for Scientific Research, NASA IV and V Independent Verification and Validation, Facility Educator Resource Center, Alderson Broadus College, Davis & Elkins College, and the West Virginia Schools for the Deaf and Blind. Although NASA is a project partner, the reviewers encourage the project proposer to continue building direct NASA funding. For example, a NASA space grant may be a good dissemination vehicle in the future. Reviewers were impressed with the various project elements: the mobile unit, pre- and post- standards based lessons, hypothesis testing with immediate feedback. The evaluation and dissemination plans provide for effective and immediate impact on a statewide and national level. The project provides for broader impact as the multi-media tools will be of assistance to other groups of students with disabilities as well.
DATE:
-
TEAM MEMBERS:
Marjorie DarrahPatricia HarrisSharmistha RoyAmy BlakeRebecca Giorcelli
The purpose of this front-end evaluation study was to inform design decisions about the development of an interactive learning system focusing on Earth and planetary science. The design team was led by the Institute for Scientific Research (ISR), and the project was funded by the National Science Foundation (NSF). The aim of the Advancing Content Through Interactive Virtual Environments (ACTIVE) Project is to create an interactive learning environment that allows exploration of the solar system through several senses including touch, sound, and sight. Developers will incorporate NASA Earth and
DATE:
TEAM MEMBERS:
Carey TisdalThe West Virginia High Technology Consortium Foundation