Funded by the Institute of Museum and Library Services, the Access from the Ground Up project at the Palo Alto Junior Museum & Zoo (JMZ) seeks to better serve children with disabilities through a combination of partnerships with community, staff professional development and training, and the development of accessible STEM-focused exhibits and resources at the new JMZ facility, which opened in November 2021. This summative evaluation report seeks to answer the following evaluation questions:
To what extent does the Access from the Ground Up project build or strengthen relationships with
Data science is ever-present in modern life. The need to learn with and about data science is becoming increasingly important in a world where the quantity of data is constantly growing, where one’s own data are often being harvested and marketed, where data science career opportunities are rapidly increasing, and where understanding statistics, data sources, and data representation is integral to understanding STEM and the world around us. Museums have the opportunity to play a critical role in introducing the public to data science concepts in ways that center personal relevance, social connections and collaborative learning. However, data science and statistics are difficult concepts to distill and provide meaningful engagement with during the brief learning experiences typical to science museums. This Pilot and Feasibility study brings together data scientists, data science educators, and museum exhibit designers to consider these questions:
What are the important data science concepts for the public to explore and understand in museum exhibits?
How can museum exhibits be designed to support visitors with diverse backgrounds and experiences to engage with these data science concepts?
What principles can shape these designs to promote broadening participation in data science specifically and STEM more broadly?
This Pilot and Feasibility project combines multidisciplinary expert convening, feasibility testing, and early exploratory prototyping around the focal topic of data science exhibits. Project partners, TERC, the Museum of Science, Boston, and The Tech Interactive in San Jose will engage in an iterative process to develop a theoretical grounding and practical guidance for museum practitioners. The project will include two convenings, bringing together teams of experts from the fields of data science, data science education and museum exhibit design. Prior to the first convening, an initial literature summary and a survey of convening participants will be conducted, culminating in a preliminary list of big ideas about data science. Periodically, participants will have the opportunity to rank, annotate and expand this list, as a form of ongoing data collection. During the convenings, participants will explore the preliminary list, share related work from the three disciplines, engage with related data science activities in small groups, and work together to build consensus around promising data science topics and approaches for exhibits. Participant evaluation will allow for iterative improvement of the convenings and the capture of missed points or overlooked topics. After each convening, museum partners will create prototypes that respond to the convening conversations. Prototypes will be pilot tested (evaluated) with an intentionally recruited group of families that includes both frequent visitors and those who are less likely to visit the museum; diversity in terms of race, languages and dis/ability will be reflected in selection. Pilot data collection will consist of structured observations and interviews. Results from the first round of prototyping will be shared with convening participants as a way to modify the list of big ideas and to further interrogate the feasibility of communicating these ideas in an exhibit format. Results from the convenings and from both rounds of prototyping will be combined in a guiding document that will be shared on all three partner websites, and more broadly with the informal STEM learning field. The team will also host a workshop for practitioners interested in designing data science exhibits, and present at a conference focused on museum exhibits and their design.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This report summarizes the ideas and conversations of the CAISE Broadening Participation Task Force, which was led by the authors, along with James Bell, Principal Investigator and project director of CAISE (see informalscience.org/bp-task-force). The task force was instrumental in identifying key ideas and challenges to the field, providing edits and input into the report, developing and drafting the associated practice briefs, and piloting the materials.
Across the nation, many are undertaking efforts to significantly transform who participates in science, technology, engineering, and
Slides from the January 30, 2018 Webinar present information for preparing proposals for the NSF INCLUDES Alliance Solicitation (NSF 18-529). Includes a brief description of NSF INCLUDES, an explanation of Collaborative Change strategies and the NSF INCLUDES 5 elements of collaborative change, proposal recommendations, details on the NSF cooperative agreements and the NSF Merit Review criteria, and provides useful resources.
DATE:
TEAM MEMBERS:
Jolene JessePaige Smith
resourceevaluationProfessional Development, Conferences, and Networks
The Summative Study of the Nano Mini-exhibition took place during the spring and summer of 2012. After being observed during their Mini-exhibition experience, 455 visitors across six different partner institutions participated in surveys and interviews with NISE Net evaluation team members. This report begins by describing the key findings of the study in detail, with additional information about study methods, instruments, and two exploratory sub-studies found in the Appendices.
This article seeks to reflect on mediation in museums based on experiences that occurred in the “Learning in order to Teach” Project. In this case, the mediation acquires specific characteristics because it deals with young deaf people learning art-related contents in order to teach other youth in their first language. The most interesting aspect of this encounter between museum and deaf culture is a mutual, immediate and highly visible influence. While museum-goers and professionals understand that the “gestures” used by the deaf are not random (rather, on the contrary, they make up a
DATE:
TEAM MEMBERS:
Daina LeytonCibele LucenaJoana Zatz Mussi
This special report describes NSF INCLUDES (Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science), a comprehensive initiative to enhance U.S. leadership in science and engineering discovery and innovation by proactively seeking and effectively developing science, technology, engineering and mathematics (STEM) talent from all sectors and groups in our society. By facilitating partnerships, communication and cooperation, NSF aims to build on and scale up what works in broadening participation programs to reach underserved populations
These slides were presented at the NSF Advancing Informal STEM Learning (AISL) Principal Investigators' Meeting held in Bethesda, MD from February 29-March 2, 2016. The presentation describes NSF INCLUDES, a funding opportunity that leverages collective impact strategies to broaden participation in STEM.
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12. During this second regional workshop in Boston, the NFB operated two different programs simultaneously: one program for youth, and a second program for their parents/caregivers. A third program, for Boston Museum of Science staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report will discuss the
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12. During the third regional workshop in Columbus, Ohio, the NFB operated two different programs simultaneously: one program for youth, and a second program for their parents/caregivers. A third program, for COSI (science center) staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report will discuss
Creating Museum Media for Everyone is an NSF-funded collaborative project of the Museum of Science, the WGBH National Center for Accessible Media, Ideum, and Audience Viewpoints, to further the science museum field's understanding of ways to research, develop, and evaluate digital interactives that are inclusive of all people. As a part of this effort to enable museums to integrate more accessible media into their exhibits to make them more welcoming and educational for visitors with disabilities as well as general audiences, this paper provides an overview of approaches to media accessibility