Through desk-based research and expert interviews, this study set out to investigate how funders and policy makers could drive coordination and improvements in the evaluation of youth engagement with STEM. The study explored the current landscape of evaluating youth engagement with STEM, gaps and challenges and key learnings from the evaluation practice in other sectors and key initiatives. Between February and March 2022, 18 project and programme evaluation reports and papers were reviewed, approximately 40 academic papers were analysed and synthesised, and 14 experts were interviewed.
Life on the Edge is a traveling exhibition focused on educating children ages 8-14 and their families about how understanding Earth’s extreme environments helps us search for life in space. Created by Sciencenter in Ithaca, NY, the big idea of the exhibition is: “our exploration of extreme environments expands our understanding of life on Earth and the possibilities for life in our solar system and beyond.” Through five unique exhibit sections, the exhibition offers visitors information, activities, and questions focused on scientific exploration and discovery, life in space, and the origins
Overview
In 2020, RK&A (now Kera Collective) partnered with the National Museum of Natural History to conduct a summative evaluation of the David H. Koch Hall of Fossils: Deep Time, a 31,000 square foot exhibition that explores how Earth’s distant past shapes our future.
Our evaluation explored how visitors process complex scientific topics, such as climate change, mass extinctions, the evolution of life on Earth, and humans’ role in positively impacting Earth’s future.
Approach
We designed a large-scale evaluation study with four distinct but interrelated parts:
A
The poster shares work conducted as part of the Modeling Zoos and Aquariums as Inclusive Communities of Science for Autistic Individuals (MoZAICS) project and specifically sharing details of the MoZAICS access and inclusion framework (e.g., definitions, structure/levels of the framework).
The COVID-19 pandemic tested many fundamental connections between science and society. A growing field working to strengthen those connections exists within the informal STEM learning (ISL) community which provides diverse learning and engagement environments outside the formal classroom. One of the largest funders of ISL initiatives is the National Science Foundation (NSF) which runs the Advanced Informal STEM Learning (AISL) program in the United States. The AISL program supports initiatives through six categories that include pilots and feasibility studies, research in service to practice
The McWane Science Center (MWSC) will create a new exhibition experience entitled “Dropping Science: Hip-Hop Interactive” that will capture the elements of the popular music genre using interpretive experiences. Project activities include exhibit content development; development of a formal evaluation plan; exhibit prototyping; remedial evaluation, and a final exhibit design plan. An important project goal is to develop the process for creating lasting, reciprocal relationships with the local African American community and throughout the region, thus creating an exhibit space that connects underrepresented audiences to STEM and establishes MWSC as a true community partner. The outcome of this project will be a new interactive experience that was co-developed with and representative of MWSC’s local community that helps MWSC connect with and engage local visitors in science through a more culturally and personally relevant lens.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
The Palo Alto Junior Museum & Zoo will create the California Dinosaur Garden exhibition, an inclusive environment for children ages 3 to 11 that promotes science learning. The museum will employ sensory-rich storytelling and interactive experiences to engage children and their caregivers. Project activities will include the completion of initial concept designs and evaluation to inform exhibit development; design development, prototyping, and formative evaluation; and engaging external contractors to fabricate and install the exhibit. The exhibition will include prehistoric plants within a seasonal marsh landscape, interactive interpretive exhibits, a fossil dig, and life-size dinosaur sculptures. The project will also address the need for science learning experiences for children with disabilities by applying universal design principals such as wheelchair access to the garden experience, braille labels, and tactile, sensory-rich elements.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
The Museum of Science in Boston, Massachusetts is one of the world’s largest science centers and the most visited cultural institution in New England. Located in Science Park, a piece of land that spans the Charles River, the museum is conveniently situated close to Boston and Cambridge. The museum has more than 700 interactive exhibits and a number of live presentations offered daily. One of these daily shows include live animal presentations, where museum visitors can learn more about some of the many animals that the museum cares for in its live animal center. An evaluation of these live
DATE:
TEAM MEMBERS:
Sarah RosenthalKristina OhlSadia Sehrish IslamMaría José Brito Páez
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.