Overview
In 2020, RK&A (now Kera Collective) partnered with the National Museum of Natural History to conduct a summative evaluation of the David H. Koch Hall of Fossils: Deep Time, a 31,000 square foot exhibition that explores how Earth’s distant past shapes our future.
Our evaluation explored how visitors process complex scientific topics, such as climate change, mass extinctions, the evolution of life on Earth, and humans’ role in positively impacting Earth’s future.
Approach
We designed a large-scale evaluation study with four distinct but interrelated parts:
A
The Palo Alto Junior Museum & Zoo will create the California Dinosaur Garden exhibition, an inclusive environment for children ages 3 to 11 that promotes science learning. The museum will employ sensory-rich storytelling and interactive experiences to engage children and their caregivers. Project activities will include the completion of initial concept designs and evaluation to inform exhibit development; design development, prototyping, and formative evaluation; and engaging external contractors to fabricate and install the exhibit. The exhibition will include prehistoric plants within a seasonal marsh landscape, interactive interpretive exhibits, a fossil dig, and life-size dinosaur sculptures. The project will also address the need for science learning experiences for children with disabilities by applying universal design principals such as wheelchair access to the garden experience, braille labels, and tactile, sensory-rich elements.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Dinosaurs of Antarctica is a giant screen film and outreach project that documents the work of NSF-funded researchers on expeditions to Shackleton Glacier during the 2017-2018 field season. This immersive film and companion television special will bring the past to life and engage the public, and particularly students in middle grades (6-9), with polar science through appealing, entertaining media experiences and informal learning programs. The film serves as a companion for the synonymous Antarctic Dinosaurs museum exhibition
This timeline was constructed by participants during the Center for Advancement of Informal Science Education (CAISE ISE Summit) meeting in March 3-5, 2010 to document histories, capture events, and share memories about the field of informal science education. Postings were shepherded into four main strands: key events, policy, infrastructure, and learning. Along the bottom, participants marked when they entered the field.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This Research in Service to Practice project will study how visual immersion and interactivity in augmented reality (AR) affects visitors' engagement and understanding of science. The research involves creating different versions of an AR exhibit to communicate paleontology research from the La Brea Tar Pits to the general public. Different versions of the exhibit will be compared to learn how design choices for immersion and interactivity impact visitors' engagement and understanding of science. The result of this study should be a model to follow for similar public exhibits, as well as design principles that generalize to AR experiences for a broader range of informal learning environments. This project will also demonstrate and report on specific AR mechanisms that help visitors understand the scientific process and increase knowledge about paleontology research.
The study includes a user-centered design and evaluation process with both formative and comparative studies. This project investigates two high-level design factors for mobile AR: visual immersion and interactivity. These impact the learning experience and the development so extensively that multiple versions are seldom compared. These factors also have unique considerations for informal settings, such as how to balance immersion against situational awareness (e.g., 3D viewers reduce field of view). One goal of this project is to systematically compare qualitatively different AR designs that convey equivalent science content and study these tradeoffs empirically. The second goal is to leverage these findings to publicly release an AR experience that promotes engagement, increases understanding of science, and reduces scientific misconceptions. This research will also contribute to understanding usability and logistical issues for different AR designs for public, outdoor, informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Emily LindseyBenjamin NyeGale SinatraWilliam Swartout
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
Dinosaurs have been a very popular science topic since signs of their presence on earth were first discovered. They have represented so-called ‘edutainment’ for some people. Learning from informal sources and in- an out-of-school environment can be effective and motivating. In this study, 12-year-old pupils (N = 366) visited a dinosaur science centre exhibition in Finland. Pupils were tested with standardised tests of motivation as defined by self-determination theory, cognitive skills, and interest via pre-, post-, and delayed post-tests during a six-month period. Findings show that pupils
DATE:
TEAM MEMBERS:
Hannu SalmiHelena ThunebergMari-Pauliina Vainikainen
The National Museum of the American Indian, NY (NMAI-NY) contracted RK&A to conduct a two-phase formative evaluation of the museum’s upcoming Native New York exhibition. The study’s objectives for walk-in visitors and teachers were to understand their baseline knowledge, what piques their interest, potential barriers (confusion or misunderstanding), strategies to help make personal connections, and how/if they understand exhibition outcomes (such as appreciate who Native Americans are today and understand that Native peoples have powerfully shaped and defined New York’s geography, economy, and
The Concord Museum contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation of its current permanent exhibition gallery—Why Concord?—in preparation for a comprehensive reinterpretation and reinstallation of the museum’s permanent collections funded by an IMLS grant. The goal of the evaluation was to understand the current visitor experience in Why Concord? and to explore visitors’ responses to several ideas the museum is considering for the updated exhibition. Specifically, the evaluation explored the extent to which visitors find history relevant (in general, in the
The San Diego Natural History Museum (theNAT) contracted RK&A to conduct a summative evaluation of the exhibition Extraordinary Ideas from Ordinary People: A History of Citizen Science and to explore how well the exhibition communicates an inclusive view of science. The goals for the evaluation were to explore visitors’ behaviors in the exhibition as well as understand what meanings visitors made from the exhibition, particularly with regard to how the exhibition’s messages about citizen science are resonating in the context of visitors’ science identity.
RK&A conducted timing and tracking
In 2012, the Conner Prairie Interactive History Park began work on the National Science Foundation-funded Prairie Science project. Its goal: to produce a framework for integrating informal science experiences into exhibitions, interpretation, and programs at historic sites and museums. From the outset, the core project team acknowledged that the task of integrating STEM (Science, Technology, Engineering, and Math) and history learning would challenge the norms of both disciplines and institutions. Conner Prairie is a history museum in Fishers, Indiana, with a long tradition of exploring novel