Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceevaluationMuseum and Science Center Exhibits
This document presents the final evaluation report for the NSF-funded AISL project: "Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits."
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
The Climate Change Toolkit includes a suite of resources that address the science behind climate change while encouraging participants to take action to reduce the effects of climate change. Each resource has been designed to be low cost and easy for educators to reproduce. Contents of the Toolkit include: (1) Ten Hands-on Cart Activities - These hands-on, cart-type science activities for families in an informal education setting or for children in an afterschool setting, engage participants with the science of climate change. The activities are divided into two categories, those that address the science behind climate change, and those that address how individual choices affect the rate of climate change. (2) Four Portable Self-Guided Exhibits Kits - These self-guided science kits use four hands-on activities per kit to explore how climate change is affecting the forest, ocean, urban, and atmosphere environments. Each kit can be packaged in a small bag or box and bundled together with an activity map box for check-out by families in an informal education setting. (3) Public Presentation - CO2 and You is a twenty-minute presentation that provides the option of using interactive clickers to introduce the science behind how fossil fuel consumption leads to climate change. The interactive presentation also explores how simple energy choices can have a positive effect on the climate. (4) Museum Field Trip Program - The Power the Future field trip uses an interactive diagram to explain how carbon based fossil fuels such as coal emit carbon dioxide and contribute to climate change. The program then discusses the need to transition away from carbon based energy sources such as fossil fuels to those that do not emit carbon dioxide, such as wind power. The second section of the program guides visitors through a hands-on inquiry activity where they explore their own windmills.
DATE:
TEAM MEMBERS:
Charlie TrautmannKatie LevedahlAlberto López
This Communicating Research to Public Audiences project focuses on the Reedy Glacier Antarctic research of Brenda Hall (OPP 0229034) and its relevance to the residents of and visitors to Maine. Collaborators include the University of Maine, the Maine Discovery Museum, the Acadia National Park and Cadillac Mountain Sports (an environmentally active retail company with several stores around the state). The primary deliverable is the development of an interactive software program that presents information and experiences in a two-tiered concept approach -- on the Reedy Glacier and its connection to Maine and on the process of science. The software is being configured into kiosks at the three partnering organizations, into a DVD format for informal and formal settings to be distributed at cost and onto a University of Maine Climate Change web portal currently under separate development. The project web site will provide source code for the portal design so others may use it to create portals and modules of their own. The Maine Discovery Museum intends to create additional exhibitry on the topic with resources outside this proposal, and the Acadia National Park will use the programs in teacher education workshops.
In this full-scale research and development project, Oregon State University (OSU), Oregon Sea Grant (OSG) and the Hatfield Marine Science Center Visitors Center (HMSCVC) is designing, developing, implementing, researching and evaluating a cyberlaboratory in a museum setting. The cyberlaboratory will provide three earth and marine science learning experiences with research and evaluation interwoven with visitor experiences. The research platform will focus on: 1) a climate change exhibit that will enable research on identity, values and opinion; 2) a wave tank exhibit that will enable research on group dynamics and problem solving in interactive engineering challenges; and 3) remote sensing exhibits that will enable research on visitor interactions through the use of real data and simulations. This project will provide the informal science educaton community with a suite of tools to evaluate learning experiences with emerging technologies using an iterative process. The team will also make available to the informal science community their answers to the following research questions: For the climate change exhibit, "To what extent does customizing content delivery based on real-time visitor input promote learning?" For the wave tank exhibit, "To what extent do opportunities to reflect on and share experiences promote STEM reasoning processes at a build-and-test exhibit?" For the data-sensing exhibit, "Can visitors' abilities to explain or use visualizations be improved by shaping their visual searches of images?" Mixed-methods using interviews, surveys, behavioral instruments, and participant observations will be used to evaluate the overall program. Approximately 60-100 informal science education professionals will discuss and test the viability of the exhibit's evaluation tools. More than 150,000 visitors, along with community members and local middle and high school students, will have the opportunity to participate in the learning experiences at the HMSCVC. This work contributes to the fields of cyberlearning and informal science education. This project provides the informal science education field with important knowledge about learning, customized content delivery and evaluation tools that are used in informal science settings.