Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceevaluationMuseum and Science Center Exhibits
This document presents the final evaluation report for the NSF-funded AISL project: "Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits."
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
This project will use a complex systems approach to hazard reduction across multiple scales of risk by developing a new generation of socio-technical digital twin that integrates models of physical infrastructure systems and virtual networks of communication with social games to engage community awareness and commitment to collective action.
DATE:
-
TEAM MEMBERS:
Kenichi SogaLouise ComfortStephen CollierMichael GollnerJ. Keith Gilless
While previous studies have found games and gaming to be a new and innovative communication strategy to inform the public and citizens about scientific research and engage them with it, this article addresses the under-researched question of credibility aspects in research-based gaming. The study analyses agricultural stakeholders' discussions on the credibility of scientific descriptions in The Maladaptation Game — a game based on research on climate change maladaptation in Nordic agriculture. The analysis of focus group transcripts and frame credibility finds that players attribute
‘Catan’® (1995) is a multiplayer tabletop game with global sales of over 20 million copies. Presented here is an exploration of the steps that were taken in the development of the ‘Catan: Global Warming’ expansion, from prototype to final design. During the playtesting of the game the feedback that we received from a variety of playtesters indicated that the game mechanics (rather than any accompanying story) were an effective and elegant way of developing dialogue around a specific topic, in this instance global warming. We conclude that in order to develop such a game, consideration must be
This NOVA multiplatform media initiative consisted of a 2-hour nationally broadcast PBS documentary, Polar Extremes; a 10-part original digital series, Antarctic Extremes; an interactive game, Polar Lab; accompanying polar-themed digital shorts, radio stories, text reporting, and social media content; a collection of educational resources on PBS LearningMedia; and community screening events and virtual field trips for science classrooms. Across multiple media platforms the project’s video content had nearly 13 million views.
The research explored the potential for informal STEM learning