Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
While previous studies have found games and gaming to be a new and innovative communication strategy to inform the public and citizens about scientific research and engage them with it, this article addresses the under-researched question of credibility aspects in research-based gaming. The study analyses agricultural stakeholders' discussions on the credibility of scientific descriptions in The Maladaptation Game — a game based on research on climate change maladaptation in Nordic agriculture. The analysis of focus group transcripts and frame credibility finds that players attribute
‘Catan’® (1995) is a multiplayer tabletop game with global sales of over 20 million copies. Presented here is an exploration of the steps that were taken in the development of the ‘Catan: Global Warming’ expansion, from prototype to final design. During the playtesting of the game the feedback that we received from a variety of playtesters indicated that the game mechanics (rather than any accompanying story) were an effective and elegant way of developing dialogue around a specific topic, in this instance global warming. We conclude that in order to develop such a game, consideration must be
This NOVA multiplatform media initiative consisted of a 2-hour nationally broadcast PBS documentary, Polar Extremes; a 10-part original digital series, Antarctic Extremes; an interactive game, Polar Lab; accompanying polar-themed digital shorts, radio stories, text reporting, and social media content; a collection of educational resources on PBS LearningMedia; and community screening events and virtual field trips for science classrooms. Across multiple media platforms the project’s video content had nearly 13 million views.
The research explored the potential for informal STEM learning
With the acceleration and increasing complexity of macro-scale problems such as climate change, the need for scientists to ensure that their work is understood has become urgent. As citizens and recipients of public funds for research, scientists have an obligation to communicate their findings in ways many people can understand. However, developing translations that are broadly accessible without being “dumbed down” can be challenging. Fortunately, tenets of visual literacy, combined with narrative methods, can help to convey scientific knowledge with fidelity, while sustaining viewers’
Presentation on NSF grant DRL-1011086 (""The Nexus of Energy, Water, and Climate: From Understanding to Action"") presented at the CAISE Convening on Sustainability Science and Informal Science Education, February 6th, 2012.