Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Dinosaurs of Antarctica is a giant screen film and outreach project that documents the work of NSF-funded researchers on expeditions to Shackleton Glacier during the 2017-2018 field season. This immersive film and companion television special will bring the past to life and engage the public, and particularly students in middle grades (6-9), with polar science through appealing, entertaining media experiences and informal learning programs. The film serves as a companion for the synonymous Antarctic Dinosaurs museum exhibition
Science centers are seen as places for communication of science very focused on the mise en scène of the content and methodologies of natural sciences. However, in the recent history, these institutions are transforming their role within education and transformation processes in the society they are engaged with. This communication presents a social project in Medellín, Colombia, that involves a vulnerable community, the local authorities of the city, academic institutions and NGO’s and a science center that is neighbor to this community.
In January 2006, my wife Susannah Sayler and I set out to photograph landscapes around the world that were being transformed by global warming. We called our work The Canary Project. From the beginning, as now, we had both activist aims and artistic ambitions. These two types of motivation overlap in places and in other places feel completely distinct. In general, we feel as though are carrying forward a torch that science cannot carry any further. Following are some thoughts on our role as activists and as artists and as collaborators with the scientific community.
In the globalisation era, arts have provided food for thought on “how latitudes became forms”, to stress again that now, at global level, one should no longer define art as a contemplation “space”, but as an “environment”, a place for experience. On the other hand, already when Bern saw the inauguration of the historic exhibition “When Attitudes became Forms” in 1969, people realised that the problem was lying in the behaviour, in the attitude, of making arts towards the world. Basically, the formalistic concept of self-referentiality in a work of art was to be overcome, and attention was to
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. Native Universe (NU) was designed to build institutional capacity in leadership and practice among scientific museums, in order to increase public understanding of environmental change and the human relationship to nature from Indigenous perspectives, while also providing access to science as practiced in the established scientific community.