This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
This paper presents synthesized research on where XR is most effective within a museum setting and what impact XR might have on the visitor experience.
The Front-End Evaluation for the Mars Habitat exhibit component was conducted to inform the project team about overall public reactions to the concept of the exhibit, as well as to gather feedback about content, activity and the potential structure and building aspects of the component. This data was also used to help guide the development of an exhibit prototype and the subsequent testing of related ideas, materials and builds. This document includes the full data set and results of the front-end data collection.
The questions that were used for this evaluation included three main focus
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
Sense-making with data through the process of visualization—recognizing and constructing meaning with these data—has been of interest to learning researchers for many years. Results of a variety of data visualization projects in museums and science centers suggest that visitors have a rudimentary understanding of and ability to interpret the data that appear in even simple data visualizations. This project supports the need for data visualization experiences to be appealing, accommodate short and long-term exploration, and address a range of visitors’ prior knowledge. Front-end evaluation
We examined the conversational reflections of 248 families with 6–11‐year‐old children shortly after they visited a tinkering exhibit. Our aim was to understand the conditions of tinkering and conversational reflection that can enhance STEM learning opportunities for young children. We discuss implications for the design of tinkering and reflection activities that can both reveal and advance STEM learning.
The Lemelson Center for the Study of Invention and Innovation (Lemelson) at the National Museum of American History (NMAH) contracted RK&A to conduct a front-end evaluation of Game Changers, a new exhibition that will highlight stories of invention and innovation related to sports. The goals of the study were to identify visitors’ associations with sports and invention and explore their reactions to preliminary exhibition concepts and titles.
How did we approach this study?
RK&A conducted 40 in-depth interviews with walk-in visitors to NMAH. As much as possible, RK&A recruited
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
resourceevaluationProfessional Development, Conferences, and Networks
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
The COMPASS conference will bring together 80 participants for two days in September 2018 at the Exploratorium in San Francisco, CA. The first dissemination will take place in a presentation at the ASTC conference the following month in October 2018. A webinar sharing insights from COMPASS and inviting others to engage will be held in March 2019 hosted by ASTC and accessible by ASTC members and non-members alike. A companion COMPASS e-publication will be released for free download, also in March 2019, with summaries of conference proceedings, key issues identified, case histories of ILAM in
Exploration Place, with funding from the National Aeronautics and Space Administration (NASA), contracted RK&A to conduct a summative evaluation of Design Build Fly, an exhibition and program series that explores what happens behind-the-scenes in Wichita’s aircraft plants. The goals of the study were to identify how visitors use the exhibition, explore what meaning visitors make from Design Build Fly, and understand to what extent visitors’ meaning-making aligns with intended outcomes.
How did we approach this study? RK&A conducted timing and tracking observations of visitors to the
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.