This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
The project will develop and research a new system that bridges the advantages of physical and virtual worlds to improve young children's inquiry-based science learning and engagement in a collaborative way. The project will use innovative technology and successful techniques developed for adaptive tutoring systems and bring this core research into informal learning settings where they haven't been applied before, with the goal of increasing engagement, learning and deep inquiry-based understanding in these environments. Museums and similar informal learning settings offer opportunities for children and families to learn together in an engaging way. However, without learning supports provided by people, signage, or technology, people often miss the point of the learning activity in museums. The project will develop a new genre of "intelligent" interactive science exhibits that combine proven intelligent tutoring system approaches with camera-based vision sensing to add a new layer to hands-on museum exhibits. This intelligent layer provides personalized interactive feedback to museum visitors while they experiment with physical objects in the real world. The project is a collaborative effort led by the Human Computer Interaction Institute at Carnegie Mellon University in partnership with the University of Pittsburgh Learning Research and Development Center, Children's Museum of Pittsburgh, and Carnegie Science Center. It is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
The project will research whether and how learning principles and adaptive, computer-based technologies that are effective in formal school learning be made effective in an informal museum experience with hands-on activities to enhance the learning and engagement of children and parents. The system will use intelligent camera sensing that tracks and notices children's interaction in physical and virtual spaces and provides adaptive personalized feedback via the help of an engaging character. It guides the children as well as the parents to engage in productive dialogue, helping shape a better parent-child interaction. To investigate this, the project will further develop an innovative mixed-reality system and smart adaptive system that gives personalized feedback to visitors based on their actions, guiding them to understand the world around them like a scientist. The project will gather data on learner behaviors in mixed-reality experiences in informal settings to inform how to better design intelligent science exhibits and derive patterns to support key outcomes, including learning, engagement, collaboration, and productive dialogue. The project will also research the application of these design patterns across different science content areas.
DATE:
-
TEAM MEMBERS:
Ken KoedingerScott HudsonKevin CrowleyNesra Yannier
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
Informal learning, and by extension, museums, are inherently emotional experiences, evoking feelings of awe, excitement, and curiosity. Oftentimes, museum professionals have prioritized traditionally positive emotions such as excitement and interest as being the most desirable and useful in supporting museum learning. However, prior research into naturally occurring emotions at museums found that some visitors who experienced negative emotions, such as confusion or frustration, at exhibits also reported deeper engagement and overall feelings of satisfaction (Rappolt-Schlichtmann et al., 2017). Based on these findings and similar results from formal education (D’Mello et al., 2014), this project team has worked to develop and refine a framework of strategies for creating exhibits that invoke and support visitors through the complex emotional state called productive struggle (PS) which is defined as a three-part emotional arc characterized by: 1) disequilibrium (experienced emotionally as emotions like confusion, frustration, surprise, or unease) that arises from encountering a challenging task, phenomenon, or idea, 2) persistence through the task which is supported by exhibit design scaffolds, and 3) an emotionally productive resolution tied to the source of disequilibrium or an overall sense of effortful achievement. In deliberately attending to and supporting a range of negative and positive emotions in museums, visitors can gain access to a wider variety of complex emotional experiences, including those critical to STEM learning, and have potential to broaden participation in STEM by supporting learners' diverse emotional needs and preferences.
This multidisciplinary project team consisting of researchers and exhibit professionals utilized a design-based research (DBR) process to develop, test, and refine a definition of museum-based productive struggle, and create a framework of design strategies that support PS. Three physical exhibits and a virtual exhibit were created during this multi-year project. Additionally, a summative research study was conducted with 105 youth ages 10-17 to explore: 1) whether visitors experienced the expected emotional arc of PS; 2) how exhibit design strategies supported PS; and 3) the extent of visitors’ learning and engagement at these PS exhibits.
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
This EAGER project sought to generate early knowledge for the museum field about the capabilities and limitations of an Indoor Positioning System to: 1) automate the collection of visitor movement data for museum research, and 2) enable location-aware applications designed to support museum visitor learning. Working with Qualcomm, Inc., the Exploratorium installed and experimented with an early prototype of a whole-museum, WiFi-based IPS that acquired and processed timestamped location data (latitude/longitude) from mobile test devices, similar to cell phones. The project 1) defined IPS ground
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Using hand-held mobile devices this project would test specialized Signing Glossaries for Science Exhibits (SGSE). The glossaries are developed from 5000 unique signing terms specific to the science in 6 partner institutions and designed to reach families with at least one member, ages 5-12+, who is deaf or hard of hearing and uses American Sign Language (ASL) for communication. The project would demonstrate the potential effectiveness of the venue-specific signing glossaries to enhance access to STEM learning during visits to informal STEM learning environments such as aquariums, botanical gardens, natural history museums, nature centers, science museums, and zoos.
While utilizing existing domain specific signing terms, the project will adapt and improve on their use in content specific informal science venues to increase the opportunity for the target audience to both enjoy and benefit from the wide array of informal science learning opportunities available to this group. The research should reveal how this approach might benefit those with other types of disabilities. The research questions are designed to understand both how family members might interact with a hearing disabled family member as well as how the disabled individual might learn more about a variety of STEM content in a setting that is not domain specific but uses the influence of science exhibits to inform, engage and interest members of the public generally.
Domain specific signing dictionaries have been developed, many by this PI, to address access to content specific topics in STEM. This proposal extends this concept to informal learning environments that are content specific to increase the opportunity for those with hearing disabilities to increase their capability to both enjoy informal science learning venues and to understand more of what these venues provide in terms of science learning.
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
Roots of Wisdom (also known as Generations of Knowledge; NSF-DRL #1010559) is a project funded by the National Science Foundation that aims to engage Native and non-Native youth (ages 11-14) and their families in Traditional Ecological Knowledge (TEK) and western science within culturally relevant contexts that present both worldviews as valuable, complementary ways of knowing, understanding, and caring for the natural world. The Oregon Museum of Science and Industry (OMSI) and its partner organizations, The Indigenous Education Institute (IEI), The National Museum of the American Indian (NMAI
Roots of Wisdom (also known as Generations of Knowledge) is a 5-year project funded by the National Science Foundation (NSF-DRL #1010559) in support of a cross-cultural reciprocal collaboration to develop a traveling exhibit, banner exhibit, and education resources that bring together Traditional Ecological Knowledge (TEK) and western science. The summative evaluation for public audience impacts was conducted by the Lifelong Learning Group (COSI, Columbus, OH), in collaboration with Native Pathways (Laguna, NM).