The linked repository contains select resources from the SICIIT NSF project (Supporting Science and Engineering Identity Change in Immersive Interactive Technologies). The project did not reach its main objective, mainly due to disruptions caused by COVID, but we hope that the materials will be a useful resource for follow-up research.
DATE:
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Science Behind Pixar (SBP) exhibition was the product of a collaborative effort among the Museum of Science, Boston (MOS), Pixar Animation Studios, and the Science Museum Exhibit Collaborative (SMEC). The 13,000 square foot exhibition presented the science, math, and computer science behind Pixar Animation Studios’ animated films and innovation. Before entering SBP, visitors watched a five-minute film that oriented them to the exhibition and discussed its main messages. Visitors then interacted with screen-based and physical interactive exhibits, as well as the technical pipeline of the
Becoming computationally literate is increasingly crucial to everyday life and to expanding workforce capacity. Research suggests that computational literacy--knowing what, when, how, and why to use the ideas of computer science, in combination with the capacity to view problems and potential solutions through the lens of computational structures and procedures--can be supported through digital game play. This project aims to develop a social and creative exhibit game that foregrounds aspects of computer science, specifically artificial intelligence (AI) and computer programming, in ways that enable youth to explore, construct, and share computational complex systems content with one another and other museum visitors. To play the game, pairs of youth visitors will use code cards to program the behavior of AI animals in a virtual forest. As they do so, youth will engage with computational literacy practices, such as basic computer programming, describing their computational ideas, and doing computational problem solving with their friends. Their activity will be projected on a large screen as a strategy for enabling youth to test, rehearse, and communicate their computational ideas and to also interest other visitors into computational problem solving.
Using multi-perspective and iterative design-based research, university learning scientists, museum practitioners, and game developers will pursue research questions around how science museums can better engage youth who are traditionally underrepresented in computer science in complex computational practices. Data sources will include interactive-log data, observations of visitor interactions with the game, visitor interviews, and visitor surveys. A multimodal and mixed methods approach that searches for convergences between qualitative analysis, quantitative analysis, and learning analytics will be used to generate research findings. Changes in computational literacy will be assessed by evaluating what problems visitors choose to solve with programming, how they frame those problems, and their selections from among possible solutions, what they program, how they program, and how they describe programming ideas. The results of this project will include: 1) a social, interactive gameplay experience that supports the development of computational literacy; 2) design principles for game-based exhibits that facilitate development of computational literacy; and 3) new knowledge of variations in design and gameplay across diverse gameplay users, including those from underrepresented groups in computer science. It is anticipated that 1,000 museum youth visitors will directly participate in the study.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Matthew BerlandLeilah LyonsMatthew Cannady
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
C-RISE will create a replicable, customizable model for supporting citizen engagement with scientific data and reasoning to increase community resiliency under conditions of sea level rise and storm surge. Working with NOAA partners, we will design, pilot, and deliver interactive digital learning experiences that use the best available NOAA data and tools to engage participants in the interdependence of humans and the environment, the cycles of observation and experiment that advance science knowledge, and predicted changes for sea level and storm frequency. These scientific concepts and principles will be brought to human scale through real-world planning challenges developed with our city and government partners in Portland and South Portland, Maine. Over the course of the project, thousands of citizens from nearby neighborhoods and middle school students from across Maine’s sixteen counties, will engage with scientific data and forecasts specific to Portland Harbor—Maine’s largest seaport and the second largest oil port on the east coast. Interactive learning experiences for both audiences will be delivered through GMRI’s Cohen Center for Interactive Learning—a state-of-the-art exhibit space—in the context of facilitated conversations designed to emphasize how scientific reasoning is an essential tool for addressing real and pressing community and environmental issues. The learning experiences will also be available through a public web portal, giving all area residents access to the data and forecasts. The C-RISE web portal will be available to other coastal communities with guidance for loading locally relevant NOAA data into the learning experience. An accompanying guide will support community leaders and educators to embed the interactive learning experiences effectively into community conversations around resiliency. This project is aligned with NOAA’s Education Strategic Plan 2015-2035 by forwarding environmental literacy and using emerging technologies.
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
Informal Community Science Investigators (iCSI) creates a network of four geographically diverse informal science institutions working together on strategies to engage youth ages 10-13 through location based augmented reality (AR) games played on smartphones. These high-interest, kid-friendly games will be used by families visiting the institutions and by youth who enroll in more intensive summer camp programs. Using AR games, participants will engage in playful but scientifically-grounded investigations drawing on each institution's research, exhibits, and natural spaces. For example, a botanical garden might engage young visitors through AR games with themes related to native and invasive species, while a zoo might create a game experience focusing on illegal wildlife trade. Participants in the iCSI summer camp program will have more intensive experiences, including work with the host institution's scientists, opportunities to develop original augmented reality games, and experiences with game-related service learning and citizen science programs. For both target groups (families and campers), the location specific games build understanding of both the institution's mission and the broader realm of scientific research and application. The project will test the notion of participants as "learner hero," the link between game play and the individual's development of competency, autonomy and the relationship to real world experience, in this case through community action on the subject of the game developed. To that end, participants will be encouraged to extend their involvement through related investigations on site and participation in community activities and projects that can be done at home. Social media tools such as Facebook and web sites managed by the host institutions will provide recognition for this extended engagement, helping participants maintain ties to the program. Additionally, program resources provide assistance to adult family members in nurturing and sustaining youth interest in STEM activities and careers. A major effort of the project will be development of a new software infrastructure called TaleBlazer for the augmented reality game that will enable teachers and students to develop their own game that incorporates real data collection and scientific model building. The new platform will enhance the game play platform MITAR developed with NSF funding.
Much of the work done in the field of tangible interaction has focused on creating tools for learning; however, in many cases, little evidence has been provided that tangible interfaces offer educational benefits compared to more conventional interaction techniques. In this paper, we present a study comparing the use of a tangible and a graphical interface as part of an interactive computer programming and robotics exhibit that we designed for the Boston Museum of Science. In this study, we have collected observations of 260 museum visitors and conducted interviews with 13 family groups. Our
DATE:
TEAM MEMBERS:
Michael HornErin SoloveyR. Jordan CrouserRobert Jacob
In this paper we describe the design and initial evaluation of a tangible computer programming exhibit for children on display at the Boston Museum of Science. We also discuss five design considerations for tangible interfaces in science museums that guided our development and evaluation. In doing so, we propose the notion of passive tangible interfaces. Passive tangibles serve as a way to address practical issues involving tangible interaction in public settings and as a design strategy to promote reflective thinking. Results from our evaluation indicate that passive tangibles can preserve
DATE:
TEAM MEMBERS:
Michael HornErin SoloveyRobert Jacob
Laurel Clark Earth Camp was a set of interconnected programs for Middle and High School students and their teachers that help them develop new perspectives on global change. The project was a partnership of the Arizona-Sonora Desert Museum, Arizona Project WET at the University of Arizona, and the Planetary Science Institute in Tucson, Arizona. Project goals were to: I. Engage students in lifelong learning in STEM disciplines to inform their Earth stewardship practices, career decisions and capacity for innovation; II. Provide teachers with tools and experiences to inspire students to discover the real-world relevancy of STEM disciplines and apply this learning to the pursuit of STEM careers and technological innovation; III. Enhance public awareness of environmental change in the southwestern US and the importance of NASA satellites for recording, understanding and predicting these changes. Over four years, Earth Camp served 132 students and 42 teachers. Program participants understand more about Earth System connectivity and are more aware of their impacts on the environment and how to quantify and reduce these impacts. A post-camp online survey of alumni from previous years indicated that 75% of participants were felt that the camp influenced them to be more interested in STEM careers and 80% were more motivated to do well in their science classes. Teachers in the program were able to implement many of the project activities in their classrooms and most of them were exposed to satellite data for the first time; The project also created a public exhibit “Earth Change from Space” at the Arizona-Sonora Desert Museum, and an online tool that allowed students to explore, research and report on global change issues using Google Earth historical imagery.
Bridging Earth and Mars (BEAM): Engineering Robots to Explore the Red Planet engages the general public and K-8 students in exhibits and programs designed to foster awareness of robotic technology, computer programming, and the challenges and opportunities inherent in NASA missions and S-STEM careers. The Saint Louis Science Center (SLSC) of St. Louis, Missouri is the lead institution and project site; partners include Washington University in St. Louis, Saint Louis University, the St. Louis regional FIRST Robotics organization, and the Challenger Learning Center-St. Louis. Project goals are to: 1) inform, engage, and inspire the public to appreciate NASA’s Mission by sharing findings and information about NASA’s missions to Mars; 2) ignite interest in S-STEM topics and careers for diverse K-8 students; and, 3) encourage students in grades 6-8 to sustain participation in educational experiences along the S-STEM careers pipeline. The SLSC will design and build a Martian surface and panorama where two rovers can be remotely controlled. Visitors in the McDonnell Planetarium will use controllers to program rover exploration of the Martian landscape in real-time. Visitors in SLSC’s Cyberville gallery, located one-quarter mile away across a highway-spanning enclosed bridge, will program the second rover with simulated time lag and view its movements via a two-way camera system. SLSC will organize and host a series of Innovation Workshops for K-8 students, each featuring teamwork-building engineering challenges from current and updated NASA-based science curricula. Participants will be recruited from SLSC community partners, which include community centers and faith-based programs for underserved families.