Artificial intelligence (AI) is in many of our everyday activities—from unlocking phones to running Internet searches to parking cars. Yet, most instruction on how AI works is only in computer science courses. The unique role that AI plays in making decisions that affect human lives heightens the need for education approaches that promote public AI literacy. Little research has been done to understand how we can best teach AI in informal learning spaces. This project will engage middle school age youth in learning abouts AI through interaction with museum exhibits in science and technology centers. The exhibits employ embodied interactions and creative making activities that involve textiles, music making, and interactive media. The research will build on three exhibit prototypes that teach about concepts including bias in data in machine learning, AI decision-making processes, and how AI represents knowledge. Female-identifying and Title 1 youth will be recruited as participants during the exhibit design iterations and testing. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments
Researchers will explore two key research questions: 1) How can the design of interactive museum exhibits encourage interest development in and learning about AI among learners without a Computer Science background by using embodiment and creative making? and 2) How do embodied interaction and creative making mediate learning about AI in informal learning environments? The project will take a design-based research approach, iteratively building on existing exhibit prototypes and testing them in-situ with learners. Data sources and modes of analysis will include retrospective surveys to assess interest, content knowledge gain, creativity, learning talk analysis of audio recordings, and coding of embodied movements in video recordings. Learning talk analysis will identify instances of joint sensemaking during naturalistic interactions with our exhibit to reveal connections between sensemaking talk; learners' behaviors and embodied actions during real-time collaborative knowledge building; and outcomes in knowledge, interest, and creativity measures as elicited in retrospective surveys. The final set of exhibits will be rigorously evaluated with over 500 museum visitors. The key contributions of this work will include a set of rigorously tested exhibits, publicly available exhibit designs, a set of design guidelines for developing AI literacy museum exhibits, and an improved understanding of the relationship between AI-related learning and interest development, embodiment, and creativity.
DATE:
-
TEAM MEMBERS:
Brian MagerkoDuri LongJessica Roberts
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
The AI behind Virtual Humans Exhibit aims to communicate to the public about the capabilities and impact of artificial intelligence (AI) through AI technologies used in Virtual Humans including facial recognition and natural language processing. AI has and will continue to profoundly impact society in the United States and around the globe. It is important to prepare the nation’s youth and the future workforce with fundamental knowledge of AI. Informal settings, such as museums, offer open and flexible opportunities in helping youth and the general public learn about AI. Virtual Humans provide an ideal vehicle to illustrate many fields of AI, as AI is arguably the science of building intelligence that thinks and acts like humans. Led by a multidisciplinary team of researchers with expertise in AI, learning design, and assessment from the Institute for Creative Technologies at University of Southern California and the Lawrence Hall of Science at University of California, Berkeley, this project will develop a Virtual Human exhibit to engage visitors through structured conversations with a Virtual Human, while showcasing how AI drives the Virtual Human’s behavior behind the scenes. The exhibit will include collaborative learning experiences for visitors such as parent-child, siblings and peers to explore what AI is and is not, what AI is and is not capable of, and what impact it will have on their lives.
The project will investigate three research questions: (1) How can a museum exhibit be designed to engage visitor dyads in collaborative learning about AI? (2) How can complex AI concepts underlying the Virtual Human be communicated in a way that is understandable by the general public? And (3) How does and to what extent the Virtual Human exhibit increase knowledge and reduce misconceptions about AI?
The project leverages existing conversational Virtual Human technology developed through decades of collaborative research in AI, including machine vision, natural language processing, automated reasoning, character animation, and machine learning. Set in the informal setting of a museum, the exhibit will be designed following evidence-based research in Computer Supported Collaborative Learning. The project team will use a mixed methods design, drawing on design-based research methodologies and experimental studies. The research team will conduct analysis of visitor observations and interviews for iterative formative improvement. Randomized experimental studies will be conducted in both lab and naturalistic environments to gauge visitor knowledge about AI. Quasi-experimental analyses will be performed to study the relationship between engagement with exhibit features and AI knowledge. The project will produce an interactive exhibit with a Virtual Human installed at the Lawrence Hall of Science and other participating museums, and instruments to measure AI learning. The project will also produce a website where visitors can experience parts of the exhibit online and continue more in-depth learning about AI and the Virtual Human technology. The project holds the potential for producing theoretical and practical advances in helping the general public develop an understanding of AI capability and ethics, advancing knowledge in the process through which young learners develop knowledge about AI, and formulating design principles for creating collaborative learning experiences in informal settings. The results will be disseminated through conference presentations, scholarly publications, and social media. The Virtual Human exhibit will be designed for dissemination and made available for installations at informal science education communities.
Becoming computationally literate is increasingly crucial to everyday life and to expanding workforce capacity. Research suggests that computational literacy--knowing what, when, how, and why to use the ideas of computer science, in combination with the capacity to view problems and potential solutions through the lens of computational structures and procedures--can be supported through digital game play. This project aims to develop a social and creative exhibit game that foregrounds aspects of computer science, specifically artificial intelligence (AI) and computer programming, in ways that enable youth to explore, construct, and share computational complex systems content with one another and other museum visitors. To play the game, pairs of youth visitors will use code cards to program the behavior of AI animals in a virtual forest. As they do so, youth will engage with computational literacy practices, such as basic computer programming, describing their computational ideas, and doing computational problem solving with their friends. Their activity will be projected on a large screen as a strategy for enabling youth to test, rehearse, and communicate their computational ideas and to also interest other visitors into computational problem solving.
Using multi-perspective and iterative design-based research, university learning scientists, museum practitioners, and game developers will pursue research questions around how science museums can better engage youth who are traditionally underrepresented in computer science in complex computational practices. Data sources will include interactive-log data, observations of visitor interactions with the game, visitor interviews, and visitor surveys. A multimodal and mixed methods approach that searches for convergences between qualitative analysis, quantitative analysis, and learning analytics will be used to generate research findings. Changes in computational literacy will be assessed by evaluating what problems visitors choose to solve with programming, how they frame those problems, and their selections from among possible solutions, what they program, how they program, and how they describe programming ideas. The results of this project will include: 1) a social, interactive gameplay experience that supports the development of computational literacy; 2) design principles for game-based exhibits that facilitate development of computational literacy; and 3) new knowledge of variations in design and gameplay across diverse gameplay users, including those from underrepresented groups in computer science. It is anticipated that 1,000 museum youth visitors will directly participate in the study.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Matthew BerlandLeilah LyonsMatthew Cannady
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments. The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar