This project is funded by the EHR Core Research (ECR) program, which supports work that advances fundamental research on STEM learning and learning environments, broadening participation in STEM, and STEM workforce development. It responds to continuing concerns about racial and social inequities in STEM fields that begin to emerge in the early childhood years. The overarching goal of the project is to identify cultural strengths that support early science learning opportunities among Spanish-speaking children from immigrant Latin American communities, a population that is traditionally underrepresented in STEM educational and career pursuits. Building on a growing interest in the ways stories can promote early engagement in and understanding of science, this project will investigate the role of oral and written stories as culturally relevant and potentially powerful tools for making scientific ideas and inquiry practices meaningful and accessible for young Latinx children. Findings will reveal ways that family storytelling practices can provide accessible entry points for Latinx children's early science learning, and recommend methods that parents and educators can use to foster learning about scientific practices that can, in turn, increase interest and participation in science education and fields.
The project will advance knowledge on the socio-cultural and familial experience of Latinx children that can contribute to their early science learning and skills. The project team will examine the oral story and reading practices of 330 Latinx families with 3- to 5-year-old children recruited from three geographic locations in the United States: New York, Chicago, and San Jose. Combining interviews and observations, the project team will investigate: (1) how conversations about science and nature occur in Latinx children's daily lives, and (2) whether and to what extent narrative and expository books, family personal narratives, and adivinanzas (riddles) engender family conversations about scientific ideas and science practices. Across- and within-site comparisons will allow the project team to consider the immediate ecology and broader factors that shape Latinx families’ science-related views and practices. Although developmental science has long acknowledged that early learning is culturally situated, most research on early STEM is still informed by mainstream experiences that largely exclude the lived experiences of children from groups underrepresented in STEM, especially those who speak languages other than English. The proposed work will advance understanding of stories as cultural resources to support early science engagement and learning among Latinx children and inform the development of high quality, equitable informal and formal science educational opportunities for young children.
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
Public outdoor spaces present opportunities for social experiences and learning. This Broader Implementation project will expand and evaluate a model that transforms urban public spaces into accessible and engaging environments for learning social science in outdoor public spaces. The model combines social science inquiry exhibits, place making and human facilitation of learning experiences in outdoor public areas. Project exhibits use the facilitated social interactions as both the content of and medium for the experiences. This project will adapt the existing exhibits and add new exhibits and facilitation techniques for testing in three different urban environments. Project research will explore the efficacy of these adaptations and revised facilitation techniques for the different settings in collaboration with civic partners at each site. The project will share the model and research findings widely through the Exploratorium website and publications for researchers, developers, and educators.
The team’s prior research showed that facilitators improved multiple learning outcomes with the current exhibits. Visitors acquired new social observation skills, reflected on their own experiences, perceptions, and actions, and increased their awareness for how social behavior, cognition, and emotion can be studied scientifically. Building on the prior research, the project will install the exhibition and test its efficacy in three different urban environments and explore the adaptations that are required for different settings with different civic partners. The project will use design-based research to develop a new theoretical model of facilitation strategies for supporting science learning in outdoor public spaces. For evaluation, the project will use mixed methods, including observations, interviews, surveys, and document review. Evaluation will assess success in attracting and engaging visitors; conveying social science concepts; prompting self-reflection of judgments and actions; and fostering empathy among those with different social identities. The project will assess the extent to which participants, particularly those from marginalized communities, experience feelings of belonging and inclusion. The project will be presented in three sites which represent the significant diversity, income levels, and urban environments of San Francisco. Facilitation strategies are being co-developed with Urban Alchemy, an organization that works within distressed urban communities in San Francisco. Project site partners and collaborators include the San Francisco Public Library, the Port of San Francisco, and the San Francisco Department of Parks and Recreation. The project will also measure partnership outcomes, through surveys and interviews, to look at the extent and ways the project integrates a co-creation model and develops an authentic, mutually beneficial, sustainable partnership. The project will generate and disseminate generalizable knowledge about the affordances of combining informal science learning, placemaking, and facilitation in a variety of free, outdoor STEM learning spaces in collaboration with local community groups. The project will also advance public understanding of the social and behavioral sciences.
This research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and sssessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Zoos and aquariums have been offering programming, events, and visit accommodations to autistic individuals for several years. While these efforts can provide great experiences, they are focused more on accommodation and the outward-facing guest experience than inclusion. Lack of inclusion features in design, programming, and representation amongst zoo and aquarium representatives, ultimately limits full inclusion and adds to a sense in autistic individuals of not belonging and not being welcomed. To develop a fully inclusive experience for autistic individuals, this project will develop an evidence-based framework of inclusive practices for zoos and aquariums and build a community of practice around inclusion broadly. The project brings together researchers from Oregon State University, Vanderbilt Kennedy Center’s Treatment and Research Institute for Autism Spectrum Disorders, and the Association of Zoos and Aquariums. Researchers will create and investigate the extent and ways in which a research-informed framework and associated tools (i.e. case studies, discussion guides, self-guided audits, etc.) and strategies support science learning for autistic individuals, and help practitioners expand access and inclusion of autistic audiences beyond special events or the general visit experience by applying inclusive practices for programs, exhibit development, internships, volunteer opportunities, and employment. To maximize impact, the project will develop and expand a network of early adopters to build a community of practice around inclusive practices to develop fully inclusive zoo and aquarium experiences for all individuals.
The project will investigate 4 research questions: (1) In what ways and to what extent are zoos and aquariums currently addressing access and inclusion for autistic individuals? (2) How do staff in zoos and aquariums perceive their and their institution’s willingness and ability to address access and inclusion for autistic individuals? (3) What is a framework of evidence-based practices across the zoo and aquarium experience that is inclusive for autistic individuals, and what associated tools and strategies are needed to make the framework useful for early adopters? And (4) to what extent and in what ways does a research informed framework with associated tools and strategies engage, support, and enhance an existing community of practitioners already dedicated to addressing autistic audiences and promote inclusive practices at zoos and aquariums for autistic people? The project is designed as two phases: (1) the research and development of a framework of inclusive practices and tools for supporting autistic individuals and (2) expanding a network of early adopters to build a community of practice around inclusive practices and an overall strategy of implementation. The framework will be informed through a state of the field study across the zoo/aquarium field that includes a landscape study and needs assessment as well as a review of literature that synthesizes existing research across disciplines for developing inclusive practices for autistic individuals in zoos and aquariums. The team will also conduct online surveys and focus groups to gather input from various stakeholders including zoo and aquarium employees and practitioners, autistic individuals, and their social groups (e.g., family members, peers, advocacy organizations). The second phase of the study will focus on sharing the framework and tools with practitioners across the zoo/aquarium field for feedback and reflection to develop an overall strategy for broader implementation and expanding the existing network of zoo and aquarium professionals to build a community of practice dedicated to the comprehensive inclusion of autistic individuals across the full zoo and aquarium experience. The results will be disseminated through conference presentations, scholarly publications, online discussion forums, and collaborative partners’ websites. The project represents one of the first of its kind on autistic audiences within the zoo and aquarium context and is the first to look at the full experience of autistic patrons to zoos and aquariums across programs/events, exhibits, volunteering, internship, and employment opportunities. A process evaluation conducted as part of the project will explore how the approach taken in this project may be more broadly applied in understanding and advancing inclusion for other audiences historically underserved or marginalized by zoos and aquariums.
This Research in Service to Practice project is supported by the Advancing Informal STEM Learning (AISL) program.
Science is a process of inquiry that involves question asking, experimentation, and exploration. However, for youth, it is often presented as settled, a fixed collection of facts, principles, and theories that can seem sterile and unimaginative. This project is designed to combat that idea. This Research in Service to Practice project brings scientists, middle school youth and choreographers together to explore unsettled scientific phenomena from a complex systems perspective using choreography and agent-based modeling (ABM), to engage all participants in cutting edge scientific inquiry. Given the ubiquity of complex systems, being able to adopt a complex systems perspective is critical to understanding the world and our relationship to it. However, research has shown that this can be a challenge, specifically for youth. While most complex systems research has not focused on the role of the body, recent studies have shown the promise and potential of embodiment as its own form of reasoning about complex systems. Thus, this project will create exploratory science spaces foregrounding embodiment in the process of scientific discovery. The program has two phases: (1) a 20-hour training workshop where scientists and choreographers engage in interdisciplinary collaborative design work, and (2) a 60-hour summer program where the researcher-practitioner partnership involving scientists, choreographers and youth engages in agent- based & embodied choreographic scientific modeling. The summer program takes place in community-based centers in Gainesville, FL and Boston, MA broadening perceptions of what science research looks like and can be. Each site will host 20 youth, two local scientists, and a local choreographer. Participants will engage in embodied collaborative inquiry, brainstorming and modeling to create choreographic representations and culminate in a public event for the community. The project aims to understand the experiences of and shifts in youth and scientists as they engage in these activities and to understand how to design such a model for informal learning. The project will also help scientists apply a complex systems lens to their own work and settled perspectives. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Using a design-based research (DBR) approach, the project will develop and expand embodied and agent-based learning theories, while also piloting, analyzing, and refining collaborative models for science learning in informal spaces. The research questions are: 1. How does engaging in the process of creating embodied and agent-based models of complex systems contribute to new ways of understanding science, de-settle ideas about the process of how science gets “made”, and impact understanding of the role of the body in making science? and 2. How can arrangements of bodies and modeling tools work together to support understanding of complex systems? The research and design are informed by three main theoretical principles: (a) science is “dance of agency”, a process of inquiry that through iterative dialogic interaction with tools, technology, and humans, produces understandings that more and more closely explain natural phenomena; (b) embodied-interactionist theories of learning allow us to understand representational sense-making by looking closely at the processes by which representations are made, not just at representational end- products; and (c) creative embodiment and agent based modeling are valuable tools for sense-making around complex science ideas and emergent phenomena. Two cycles of design, implementation, and analysis across two different informal learning sites will be conducted. Data will be collected at both sites, resulting in four implementation and data collection periods. Each round of implementation will be staggered so that reflections and lessons from an implementation can inform the next design iteration. This project will provide insights on the relationship between choreography and ABM as tools for scientific sense-making and expand ABM to consider the role of movement and bodies more broadly in physical space. It will also contribute to an understanding of how underrepresented youth’s perceptions and conceptions of science can be shaped through embodied science activities, and of the relationships these youth see between their own bodies and identities, science, and the creative arts. Finally, by involving individuals from underrepresented communities as researchers, designers, scientists, evaluators, and advisors, this project expands cross-cultural and training opportunities within the field of education and STEM research.
DATE:
-
TEAM MEMBERS:
Dionne ChampionAditi WaghLauren Vogelstein
Although approximately one-quarter of U.S. students reside in rural communities, rural youth are fifty percent less likely to receive and engage in out-of-school STEM experiences than their urban counterparts. In addition, there has been significantly more investment in understanding and improving informal experiences in urban settings than in rural settings. As a result, there is less known about the characteristics of learning ecosystems and programs that support STEM learning for youth in informal contexts within rural communities. This Research in Service to Practice project aims to address this challenge by exploring the feasibility of a culturally relevant and sustaining STEM program designed specifically for rural youth and their families. Parents and caregivers play a critical role in fostering youths’ interests and persistence in STEM through their own engagement and by connecting them to STEM opportunities and STEM-related fields and career pathways. Through a partnership between the High Desert Museum in Oregon, the Institute for Learning Innovation, Maine Mathematics and Science Alliance, JKS Consulting, and three informal science education institutions, a year-long series of STEM-based workshops and experiences for youth and their families will be co-designed by members of the rural community, informal STEM educators, and STEM professionals and implemented within the rural communities of the participating informal science education institutions—Caddo Mounds State Historic Site Weeping Mary (TX), High Desert Museum (OR), Oregon Coast Aquarium, and The Wild Center (NY). Each series will reflect the cultural knowledge, connections, and resources specific to each rural community. In addition, the informal STEM educators and STEM professionals will receive training on facilitating the culturally sustaining workshops and experiences. Researchers at the Institution for Learning Innovation and the Maine Mathematics and Science Alliance together with the evaluator at JKS Consulting will employ a collaborative design-based research approach to identify and study the STEM learning practices and supports that occur within the program to promote youths’ interests and persistence in STEM. The findings will offer evidence-based insights to the field on how to better engage, reflect, and provide opportunities for diverse rural communities. Ultimately, this research has the potential to advance the current understanding thereby, strengthening rural STEM learning ecosystems and broadening STEM participation among youth in rural communities.
Over a four-year project duration, a collaborative design-based research approach will be employed to address the following research questions: (1) How does culturally sustaining informal STEM programming for families in rural communities contribute to increases in youth STEM persistence? (1a) How might this vary in relation to family and community factors? (2) How does culturally sustaining informal family STEM programming increase community connectivity between STEM-related resources and institutions across informal and formal learning contexts in rural communities leading to a more robust and inclusive STEM learning ecosystem? (2a) To what extent do participating families, informal STEM educators, STEM professionals, and community partners each play a role in increasing this connectivity? The research sample will include 300 families with youth ages 8-11, informal science educators, and STEM professionals across all four sites. Surveys, interviews and observations will be the primary data sources. Analysis of Variance and simple descriptive statistical analysis will be used to analyze the quantitative data. The qualitative data will be analyzed using thematic coding through NVivo. In addition, to complement the research data, JKS Consulting will conduct the formative and summative evaluations of the project to hone effective practices for training informal science learning practitioners in developing and implementing place-based, inquiry-based family learning in rural communities and effective and sustainable practices for engaging rural families in place-based STEM. Findings from the research will be made available and widely distributed in publications, conference presentations, and a multi-part Research to Practice Toolkit designed for parents and caregivers, informal science educators, STEM professionals, and the informal education field at large.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program.
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
For many youth, gaining access to quality STEM (science, technology, engineering mathematics) experiences is a challenge. Inequity and underrepresentation of youth of color in STEM persist. The makerspace movement holds great promise in broadening participation in STEM among youth from underrepresented communities. Makerspaces are defined as collaborative workspaces inside a library, school, or other community location designed for creating, learning, exploring, and sharing with high- to low-tech tools. Despite the availability of making programs focused on STEM activities targeted towards youth of color, the field has few models for designing these programs in ways that build upon youths’ cultural assets and desires for making. Working collaboratively with youth, families, and maker educators in Lansing, Michigan, and Greensboro, North Carolina, this project aims to deepen the field’s understanding about the rich and deep ingenuity in STEM-based making that youth from underrepresented communities can engage. These insights will be leveraged towards advancing community-based maker programming across four community-based makerspaces. The project will also build capacity among STEM-oriented maker educators, researchers, and youth. This model is important because the voices and perspectives of families and communities have been largely absent from the formative knowledge and theory-building processes of the field of makerspace education.
This project will build new knowledge about how and why youth and families make at home, in communities, and in STEM-based maker programs. Collaborators for the project include the University of Michigan, the University of North Carolina at Greensboro, and four STEM- and youth-oriented making spaces in Lansing, Michigan, and Greensboro, North Carolina. This project will take place in two phases, exploring two main research questions: 1) What are the learning results of making at home and in the community? And 2) How do youth organize community resources for sustained STEM making, and what facilitates or hinders such organization? Phase one investigates the community resources (people, tools, materials, knowledge, data, and spaces) youth leverage towards making and how they do so across time. The project will study how youth connect these resources to STEM-rich making and what youth and families learn in the process. In phase two, design-based research will be used to apply phase one insights to the design of community-based STEM-rich maker programs in four maker clubs in Michigan and North Carolina. This work will develop an understanding of youths’ family and community-based STEM-based making practices, including the community resources (people, tools, materials, knowledge, data, and spaces) that youth leverage.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
The AI behind Virtual Humans Exhibit aims to communicate to the public about the capabilities and impact of artificial intelligence (AI) through AI technologies used in Virtual Humans including facial recognition and natural language processing. AI has and will continue to profoundly impact society in the United States and around the globe. It is important to prepare the nation’s youth and the future workforce with fundamental knowledge of AI. Informal settings, such as museums, offer open and flexible opportunities in helping youth and the general public learn about AI. Virtual Humans provide an ideal vehicle to illustrate many fields of AI, as AI is arguably the science of building intelligence that thinks and acts like humans. Led by a multidisciplinary team of researchers with expertise in AI, learning design, and assessment from the Institute for Creative Technologies at University of Southern California and the Lawrence Hall of Science at University of California, Berkeley, this project will develop a Virtual Human exhibit to engage visitors through structured conversations with a Virtual Human, while showcasing how AI drives the Virtual Human’s behavior behind the scenes. The exhibit will include collaborative learning experiences for visitors such as parent-child, siblings and peers to explore what AI is and is not, what AI is and is not capable of, and what impact it will have on their lives.
The project will investigate three research questions: (1) How can a museum exhibit be designed to engage visitor dyads in collaborative learning about AI? (2) How can complex AI concepts underlying the Virtual Human be communicated in a way that is understandable by the general public? And (3) How does and to what extent the Virtual Human exhibit increase knowledge and reduce misconceptions about AI?
The project leverages existing conversational Virtual Human technology developed through decades of collaborative research in AI, including machine vision, natural language processing, automated reasoning, character animation, and machine learning. Set in the informal setting of a museum, the exhibit will be designed following evidence-based research in Computer Supported Collaborative Learning. The project team will use a mixed methods design, drawing on design-based research methodologies and experimental studies. The research team will conduct analysis of visitor observations and interviews for iterative formative improvement. Randomized experimental studies will be conducted in both lab and naturalistic environments to gauge visitor knowledge about AI. Quasi-experimental analyses will be performed to study the relationship between engagement with exhibit features and AI knowledge. The project will produce an interactive exhibit with a Virtual Human installed at the Lawrence Hall of Science and other participating museums, and instruments to measure AI learning. The project will also produce a website where visitors can experience parts of the exhibit online and continue more in-depth learning about AI and the Virtual Human technology. The project holds the potential for producing theoretical and practical advances in helping the general public develop an understanding of AI capability and ethics, advancing knowledge in the process through which young learners develop knowledge about AI, and formulating design principles for creating collaborative learning experiences in informal settings. The results will be disseminated through conference presentations, scholarly publications, and social media. The Virtual Human exhibit will be designed for dissemination and made available for installations at informal science education communities.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.