This Informal Learning Review article briefly recounts the activities of Center for Advancement of Informal Science Education's (CAISE) over three award periods, from 2007 through 2022. It includes links to key CAISE resources and event documentation. CAISE sunsetted its activities in early 2022 and passed the baton of leadership of the National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) program resource center to REVISE- the Reimagining Equity and Values in Informal STEM Education center.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
This award is funded with support from NSF's program for Advancing Informal STEM Education.
This project develops a partnership between language researchers and Planet Word, a new museum devoted to language in Washington D.C., to engage museum visitors in scientific research and outreach. Interested museum visitors from all ages and backgrounds are invited to participate in behavioral research studies on a range of language-related topics. This "living language laboratory" of interactive studies includes accompanying educational demonstrations. These activities will lead to the development of infrastructure and best practices that will allow future language researchers to engage with the public at Planet Word and other similar sites.
The project enhances scientific understanding by engaging visitors in activities that expose them to active science about language as a part of their visit to the museum. For example, the research examines topics from understanding what makes certain American Sign Language signs more learnable, to why it is easier to understand people we know rather than strangers, to whether we think differently when we are reading a text message compared to reading more formal writing. In doing so, the project raises the profile of linguistics among the general public and promotes scientifically informed attitudes about language. The project also provides key opportunities to disseminate research findings of interest to the public and to promote greater interest in STEM topics among museum visitors, as well as student trainees and museum staff. The project creates educational and research opportunities for students, who will be trained in a hands-on course, and will gain first-hand experience with research and outreach in a museum setting. Through the collaborative partnership of researchers from University of Maryland, Howard University, and Gallaudet University, the project broadens participation of underrepresented minority students in the language sciences, seeking to diversify the pipeline of scholars continuing in careers in the language sciences and related STEM fields.
DATE:
-
TEAM MEMBERS:
Charlotte VaughnYi Ting HuangDeanna GagnePatrick Plummer
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Creating science education that can contribute to cultivating just, culturally thriving, and sustainable worlds is an important issue of our time. Indigenous peoples have persistently been under-represented in science reproducing inequalities in a myriad of ways from educational attainment, participation in and contributing to innovations in foundational knowledge, to effective policy making that upholds and respects Indigenous sovereignty. The development of models of science education that attend to intersections of knowledge and development, socio-scientific decision-making and civic leadership, and the complexities and contradictions of these realities, is imperative. This five-year Innovations in Development project broadens participation and strengthens infrastructure and capacity for Indigenous learners to meet, adapt to, and lead change in relation to the socio-ecological challenges of the 21st century. The project engages multi-sited community-based design studies to develop and research the impacts of Indigenous informal field-based science education with three Indigenous leadership communities from the Pacific Northwest and the Great Lakes. This project will have broader impacts through model development, building infrastructure to transform the capacity of informal field-based science education, and will produce cutting edge foundational knowledge about pressing 21st century issues with a particular focus on Indigenous communities. The project increases Indigenous participation in research through 1) engagement of Indigenous community members as research assistants, 2) training of Indigenous graduate fellows, and post-doctoral fellows, and 3) supporting the careers of more junior Indigenous scholars.
This research seeks to identify key design features of an Indigenous field (land/water) based model of science education and to understand how learners’ and educators’ reasoning, deliberation, decision-making, and leadership about complex socio-ecological systems and community change evolve in such learning environments. The project also examines key aspects of co-design and partnership with Tribal communities and how these methods of co-production of new science enable new capacities for systems transformation. This multi-layered project is organized through 3 panels of studies including: Panel 1) community-based design experiments to develop and refine a model of Indigenous informal science education; Panel 2) co-design and implementation of professional learning programs for Indigenous informal science education; and Panel 3) foundational studies in cognition and learning with respect to socio-ecological systems thinking and the impact on learning and instructional practices. Of particular importance in this research is the rigorous development and articulation of effective pedagogical practices and orientations. More broadly, findings will have clear implications for theories of cognitive development, deliberation and environmental decision making and especially those pertaining to how knowledge is shaped by culture and experience.
This project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Filiberto Barajas-LopezAnna LeesMegan BangAnna LeesFiliberto Barajas-Lopez
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
The Apsáalooke (Crow Indian) Nation in Montana, as well as other Indigenous communities across the United States, disproportionally experience negative consequences from water-related environmental hazards, such as contaminated water. In this project, fifth- and sixth-grade Apsáalooke youth will act as change agents through investigating water issues in their communities and presenting findings to their communities. They will conduct this water-related research in the context of an informal summer program designed to integrate Indigenous and Western perspectives on science. For example, youth will learn the cultural significance of water sites while also practicing methods for collecting and analyzing data relative to those sites, guided by Apsáalooke elders and science professionals. During the summer program, Indigenous high school students and tribal college students will mentor the youth. To develop this program, the project team will conduct interviews with elders and Apsáalooke community members in scientific fields to determine the desired features of a program that integrates Indigenous and Western science. They will use the findings from these interviews to develop a multimedia toolkit, which includes a set of comprehensive materials that will enable other researchers and informal educators to implement similar programs. This toolkit will include information about water science and water quality, lesson plans and related resources for the summer program, professional development materials to prepare the high school youth to act as mentors, handouts for family members to facilitate at-home engagement with their children, and more. The project team will research how the implementation of the toolkit influences the participants' water-related knowledge and attitudes toward science. The toolkit, and the associated empirical findings, will be disseminated widely through local, regional, and national professional networks that serve American Indians.
Montana State University, in partnership with Little Big Horn College, will implement and research an informal summer program for Apsáalooke youth in the fifth and sixth grades, as well as a mentorship program for Indigenous high school students and tribal college students. The older students will participate in a four-week internship program in which they learn about conducting water research and facilitating science activities that foreground Apsáalooke perspectives and cultural practices. The high school and tribal college students will partner with Apsáalooke elders and science professionals to facilitate and implement a two-week summer program for the fifth- and sixth-grade youth. This program will use the toolkit materials that were previously developed in consultation with elders and other community stakeholders. Regression analyses of validated pre- and post-surveys, as well as inductive analyses of interviews with stakeholders, will be used to study how the mentoring program affects the high school and tribal college students' attitudes toward science and career interests, and how the summer program affects the fifth- and sixth-graders' water-related knowledge. The research team will also study how youth participation in the program affects their family and community members' water-related knowledge. This project will result in a multimedia toolkit, freely available to the public and widely disseminated through professional networks, which specifies how other informal educators and researchers can implement similar mentorship programs and summer programs for Indigenous youth. Ultimately, this project will broaden participation through resulting in empirically-tested materials that advance practice in informal education for Indigenous youth and their communities. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (science, technology, engineering, and mathematics) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).
The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The Center for Advancing the Societal Impacts of Research (CASIR) will advance the rigor, relevance, and practice of broader impacts (BI) by (a) cultivating and strengthening the existent and emerging BI expert community; (b) building capacity of researchers and educators to enhance and articulate the broader impacts of their work; and (c) creating socio-technical infrastructure able to adapt to stakeholder needs as BI continues to grow and evolve. CASIR builds on the foundational work of the National Alliance for Broader Impacts and will advance the practice of translating scientific research for public understanding and meet the growing demand for innovative BI training and resources.
The Center will develop resources and provide professional development to diverse audiences across multiple institution types and settings, including research-intensive universities, minority-serving institutions, technical and community colleges, and primarily undergraduate institutions in the jurisdictions of the Established Program to Stimulate Competitive Research. CASIR will directly enhance BI capacity at the individual, departmental, institutional, and national levels. Particular focus will be given to individual researchers and institutions representing and serving traditionally under-served populations. In addition, CASIR will facilitate dialogue and collaboration around evidence-based approaches to enhancing, evaluating, and documenting research impacts. Overall, the work will be valuable to the community of researchers driving discovery, the community of professionals who provide BI support and collaboration with researchers, and the public which stands to benefit from research and education projects that are well-designed and executed in a way that enhances their broader impacts.
NSF-wide support for this Center augments the Foundation's current efforts to educate research communities about the importance of the broader impacts criterion in the review process and to communicate the societal benefits of fundamental science and engineering research. CASIR's emphasis on documentation, evidence, and best practices will support an evidence-building approach to investing in discovery and innovation.
This award is co-funded by the Office of Integrative Activities (OIA) and the following Directorates: Biological Sciences (BIO), Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), Geosciences (GEO), Mathematical and Physical Sciences (MPS), and Social, Behavioral, and Economic Sciences (SBE).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.