The September/October 2021 issue of Informal Learning Review (ILR) reflects on the state of the field during the ongoing pandemic, and the ways in which institutions are adapting to the "new normal."
The Museum of Science and Industry, Chicago will conduct a research study that measures a sense of belonging for museum guests, helping museums identify and address social exclusion issues. Project activities include developing and testing a survey instrument with museum visitors along with a comparison group of non-museum goers, culminating in the production of the final instrument, a user's guide, and a template to analyze findings. The project will involve nine museums of various types, sizes, audience demographics, and geographic locations collaborating to collect and analyze data and then share the project results with the broader museum community. Project activities will result in an increase in museum staff's awareness of their audience's sense of inclusion, leading to museums that are more responsive and relevant to their communities.
This practitioner guide summarizes lessons learned from a three-year design-based research project focused on using elements of narrative (such as characters, settings, and problem frames) to evoke empathy and support girls' engagement in engineering design practices. The guide includes a summary of the driving concepts and key research findings from this work, as well as design principles for creating narrative-based engineering activities. Six activity case studies illustrate the design principles in action, and facilitation tips and observation tools offer practical guidance in developing
Despite the fact that most science learning takes place outside of school, little is known about how engagement in informal science learning (ISL) experiences affects learners’ knowledge, skill development, interest, or identities over long periods of time. Although substantial ISL research has documented short-term outcomes such as the learning that takes place during a science center visit, research suggests that the genuine benefits of informal experiences are long-term transformations in learners as they pursue a “cascade” of experiences subsequent to the initial educational event
This project addresses a longstanding problem in informal science education: how to increase the likelihood of consequential science, technology, engineering, and mathematics (STEM) learning from short duration experiences such as field trips. Although informal learning experiences can greatly contribute to interest in and knowledge of science, there is a shared concern among educators and researchers that students may have difficulty recalling and using scientific information and practices emphasized during these experiences, even though doing so would further their science learning. Nonetheless, science learning is rarely, if ever, a "one-shot deal." Children acquire knowledge about science cumulatively across different contexts and activities. Therefore, it is important that informal science learning institutions identify effective practices that support the consolidation of learning and memory from exhibit experiences to foster portable, usable knowledge across contexts, such as from informal science learning institutions, to classrooms, and homes. To this end, this Research in Service to Practice project seeks to harness the power and potential of visual representations (e.g., graphs, drawings, charts, maps, etc.) for enhancing learning and encouraging effective reflection during and after science learning experiences. The project promises to increase learning for the 9,000+ 5th and 6th grade students from across the rurality and growing diversity of the state of Maine who annually participate in LabVenture, a 2.5-hour exploration of the Gulf of Maine ecosystem at Gulf of Maine Research Institute. The research will provide new and actionable informal science learning practices that promote engagement with visual representations and reflection, and science understandings that can be applied broadly by informal science institutions. This project is funded by the Advancing Informal STEM Learning (AISL) and the Discovery Research PreK-12 (DRK-12) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the DRK-12 program goal of enhancing the learning and teaching of STEM by preK-12 students and teachers.
The project is grounded in the idea that visual representations, including drawings, can both enhance science learning and encourage reflection on doing science that can support extension of that learning beyond a singular informal science experience. The project uses design-based research to address the following research questions: (1) Does reflection during an informal science learning experience promote students’ retention and subsequent use of science information and practices that are part of the experience? (2) Does interpreting and constructing visual representations, such as drawings, improve students’ understanding and retention of information, and if so, how and when? and (3) Does combining visual representations and narrative reflections confer benefits on students’ science learning and engagement in science practices both during the informal learning experience, and later in their classrooms and at home? These questions will be pursued in collaboration with practitioners (both informal educators and classroom teachers) and a diverse team of graduate and undergraduate student researchers. Approximately 600 student groups (roughly 3000 individual students) will be observed during the LabVenture experience, with further data collection involving a portion of these students at school and at home. The project will yield resources and video demonstrations of field-tested, empirically based practices that promote engagement with visual representations and reflection, and science understandings that can travel within students' learning ecosystem. In support of broadening participation, the undergraduate/graduate student researchers will gain wide understanding and experience connecting research to practice and communicating science to academic and nonacademic audiences.
This award is funded with support from NSF's program for Advancing Informal STEM Education.
This project develops a partnership between language researchers and Planet Word, a new museum devoted to language in Washington D.C., to engage museum visitors in scientific research and outreach. Interested museum visitors from all ages and backgrounds are invited to participate in behavioral research studies on a range of language-related topics. This "living language laboratory" of interactive studies includes accompanying educational demonstrations. These activities will lead to the development of infrastructure and best practices that will allow future language researchers to engage with the public at Planet Word and other similar sites.
The project enhances scientific understanding by engaging visitors in activities that expose them to active science about language as a part of their visit to the museum. For example, the research examines topics from understanding what makes certain American Sign Language signs more learnable, to why it is easier to understand people we know rather than strangers, to whether we think differently when we are reading a text message compared to reading more formal writing. In doing so, the project raises the profile of linguistics among the general public and promotes scientifically informed attitudes about language. The project also provides key opportunities to disseminate research findings of interest to the public and to promote greater interest in STEM topics among museum visitors, as well as student trainees and museum staff. The project creates educational and research opportunities for students, who will be trained in a hands-on course, and will gain first-hand experience with research and outreach in a museum setting. Through the collaborative partnership of researchers from University of Maryland, Howard University, and Gallaudet University, the project broadens participation of underrepresented minority students in the language sciences, seeking to diversify the pipeline of scholars continuing in careers in the language sciences and related STEM fields.
DATE:
-
TEAM MEMBERS:
Charlotte VaughnYi Ting HuangDeanna GagnePatrick Plummer
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Zoos and aquariums have been offering programming, events, and visit accommodations to autistic individuals for several years. While these efforts can provide great experiences, they are focused more on accommodation and the outward-facing guest experience than inclusion. Lack of inclusion features in design, programming, and representation amongst zoo and aquarium representatives, ultimately limits full inclusion and adds to a sense in autistic individuals of not belonging and not being welcomed. To develop a fully inclusive experience for autistic individuals, this project will develop an evidence-based framework of inclusive practices for zoos and aquariums and build a community of practice around inclusion broadly. The project brings together researchers from Oregon State University, Vanderbilt Kennedy Center’s Treatment and Research Institute for Autism Spectrum Disorders, and the Association of Zoos and Aquariums. Researchers will create and investigate the extent and ways in which a research-informed framework and associated tools (i.e. case studies, discussion guides, self-guided audits, etc.) and strategies support science learning for autistic individuals, and help practitioners expand access and inclusion of autistic audiences beyond special events or the general visit experience by applying inclusive practices for programs, exhibit development, internships, volunteer opportunities, and employment. To maximize impact, the project will develop and expand a network of early adopters to build a community of practice around inclusive practices to develop fully inclusive zoo and aquarium experiences for all individuals.
The project will investigate 4 research questions: (1) In what ways and to what extent are zoos and aquariums currently addressing access and inclusion for autistic individuals? (2) How do staff in zoos and aquariums perceive their and their institution’s willingness and ability to address access and inclusion for autistic individuals? (3) What is a framework of evidence-based practices across the zoo and aquarium experience that is inclusive for autistic individuals, and what associated tools and strategies are needed to make the framework useful for early adopters? And (4) to what extent and in what ways does a research informed framework with associated tools and strategies engage, support, and enhance an existing community of practitioners already dedicated to addressing autistic audiences and promote inclusive practices at zoos and aquariums for autistic people? The project is designed as two phases: (1) the research and development of a framework of inclusive practices and tools for supporting autistic individuals and (2) expanding a network of early adopters to build a community of practice around inclusive practices and an overall strategy of implementation. The framework will be informed through a state of the field study across the zoo/aquarium field that includes a landscape study and needs assessment as well as a review of literature that synthesizes existing research across disciplines for developing inclusive practices for autistic individuals in zoos and aquariums. The team will also conduct online surveys and focus groups to gather input from various stakeholders including zoo and aquarium employees and practitioners, autistic individuals, and their social groups (e.g., family members, peers, advocacy organizations). The second phase of the study will focus on sharing the framework and tools with practitioners across the zoo/aquarium field for feedback and reflection to develop an overall strategy for broader implementation and expanding the existing network of zoo and aquarium professionals to build a community of practice dedicated to the comprehensive inclusion of autistic individuals across the full zoo and aquarium experience. The results will be disseminated through conference presentations, scholarly publications, online discussion forums, and collaborative partners’ websites. The project represents one of the first of its kind on autistic audiences within the zoo and aquarium context and is the first to look at the full experience of autistic patrons to zoos and aquariums across programs/events, exhibits, volunteering, internship, and employment opportunities. A process evaluation conducted as part of the project will explore how the approach taken in this project may be more broadly applied in understanding and advancing inclusion for other audiences historically underserved or marginalized by zoos and aquariums.
This Research in Service to Practice project is supported by the Advancing Informal STEM Learning (AISL) program.
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.