While there is a growing commitment in ISL to broadening participation in STEM, genuine diversity cannot be attained if current efforts continue to revolve around a dominant paradigm. This research synthesis project will review, summarize, and interpret existing research and knowledge on non-Western STEM knowledge, worldviews, and ways of knowing.
In this project, the Children's Museum of Pittsburgh in partnership with EdTogether, Spelman College, and the Warner School of Education at the University of Rochester will bring together these distinct domains of learning by working with youth and practitioners to conduct a systematic review of equity and belonging work in informal science learning.
The program was co-created with practitioners and students who are people of color and/or immigrants, representing a range of gender identities and sexual orientations and neurodivergent individuals alongside facilitators that specialize in helping STEM professionals address social inequities. The IDEAL program supports practitioners in developing self-awareness, readiness, agency, and resources to modify their projects with practices that support belonging, equity, and accessibility.
Many urgent environmental challenges, from soil degradation and water pollution to global climate change, have deep roots in how complex systems impact human well-being, and how humans relate to nature and to each other. Learning In and From the Environment through Multiple Ways of Knowing (LIFEways) is based on the premise that Indigenous stewardship has sustained communities on these lands since time immemorial. This project is collaboratively led by the Indigenous Education Institute and Oregon State University’s STEM Research Center, in partnership with Native Pathways and the Reimagine Research Group, Swinomish Indian Tribal Community, Oregon Museum of Science and Industry, World Forestry Center, and a national park network in the Pacific Northwest. The aim of this partnership is to deepen the informal learning field’s understanding of how Indigenous ways of knowing are currently or can be included in outdoor learning environments such as parks, nature preserves, and tribal lands. The project will share practices that center Indigenous worldviews to build awareness of their value and enhance STEM learning in outdoor settings. These approaches engage Native community members in continuing their traditional knowledge and practices, and help non-Native audiences learn from the dynamic interrelationships of the environment in authentic, respectful ways.
Conventional outdoor education is mostly grounded in Western concepts of “conservation” and “preservation” that position humans as acting separately from nature. This Research in Service to Practice project will identify “wise practices” that honor Indigenous ways of knowing, and investigate current capacities, barriers and opportunities for amplifying Indigenous voices in outdoor education. A team of Native and non-Native researchers and practitioners will draw upon Indigenous and Western research paradigms. Methods include Talk Story dialogues, a landscape study using national surveys, case studies, and a Circle of Relations to interpret and disseminate research findings. LIFEways will also document partnership processes to continue to build on the Collaboration with Integrity framework between tribal and non-tribal organizations (Maryboy and Begay, 2012). Findings from the LIFEways project will be shared broadly through a series of webinars, local and national meetings, conferences, and publications.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
resourceprojectProfessional Development, Conferences, and Networks
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
The Ice Worlds media project will inspire millions of children and adults to gain new knowledge about polar environments, the planet’s climate, and humanity’s place within Earth’s complex systems—supporting an informed, STEM literate citizenry. Featuring the NSF-funded THOR expedition to Thwaites glacier, along with contributions of many NSF-supported researchers worldwide, Ice Worlds will share the importance of investments in STEM with audiences in giant screen theaters, on television, online, and in other informal settings. Primary project deliverables include a giant screen film, a filmmaking workshop for Native American middle school students that will result in a documentary, a climate storytelling professional development program for informal educators, and a knowledge-building summative evaluation. The project’s largest target audience is middle school learners (ages 11-14); specific activities are designed for Native American youth and informal science practitioners. Innovative outreach will engage youth underserved in science inspiring a new generation of scientists and investigative thinkers. The project’s professional development programs will build the capacity of informal educators to engage communities and communicate science. The Ice Worlds project is a collaboration among media producers Giant Screen Films, Natural History New Zealand, PBS, and Academy Award nominated film directors (Yes/No Productions). Additional collaborators include Northwestern University, The American Indian Science and Engineering Society, the Native American Journalism Association, a group of museum and science center partners, and a team of advisors including scientific and Indigenous experts associated with the NSF-funded Study of Environmental Arctic Change initiative.
The goals of the project are: 1) to increase public understanding of the processes and consequences of environmental change in polar ecosystems, 2) to explore the effectiveness of the giant screen format to impart knowledge, inspire motivation and caring for nature, 3) to improve middle schoolers’ interest, confidence and engagement in STEM topics and pursuits—broadly and through a specific program for Native American youth, and 4) to build informal educators’ capacity to share stories of climate change in their communities. The main evaluation questions are 1) to what extent does the Ice World film affect learning, engagement, and motivation around STEM pursuits and environmental problem solving 2) what is the added value of companion media for youth’s giant screen learning over short and longer term, and 3) what are the impacts of the culturally based Native American youth workshops.
The evaluation work will involve a Native American youth advisory panel and a panel of science center practitioners in the giant screen film’s development and evaluation process. Formative evaluation of the film will involve recruiting youth from diverse backgrounds, including representation of Native youth, to see the film in the giant screen theater of a partner site. Post viewing surveys and group discussions will explore their experience of the film with respect to engagement, learning, evoking spatial presence, and motivational impact. A summative evaluation of the completed film will assess its immediate and longer term impacts. Statistical analyses will be conducted on all quantitative data generated from the evaluation, including a comparison of pre and post knowledge scores. An evaluation of the Tribal Youth Media program will include a significant period of formative evaluation and community engagement to align activities to the needs and interests of participating students. Culturally appropriate measures, qualitative methods and frameworks will be used to assess the learning impacts. Data will be analyzed to determine learning impacts of the workshop on youth participants as well as mentors and other stakeholder participants. Evaluation of the community climate storytelling professional development component will include lessons learned and recommendations for implementation.
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
This award is funded with support from NSF's program for Advancing Informal STEM Education.
This project develops a partnership between language researchers and Planet Word, a new museum devoted to language in Washington D.C., to engage museum visitors in scientific research and outreach. Interested museum visitors from all ages and backgrounds are invited to participate in behavioral research studies on a range of language-related topics. This "living language laboratory" of interactive studies includes accompanying educational demonstrations. These activities will lead to the development of infrastructure and best practices that will allow future language researchers to engage with the public at Planet Word and other similar sites.
The project enhances scientific understanding by engaging visitors in activities that expose them to active science about language as a part of their visit to the museum. For example, the research examines topics from understanding what makes certain American Sign Language signs more learnable, to why it is easier to understand people we know rather than strangers, to whether we think differently when we are reading a text message compared to reading more formal writing. In doing so, the project raises the profile of linguistics among the general public and promotes scientifically informed attitudes about language. The project also provides key opportunities to disseminate research findings of interest to the public and to promote greater interest in STEM topics among museum visitors, as well as student trainees and museum staff. The project creates educational and research opportunities for students, who will be trained in a hands-on course, and will gain first-hand experience with research and outreach in a museum setting. Through the collaborative partnership of researchers from University of Maryland, Howard University, and Gallaudet University, the project broadens participation of underrepresented minority students in the language sciences, seeking to diversify the pipeline of scholars continuing in careers in the language sciences and related STEM fields.
DATE:
-
TEAM MEMBERS:
Charlotte VaughnYi Ting HuangDeanna GagnePatrick Plummer
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Zoos and aquariums have been offering programming, events, and visit accommodations to autistic individuals for several years. While these efforts can provide great experiences, they are focused more on accommodation and the outward-facing guest experience than inclusion. Lack of inclusion features in design, programming, and representation amongst zoo and aquarium representatives, ultimately limits full inclusion and adds to a sense in autistic individuals of not belonging and not being welcomed. To develop a fully inclusive experience for autistic individuals, this project will develop an evidence-based framework of inclusive practices for zoos and aquariums and build a community of practice around inclusion broadly. The project brings together researchers from Oregon State University, Vanderbilt Kennedy Center’s Treatment and Research Institute for Autism Spectrum Disorders, and the Association of Zoos and Aquariums. Researchers will create and investigate the extent and ways in which a research-informed framework and associated tools (i.e. case studies, discussion guides, self-guided audits, etc.) and strategies support science learning for autistic individuals, and help practitioners expand access and inclusion of autistic audiences beyond special events or the general visit experience by applying inclusive practices for programs, exhibit development, internships, volunteer opportunities, and employment. To maximize impact, the project will develop and expand a network of early adopters to build a community of practice around inclusive practices to develop fully inclusive zoo and aquarium experiences for all individuals.
The project will investigate 4 research questions: (1) In what ways and to what extent are zoos and aquariums currently addressing access and inclusion for autistic individuals? (2) How do staff in zoos and aquariums perceive their and their institution’s willingness and ability to address access and inclusion for autistic individuals? (3) What is a framework of evidence-based practices across the zoo and aquarium experience that is inclusive for autistic individuals, and what associated tools and strategies are needed to make the framework useful for early adopters? And (4) to what extent and in what ways does a research informed framework with associated tools and strategies engage, support, and enhance an existing community of practitioners already dedicated to addressing autistic audiences and promote inclusive practices at zoos and aquariums for autistic people? The project is designed as two phases: (1) the research and development of a framework of inclusive practices and tools for supporting autistic individuals and (2) expanding a network of early adopters to build a community of practice around inclusive practices and an overall strategy of implementation. The framework will be informed through a state of the field study across the zoo/aquarium field that includes a landscape study and needs assessment as well as a review of literature that synthesizes existing research across disciplines for developing inclusive practices for autistic individuals in zoos and aquariums. The team will also conduct online surveys and focus groups to gather input from various stakeholders including zoo and aquarium employees and practitioners, autistic individuals, and their social groups (e.g., family members, peers, advocacy organizations). The second phase of the study will focus on sharing the framework and tools with practitioners across the zoo/aquarium field for feedback and reflection to develop an overall strategy for broader implementation and expanding the existing network of zoo and aquarium professionals to build a community of practice dedicated to the comprehensive inclusion of autistic individuals across the full zoo and aquarium experience. The results will be disseminated through conference presentations, scholarly publications, online discussion forums, and collaborative partners’ websites. The project represents one of the first of its kind on autistic audiences within the zoo and aquarium context and is the first to look at the full experience of autistic patrons to zoos and aquariums across programs/events, exhibits, volunteering, internship, and employment opportunities. A process evaluation conducted as part of the project will explore how the approach taken in this project may be more broadly applied in understanding and advancing inclusion for other audiences historically underserved or marginalized by zoos and aquariums.
This Research in Service to Practice project is supported by the Advancing Informal STEM Learning (AISL) program.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.