The poster shares work conducted as part of the Modeling Zoos and Aquariums as Inclusive Communities of Science for Autistic Individuals (MoZAICS) project and specifically sharing details of the MoZAICS access and inclusion framework (e.g., definitions, structure/levels of the framework).
The COVID-19 pandemic tested many fundamental connections between science and society. A growing field working to strengthen those connections exists within the informal STEM learning (ISL) community which provides diverse learning and engagement environments outside the formal classroom. One of the largest funders of ISL initiatives is the National Science Foundation (NSF) which runs the Advanced Informal STEM Learning (AISL) program in the United States. The AISL program supports initiatives through six categories that include pilots and feasibility studies, research in service to practice
The McWane Science Center (MWSC) will create a new exhibition experience entitled “Dropping Science: Hip-Hop Interactive” that will capture the elements of the popular music genre using interpretive experiences. Project activities include exhibit content development; development of a formal evaluation plan; exhibit prototyping; remedial evaluation, and a final exhibit design plan. An important project goal is to develop the process for creating lasting, reciprocal relationships with the local African American community and throughout the region, thus creating an exhibit space that connects underrepresented audiences to STEM and establishes MWSC as a true community partner. The outcome of this project will be a new interactive experience that was co-developed with and representative of MWSC’s local community that helps MWSC connect with and engage local visitors in science through a more culturally and personally relevant lens.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
This Innovations in Development project supports racially and ethnically diverse youth in learning about climate resilience in informal settings, including community centers, afterschool programs, and museums. The project aims to: (1) build the capacity of community organizations to implement youth programming on climate resilience; (2) increase youth knowledge, skills, and self-efficacy associated with climate resilience (also referred to as environmental health literacy for climate resilience); and (3) explore how collaborating research universities and community organizations engage diverse youth in informal STEM learning. Project partners include the UNC Institute for the Environment, the University of Washington-Interdisciplinary Center for Exposures, Diseases, Genomics and Environment, the North Carolina Museum of Natural Sciences, Juntos NC, and the Duwamish River Community Coalition (DRCC). Juntos NC and DRCC actively engage Latino and Indigenous youth in their programming and seek to implement resilience-focused programming that supports youth science learning and leadership development.
Together, informal educators and participating youth will develop locally relevant solutions to climate impacts in their communities. Youth will interact with university-based climate scientists and educators to collect and analyze data and will participate in resilience-focused dialogue, planning, and actions in their communities. Youth will share what they learn with their families and peers through family events and teen summits. The project will engage dozens of educators in community organizations and at least 250 youth, who will share what they learn with their families and communities, reaching hundreds more people through communications and local action projects. Mixed-methods assessment will provide insight into the extent participating youth (a) develop environmental health literacy for climate resilience, and (b) take action to address resilience in their home communities. The team will assess how these outcomes vary by location, and the implications of any variation on potential for project replication. A participatory evaluation, led by an external evaluator, will provide insight into empowerment outcomes. Findings will be disseminated to professional audiences at local and national conferences; and curricular materials from this project will be disseminated through the project website.
DATE:
-
TEAM MEMBERS:
Kathleen GraySarah Yelton
resourceprojectProfessional Development, Conferences, and Networks
Each year, millions of Americans visit science centers and museums, children’s museums, zoos, aquariums, nature centers, planetariums, and similar institutions. Recognized as trusted and popular places for educational and leisure experiences, these institutions are uniquely capable of engaging people across a spectrum of beliefs, experiences, and identities on topics related to science, technology, engineering, and mathematics (STEM), as well as addressing pressing societal problems related to science, technology, and innovation. However, the potential impacts of these institutions are largely dependent on the skills, knowledge, and abilities of the professionals working at them. Following the onset of the COVID-19 pandemic and the need to shift the nature of work, the informal STEM learning workforce was dramatically impacted. The recent period of disruption is a time for innovation. The field is well-positioned to promote new models of professional learning and development that are grounded in the values and practices of informal learning. This project will benefit local communities across the United States and society at large by advancing the capacity of science-engagement professionals to respond to societal needs, concerns, and interests more effectively through their institutions’ exhibitions, education and learning programs, and various forms of public engagement (e.g., community outreach events, supports for teachers/educators and schools). Led by the Association of Science and Technology Centers in collaboration with the Center of Science and Industry’s Center for Research and Evaluation and Oregon State University’s STEM Research Center, this work will build on the Informal STEM Learning (ISL) Professional Competency Framework developed and validated with prior National Science Foundation funding. Competency frameworks are increasingly used across many sectors to identify the suite of skills, knowledge, and capabilities necessary to be successful in a particular area of work. Given dramatic changes to the ISL workplace in the last two years, there is an even stronger potential for the Framework, particularly if newly developed supports can link the Framework to the current, emerging, and continuing needs of the workforce.
Guided by a systematic process for designing training and instructional materials, this project will first capture changes in the ways diverse informal STEM learning professionals describe, pursue, and achieve competencies to produce a revised Framework. Next, the project will collaboratively develop companion resources with diverse professionals through a series of participatory design workshops, using a sequential and iterative approach. The resources are expected to include indicators of professional competencies, self-assessments, training tools, and other types of resources that have the potential to significantly advance the professional learning (as undertaken by individuals and institutions) and the professional development capacity (as provided by institutions, associations, and other organizations) of the informal STEM learning field. Next, the project will share final products–including a refreshed website that hosts the updated Framework and newly-developed suite of tools–with professional association and network partners who can disseminate directly to the institutions and professionals who are developing and practicing these competencies. The project will gather evidence from a small number of early adopters, providing data on specific use-case scenarios. Finally, the project will document the potential impact of the Framework on the field by measuring how the Framework is perceived by informal STEM learning professionals as usable, useful, and beginning to be “in-use." Over time—and with increased use—the Framework and its companion resources hold the promise of contributing to the opening of the field to professionals with identities currently underrepresented through more transparent expectation and clearer growth pathways.
Diversity, equity, access, inclusion, and belonging-related change is often difficult to achieve in organizations. In the context of Informal STEM Learning (ISL), this results in inequitable opportunities for both ISL professionals and learners to engage in STEM environments and experiences. For people to thrive in these settings, creative and innovative approaches that address historical and current realities of intersectional marginalization and inequitable norms within informal STEM institutions are necessary to disrupt conventions, institutional barriers, and patterns of inequities. TERC and the Detroit Zoological Society will develop and implement an ISL Equity Resource Center (the Center). The Center will advance equity within the ISL field by cultivating a multi-sector, diverse learning community that designs and conducts evidence-based research and practice, including but not limited to equity-focused leadership, decision-making, theory, methods, project topic selection and design, and budget management.
The Center will cultivate lasting change in the ISL and broader STEM learning ecosystem via (a) sharing more inclusive, culturally relevant, and responsive ISE research and practice; (b) identifying scalable, equity-focused research findings useful in ISL programming; and (c) promoting greater public awareness of the importance of broadening participation in STEM. The Center's primary stakeholders are ISL professionals, including researchers, practitioners, and evaluators. The Center will maintain and expand a digital infrastructure to support innovation and sharing across the ISL field. Through its combined efforts, the Center will raise the visibility and impact of ISL equity-focused research and practice and its contributions to the overall STEM endeavor. The Center will also organize and host the biennial AISL Awardee Meeting. The Center is funded by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Stephen AlkinsDiane MillerLisette Torres-GeraldPati Ruiz
resourceprojectProfessional Development, Conferences, and Networks
The National Girls Collaborative Project and Education Development Center are convening “Advancing the Conversation on Scaling National Informal STEM Programs,” a two-and-a-half day knowledge-building conference that brings together key stakeholders in informal STEM education (ISE) to examine what scale looks like across informal learning settings. Currently, there is not a common definition or set of dimensions related to what it means to scale programs in informal learning settings. Approaches to scale in ISE too often center on the perspectives and needs of people who are developing and spreading programs while less consideration is given to the realities of those responsible for operationalizing programs in hyper-local contexts. This conference approaches the question of scale from the perspective of the program implementers, who are the beneficiaries of capacity building and serve as facilitators of these scaled programs. The conference also gives voice to program developers, researchers, evaluators, and funders of national informal STEM programs who study and support scale in education. The aim of the conference is to develop a new framework for scale in ISE that centers partnership and capacity building of informal educators. Such an approach to scale addresses issues of local access and diversity, equity, and inclusion, and promotes sustainability of ISE in high-need communities.
Conference discussions challenge three common misperceptions of scale across ISE: (1) simple spread and replication of turnkey programs lead to effective scale in ISE; (2) definitions of scale derived from formal learning settings should be used to scale across ISE; and (3) scale across ISE should be defined by program developers and those that seek to study it. Participants with a wide range of perspectives and who represent a diversity of organizational types will attend the conference and work together to articulate scaling success factors, barriers, diversity, equity, and inclusion strategies, and intended outcomes, distilling themes, questions, and concerns about current approaches to evaluating and researching scale in ISE. Together, conference participants will co-create a framework for scale in ISE which will define new and expanded dimensions of scale that center on capacity building and diversity, equity, and inclusion, as well as a Program Developer’s Guide for scaling ISE programs through the lens of the framework. These products will increase the knowledge and capacity of informal learning organizations involved in nationally scaled initiatives, STEM-rich institutions wanting to scale their own locally developed programs, informal STEM researchers and evaluators, and the broader field of ISE including program funders. Conference findings will be broadly disseminated through publications, conferences, and a national webinar co-hosted by the National Girls Collaborative Project and Education Development Center.
This by the project external evaluation partner presents findings from the first phase of the Co-Created Public Engagement with Science project (CC-PES). The CC-PES project has sought to bring together informal science education institutions, civic partners, and community partners to create forums that address socio-scientific issues that are important to audience being served. The project is designed to lead these collaborative teams through three key steps of public engagement with science: agenda setting (identifying the topic of interest and designing a forum to address it), decision
The North Carolina Museum of Natural Sciences will partner with North Carolina State University to improve the evaluation skills of informal science education providers. The project team will create a community of practice for 54 science museums across North Carolina by implementing a series of regional professional development workshops. The workshops will be designed to create a shared sense of purpose for programming and evaluation, build capacity among science museum educators to evaluate their programs, and establish a set of common metrics and methodologies for the evaluation of informal science learning across the state. The project will produce a practitioner's guide that will describe the collaborative process, lessons learned, and ways other informal science organizations can use identified evaluation goals and metrics.
The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
Background: Capturing measures of students’ attitudes toward science has long been a focus within the field of science education. The resulting interest has led to the development of many instruments over the years. There is considerable disagreement about how attitudes should be measured, and especially whether students’ attitudes toward science can or should be measured unidimensionally, or whether separate attitude dimensions or subscales should be considered. When it is agreed upon that the attitudes toward science construct should be measured along separate subscales, there is no