The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Many informal learning institutions use STEAM approaches to engage diverse learners. Our project aims to support educators in libraries, museums, and after school programs through a STEAM professional development (PD) series. Our PD approach is centered around a set of core STEAM practices that prioritize STEAM mindset and identity work. Participants engage in exemplar activities and design new experiences for their specific teaching and learning contexts. The series involves in- person sessions, online training, and team
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
This book is a deliverable (requisite) of an NSF (National Science Foundation) grant to share the project outcomes and what we learned from the NSF grant project. This four-year NSF project was funded to provide professional development to museum educators about Indigenous Knowledge and Western Science in museums, with the goal of providing a culturally relevant way for Indigenous communities to connect to science. The name of this grant was “Cosmic Serpent: Bridging Native Ways of Knowing and Western Science in Museum Settings.”
This book is also a snapshot in time of this work in
From 2018 to 2020, the Emerging Research on Identity, Representation & Inclusion in Museums project team set out to document graduate-level research on identity in the museum field, and support professionals’ ongoing research and publishing on these topics. Researchers at Knology synthesized over 90 graduate student theses about identity and museums from 2000 to 2018. In parallel, we interviewed a sample of the authors whose work appeared in the literature review, to understand how identity research has played a role in their careers. To support new and ongoing identity research, we hosted a
Diversity, equity, accessibility, and inclusion (DEAI) have become central concerns for museums. Across the field, leaders are asking—with increasing urgency—how museums can diversify their visitors, staff, and boards; create welcoming and inclusive environments and workplaces; and ensure that museum offerings reflect a broad range of interests, experiences, and needs.
Museums have approached DEAI efforts in different ways and at different levels, from developing special exhibits and events for specific audiences to offering staff diversity training to board development. Despite more than
This study researched whether and how affiliation with the Nanoscale Informal Science Education Network (NISE Net) led to change in informal science education organizations’ (ISEs) practices. The NISE Net provided an opportunity to look at how participation in a large but loosely-structured network of museums, science centers, educators, and scientists can influence museums to experience organizational change and adopt new practices.
By conducting qualitative case studies of a few selected partners, this research aimed to understand the conditions that facilitate or impede the influence of
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.
The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).
The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [apprentices]. During the sixth and final regional workshop in Minneapolis, MN, the NFB operated two different programs simultaneously: one program for youth and a second program for their parents/caregivers. A third program, for the Science Museum of Minnesota staff, was conducted earlier to prepare the museum staff to assist with the youth program
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of