The Springfield Science Museum will increase participation in informal science learning by making its educational programs and learning spaces more accessible and inclusive. Museum staff will undergo Disability Inclusion and Universal Design training to redesign and enhance a core multi-use learning space and principle STEM program that can remove physical, cognitive, and social barriers to learning. External evaluators will measure access needs and learning outcomes before and after project upgrades in order to track progress and develop a scalable model of inclusive practice for all the museum’s science programming. The result will be an improved educational experience for visitors of all ages, abilities, and backgrounds.
DATE:
-
TEAM MEMBERS:
Katie Merrill
resourceprojectProfessional Development, Conferences, and Networks
The North Carolina Museum of Natural Sciences will partner with North Carolina State University to improve the evaluation skills of informal science education providers. The project team will create a community of practice for 54 science museums across North Carolina by implementing a series of regional professional development workshops. The workshops will be designed to create a shared sense of purpose for programming and evaluation, build capacity among science museum educators to evaluate their programs, and establish a set of common metrics and methodologies for the evaluation of informal science learning across the state. The project will produce a practitioner's guide that will describe the collaborative process, lessons learned, and ways other informal science organizations can use identified evaluation goals and metrics.
The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
The Science Museum of Virginia will launch a three-year initiative that empowers participants to effect change in their neighborhoods using citizen science as a tool. The museum will lead a team of residents, business owners, government officials, nonprofits, and health system partners in assessing air quality concerns at the neighborhood level and implementing evidence-based solutions. The museum will also introduce a new platform and interactive software system to display air quality data from this project as well as other visualizations reflecting citizen science data captured in other initiatives. An external evaluator will conduct front-end and formative evaluation to address challenges as they occur and assist the museum in disseminating learnings from the project to the field. The project is designed to build community consensus on strategies necessary to build resilience to climate change while strengthening the museum’s position as a catalyst for science-based decision-making.
The Portland Children’s Museum will open a new exhibition, “Drip City,” which focuses on water as a precious natural resource that has shaped the region’s geography, weather, and culture. Following an IMLS-funded evaluation and design process, the museum will engage a local fabrication company to construct and install exhibit components that explore concepts in science, engineering, and art. The museum will also engage community members in the design and testing of associated programs that target families and children ages 0 to 7. Museum staff will evaluate all exhibit elements to ensure they are working properly, accessible as intended, and making children’s learning visible to adult audiences.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Pacific Science Center will develop new evaluation tools to assess the impact of Tinker Tank, a visitor-directed, hands-on design space in which participants are challenged to use their creativity, problem solving, and experience to understand the processes of design, engineering, and science. The project will allow the museum to determine which tools, adapted from both informal learning settings (such as timing and tracking studies, observations, surveys, and focus groups) and formal settings (such as design journals, digital portfolios, and badging),are most suitable for providing meaningful data about the learning and engagement occurring in its makerspace. By adjusting and refining the evaluation tools and methods, the museum will be able to measure learning in its makerspace, determine the extent to which it is achieving the goals and objectives of its Tinker Tank, and guide planning for expansion of making activities into different areas of its exhibition floor.
This book chapter, which describes emotional accessibility in digital learning experiences and its relation to Universal Design, was included in the book "Inclusive Digital Interactives: Best Practices + Research" published by the Smithsonian. This chapter includes a description of the Productive Struggle project, data highlights, and information on how attending to emotions can broaden our concepts of accessibility.
As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
In November 2020, President-elect Joe Biden identified four priority areas for the incoming administration: COVID-19; climate change, economic recovery, and racial equity. These crucial areas of national interest will be the focus of media attention, policy debates, funding initiatives, and community discussions over the next four years. Will museums be part of these important conversations and initiatives? Are there opportunities for museums to affirm or to reposition their roles within the difficult public deliberations ahead? Addressing Societal Challenges through STEM (ASCs) is a research