The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
ECHO will enhance its capacity to deliver impactful STEM learning experiences for its visitors through the implementation of a re-energized volunteer program. The museum will research innovative practices from the field and build upon best practices from across institutions to overhaul its volunteer training and management systems. Project activities will include building a blended training curriculum, in which volunteers participate in asynchronous and in-person interpretive content, and diversity and inclusion trainings. The museum will also improve its volunteer tracking systems, strengthen staff supervisor training, and revitalize its volunteer recognition and engagement activities. A community of practice will engage three other science centers to inform project activities and assist with the dissemination of a set of training tools adaptable across institutions.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Harvard Museums of Science and Culture will improve the ability of middle school teachers to use museum-based digital resources to support classroom instruction aligned with state and national science standards. Working with advisory teachers from five collaborating school districts, the museum will co-create classroom activities, based on digital resources from its collections, along with associated teacher professional development programs at three sites across urban and rural Massachusetts. The project will provide schools with access to classroom-ready resources that successfully support student learning. Teachers will learn how to use these materials, integrate them into their teaching, and enhance their skills to teach science content and practice. External evaluators will assess the project's effectiveness by measuring teacher implementation of the digital resources in the classroom, requests for information and assistance, and changes in teachers' confidence and comfort levels.
Marbles Kids Museum will develop tools and strategies to train its staff, volunteers, and interns to engage infants, toddlers, and preschool children in activities and conversations that lay the foundation for critical early math skills. The staff capacity-building project will deepen the museum staff's understanding of early math skills, how to foster those skills, and why investment in early math is critical to long term success in school. With a content coach, the museum will research and develop early math resources, activities, and exhibit enhancements that engage children and their families. Additionally, the museum will seek to understand community needs related to early math learning, and create content for professional development video modules. The museum will modify the professional development modules to create caregiver workshops focused on fostering early math learning through everyday activities and play at home. Museum staff will share tools and lessons learned through a regional museum convening and at national conferences.
In partnership with early childhood service providers and elementary school systems, the Children's Museum of the Lowcountry will expand the reach of its programming to share its hands-on, play-based approach to STEM education with targeted children and educators. The museum will create a Power of Play curriculum with lesson plans that reflect best practices and focus on play-based activities to teach STEM concepts tied to grade level and state standards. The museum will train and support 40 teachers and educators from ten Head Start/First Steps early childhood centers and ten Title I elementary schools, and provide them with free Pop Up Tinker Shop (a museum on wheels) outreach visits. The trainings will build teacher confidence, promote best practices for play-based learning, support a community of practice, and enhance young learners' engagement, fascination, and attitude towards STEM. The Power of Play Curriculum will be published as a bound resource and shared with other children's museums and service providers.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
The Da Vinci Science Center will expand its Women in Science and Engineering Network by partnering with community organizations, colleges, and universities to enhance the STEM learning and support ecosystem for women and girls in the Lehigh Valley and surrounding communities in eastern Pennsylvania. The museum will assess the needs of K-12 girls, undergraduate women, and women in STEM employment, and map opportunities for cross-sector collaborations to support them. The project team will identify marketing and recruitment messages that encourage STEM-interested girls and women to participate in programs and follow developmental pathways within a STEM learning ecosystem. Based on identified needs and messages, the museum will pilot and evaluate new STEM programs for girls and women, and train educators and mentors to sustain this work.
The Academy of Natural Sciences of Drexel University will integrate unaccredited, home-based preschool care providers and the low-income families they serve into Philadelphia's initiative to increase the number of preschool education facilities and make high-quality pre-K instruction available to all children (Universal Pre-K). The project outputs include: an interdisciplinary pre-K curriculum that fosters knowledge and skill building in science, math, and literacy as well as positive social-emotional development; professional development workshops and one-on-one training with museum educators for childcare staff, followed by networking and alliance-building; and seven free Celebrate Pre-K Learning Days at the museum for families to learn about the importance of school readiness in science, math, and literacy and practice using free family learning kits that support these skills. The new citywide partnership, managed by the museum, is called Science and Literacy for Success and is supported by a robust number of partnerships with local social service and education agencies.
This guide compiles lessons learned by seven Portal to the Public Network (PoPNet) sites as well as remaining challenges and recommendations for organizations planning similar efforts in the future. PoPNet sites used the Portal to the Public Guiding Framework to build relationships with local scientists, prepare them for public engagement using Portal to the Public training materials, and feature them at public programs.
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
Face-to-face conversations between scientists and public audiences in an informal learning environment provide a valuable opportunity to support public engagement with scientific research. These types of experiences have significant benefits for members of the public and for scientists. For public audiences, interacting face-to-face with a scientist can expand awareness of the range of careers in science, spark new questions about scientific topics, and increase interest in learning more about the scientist’s topic (Tisdal, 2011; Ong, 2014). Scientists, too, are positively impacted by this