In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Museum of Science in Boston, Massachusetts is one of the world’s largest science centers and the most visited cultural institution in New England. Located in Science Park, a piece of land that spans the Charles River, the museum is conveniently situated close to Boston and Cambridge. The museum has more than 700 interactive exhibits and a number of live presentations offered daily. One of these daily shows include live animal presentations, where museum visitors can learn more about some of the many animals that the museum cares for in its live animal center. An evaluation of these live
DATE:
TEAM MEMBERS:
Sarah RosenthalKristina OhlSadia Sehrish IslamMaría José Brito Páez
The Bay Area Discovery Museum will address the need for STEM education by delivering engineering outreach programming to schools and libraries throughout the San Francisco Bay Area. The museum's mobile engineering lab, Try It Truck, will introduce the engineering design process to students and teachers in grades K-5 with hands-on activities (both on and off the truck) where they can collaborate, experiment, and design solutions to engineering challenges. The Try It Truck will serve 21,600 children, parents, and educators throughout the Bay Area, with at least 50 percent of all participants coming from underserved communities and Title I schools. The museum will work with an external evaluator to design survey instruments for both formative and summative evaluation, analyze summative evaluation data, and produce a report. Museum staff will share project results with colleagues at national and statewide conferences.
The Children's Museum of the Upstate will expand its STEAM outreach programming to benefit both teachers and students in the Greenville County Schools. The museum will serve 2,000 students through STEAM programs held on-site at their elementary schools, with a focus on curriculum areas where standardized test scores indicate that students are struggling. A new program for preschoolers will be piloted in the school district's six child development centers. The pre-school classes will visit the museum for a field trip that includes free exploration time and a tailored storytime lesson. The museum will also present four teacher workshops reaching 400 educators to assist them in teaching STEAM topics. An independent evaluator will conduct an evaluation of the outreach programming and develop assessment tools to help determine how the curriculum can support student achievement and result in improved standardized test scores.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.
This report shares the results of a year-long study of the impact of IMLS grants (1998-2003) though programs that served youth aged 9-19. Nearly 400 museum and library programs were surveyed about their goals, strategies, content, audience, and structure, as well as about their impact, effectiveness, and outcomes.
This practitioner guide summarizes lessons learned from a three-year design-based research project focused on using elements of narrative (such as characters, settings, and problem frames) to evoke empathy and support girls' engagement in engineering design practices. The guide includes a summary of the driving concepts and key research findings from this work, as well as design principles for creating narrative-based engineering activities. Six activity case studies illustrate the design principles in action, and facilitation tips and observation tools offer practical guidance in developing
Reframing engineering activities to emphasize the needs of others has the potential to strengthen engineering practices like problem scoping, while also providing more inclusive and socially relevant entry points into engineering problems. In a three-year design-based research project, we developed novel strategies for adding narratives to engineering activities to deepen girls’ engagement in engineering practices by evoking empathy for the users of their designs. In this article, we describe a set of hands-on engineering activities developed through iterative development and testing with 190