The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The SciGirls in Space: Exploring the Moon, Mars and NASA Careers Implementation Evaluation Report focuses on the STEM outreach component of the project for 15 girl-serving organizations who used research-based gender equitable and culturally responsive instructional strategies,NASA-aligned media and STEM activities with a focus on integrating of NASA women role models.
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
My Sky is a NASA funded project, which developed a traveling exhibition on astronomy. Boston Children’s Museum (BCM) created the exhibition in collaboration with the Smithsonian Astrophysical Observatory (SAO). Formative and remedial evaluations were conducted at BCM while the summative evaluation took place at the first two venues following BCM: Stepping Stones Museum for Children (Stepping Stones) in Norwalk, CT and The Providence Children’s Museum (PCM) in Providence, RI. Formative evaluation of the My Sky exhibit was conducted between April 2013 and June 2014 to ensure that the components
The impact of four half-hour science programs aired on commercial children's radio was assessed by Dr. Barbara Flagg of Multimedia Research in a causal-comparative between-groups study with prebroadcast and postbroadcast questionnaires. Of 253 fourth graders, 34% listened to one or more shows of the Kinetic City Super Crew series. Significantly more girls listened than boys. Listeners and Non-listeners did not differ on background variables of ethnic status, science attitudes, science reading and television viewing, and participation in seven of eight common at-home science activities
The Boston Schools Environmental Initiative (BSEI) program worked with several Boston Public schools to foster “hands-on, minds-on” science and environmental awareness. The overall finding from this evaluation, conducted over four academic years, was that the longer a school participated in the BSEI program, the more the culture and operations of the school changed in the direction of the intended BSEI outcomes. BSEI is a program of Mass Audubon’s Boston Nature Center (BNC), which places a teacher naturalist part time in each school, and provides ongoing professional development and project