In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This front-end evaluation study is part of Designing Our Tomorrow: Mobilizing the Next Generation of Engineers, a five-year project (2018–2023) led by the Oregon Museum of Science and Industry (OMSI) with the support of the National Science Foundation (NSF, DRL-1811617) and project partners: Adelante Mujeres, the Biomimicry Institute, and the Fleet Science Center. The Designing Our Tomorrow (DOT) project seeks to promote and strengthen family engagement and engineering learning via compelling exhibit-based design challenges, presented through the lens of sustainable design exemplified by
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
The goal for this research study was to determine the role of the SciGirls gender-equitable strategies on participating youths’ STEM identity changes in 16 participating SciGirls’ programs across the nation. The definition of STEM identity was based on Eccles (2007), Carlone and Johnson (2007) and Calabrese Barton and colleagues (2013). According to these researchers, individuals must have a positive STEM identity in order to persist in STEM careers. This positive STEM identity is affected by an individual’s expectations of success in STEM and the value they see in STEM and STEM careers
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
During the school year of 2016-2017, Fairchild Tropical Botanic Garden (Fairchild) implemented the first year of a four-year project entitled: Growing Beyond Earth (GBE). NASA is providing funding support for project implementation as well as an external project evaluation.
The evaluation activities conducted this year were focused on understanding project implementation and exploring project outcomes using data collected between September 2016 and May 2017. This report’s findings and accompanying recommendations inform next year’s project implementation and evaluation activities.
DATE:
TEAM MEMBERS:
Catherine RaymondAmy RubinsonCarl LewisMarion LitzingerAmy Padolf