In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Education Development Center (EDC) conducted the external evaluation of this second phase of NASA@ My Library. Library staff from partner libraries increased their confidence and ability to facilitate library programming related to Earth, space, and engineering.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The lack of equitable access to science learning for marginalized groups is now a significant concern in the science education community (Bell et al. 2009). In our commitment to addressing these concerns, we (the HERP Project staff) have spent four years exploring different ways to increase diverse student participation in our informal science programs called herpetology research experiences (HREs). We wanted the demographics of participants to mirror the racial, ethnic, cultural, linguistic, and socioeconomic demographics of the areas where our HREs are held. To achieve this, project staff
NASA’s Science Mission Directorate (SMD) explores the Earth, the Sun, our solar system, the galaxy and beyond through four SMD divisions: Earth Science, Heliophysics, Planetary Science and Astrophysics. Alongside NASA scientists, teams of education and public outreach (EPO) specialists develop and implement programs and resources that are designed to inspire and educate students, teachers, and the public about NASA science.
Deals with the success of the Rural Girls in Science Program at the University of Washington in Seattle, Washington State, which uses science to address local issues through long-term research projects. Source of funding for the program; Components of the research projects; Factors which contributed to the success of the program.
DATE:
TEAM MEMBERS:
Angela GinorioJanice FournierKatie Frevert
KY-H.E.R.O.S. (Health Education Rural Outreach Scientists) is a health science education program that partners the largest science center in Kentucky with Science Heroes-- important regional biomedical research scientists. The Science Heroes, their stories and their studies serve as inspiration to our rural audience. The project objectives are to: (1) Convey the relevance of health science research to people's daily lives and promote awareness of healthy lifestyle choices and wellness; (2) Promote understanding of the fundamental principles of the scientifc process and inspire K-12 teachers to incorporate current research into their teaching of health science; and (3) Encourage students to pursue advanced science education and increase awareness of the wide range of health science related careers. The Science Center, working with the distinguished Science Heroes, their research teams and a group of 15 knowledgeable professional advisors will develop the new KY-H.E.R.O.S. science education program. The program will include new hands-on labs and demonstrations, teacher training workshops, career exploration activities, interactive videoconferencing distance learning links, and innovative public programs. Using museum-based exhibits and a wet lab, traveling exhibit components, telelinking (distance learning), an interactive website and printed and electronic materials, we will present information about the work of the Science Heroes and its relevance to the lives of participants. The focus of the program will change every two years to feature three different scientists and their work. A total of nine scientists will be included during the 5 year period covered by the SEPA grant. As the focus changes every two years to a different three scientists, all the programs and exhibits will be changed accordingly. KY-H.E.R.O.S. will be designed to serve audiences composed of school groups on field trips; teachers in workshops; classes in remote areas of the state participatng through videoconferencing; underserved groups including economically disadvantaged, minorities and young women; and the family audience that makes up about 60% of the Science Center's annual attendance. Formative and summative evaluation will be conducted by an outside firm to ensure effectiveness.