Informal learning institutions, such as museums, science centers, and community-based organizations, play a critical role in providing opportunities for students to engage in science, technology, engineering, and mathematics (STEM) activities during out-of-school time hours. In recent years, thousands of studies, evaluations, and conference proceedings have been published measuring the impact that these programs have had on their participants. However, because studies of informal science education (ISE) programs vary considerably in how they are designed and in the quality of their designs, it
The National Science Foundation (NSF) funded the Research+Practice Collaboratory in 2012 to develop strategies for (1) making educational research more usable for educators, and (2) helping educators and researchers productively collaborate to advance research on educational effectiveness.
The Collaboratory comprised four partnering teams. Three of these teams were researchpractice partnerships (RPPs) that functioned as demonstration sites or “local labs.” Together, they pursued a shared commitment to improving quality and equity in STEM education while respectively, they selected different
DATE:
TEAM MEMBERS:
Kea AndersonTim PodkulCorinne SingletonCynthia D'Angelo
resourceevaluationProfessional Development, Conferences, and Networks
The One Sky Institute (One Sky) was an NSF-funded Exploratory Pathways project aimed at developing a new strategy to broaden participation in informal science education. The program emerged from the current need to expand professional development to help increase and support a more diverse cadre of leaders in ISE. One Sky tested professional learning design strategies for mentoring program participants and engaging them in research and practice by developing equity-focused projects at their home institutions in order to: 1) build new knowledge about broadening participation and the barriers
This paper discusses findings from the use of the Wise Guys and Gals (WGG) Observation of WGG Youth Protocol in a blended learning environment. The protocol was used to assess youth engagement when completing blended engineering design challenges at two Boys and Girls Clubs. WGG is a project funded through a grant from the National Science Foundation and which brings blended learning design challenges to middle school aged learners in informal STEM (science, technology, engineering, and mathematics) settings. This paper explores the feasibility of using the observation protocol to collect data
In 2017, the Education Development Center (EDC) received a grant from the National Science Foundation (NSF) to bring together PIs of STEM Program Resource Centers (PRC) funded under NSF’s Education and Human Resources (EHR), evaluators of NSF STEM projects and programs, and evaluation advisors to address concerns about the quality and consistency of STEM evaluations. According to the grant proposal, the goal was “to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of
The Museum of Science, Boston (MOS or the Museum), in partnership with EdTogether and in collaboration with researchers and engineers across a range of affective science and technology disciplines, implemented a two-year exploratory research and development initiative titled Empowering Learners through Effective Emotional Engagement (ELEEE), with funding from the Argosy Foundation. Through the ELEEE project we sought to develop a framework for leveraging emotion in design where visitors are empowered to have meaningful, self- or socially-directed, and intrinsically motivated learning
For the SciGirls Strategies supplemental activity, ten educators were trained to be SciGirls Strategies trainers during June 2019. During that time, they developed action plans for their local teacher training. The goal was for each Trainer to train ten or more teachers in their local schools/districts. Trainers could plan and schedule their workshops to fit their local context in order to accomplish the objectives of building teacher’s confidence and skills in using gender equitable and culturally responsive teaching strategies.
After the training workshop, the trainers met once a month
For the SciGirls Strategies project supplement, ten educators were trained to be SciGirls Strategies Trainers through a four-day in person workshop in June 2019. During the workshop, educators learned about the Gender Equitable Teaching and Advising Strategies (GETAS) course content, the research-based SciGirls Strategies framework and instructional strategies and began to develop plans for their localized professional development for STEM and CTE educators.
The goal of the Train-the-Trainer program was for each Trainer to train 10 teachers in their school and/or school district. Trainers
The Vertically Integrated Science Learning Opportunity (VISLO) program builds upon an existing three-way partnership between (i) faculty, graduate students, and undergraduate students form the University Nebraska-Lincoln (UNL), (ii) the 21st Century Community Learning Centers (CLC) in Lincoln, NE, and (iii) The University of Nebraska State Museum.
VISLO uniquely incorporates vertically-integrated peer instruction across educational levels, including: graduate, undergraduate, middle school, and elementary school. Throughout the program, participants of all identified educational levels had
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically