This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
This study researched whether and how affiliation with the Nanoscale Informal Science Education Network (NISE Net) led to change in informal science education organizations’ (ISEs) practices. The NISE Net provided an opportunity to look at how participation in a large but loosely-structured network of museums, science centers, educators, and scientists can influence museums to experience organizational change and adopt new practices.
By conducting qualitative case studies of a few selected partners, this research aimed to understand the conditions that facilitate or impede the influence of
This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs.
This assessment is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors.
We chose one measure from Conley, Pintrich, Vekiri, & Harrison (2004). This measure encompasses four dimensions about scientific knowledge -- source, certainty, development and justification -- so we thought it might reveal interesting dimensions of stasis and change in attitudes toward science from formal school environments to informal adult learning
Twenty-first century skills are vital for preparing youth for careers in science, technology, engineering, and math (STEM) fields. STEM out-of-school time (OST) programs play an important role in helping youth develop these skills, particularly the teamwork skills necessary for the growing collaborative nature of STEM jobs. However, there is a lack of appropriate measures to evaluate this key programmatic outcome in STEM OST settings. This dissertation research addresses the lack of measures through the development of an instrument to assess team communication skills in middle and high school
As the maker movement is increasingly adopted into K-12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K-12 makerspaces and FabLabs.
Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence
DATE:
TEAM MEMBERS:
Paulo BliksteinZaza KabayadondoAndrew P. MartinDeborah A. Fields
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) developed, implemented, and evaluated the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through this grant, the NCBYS extended opportunities for informal science learning for the direct benefit of blind students by conducting six NFB STEM2U regional programs included programs for blind youth, their parents/caregivers, blind teen mentors (apprentices), and museum educators.
This checklist identifies and describes the elements of an evaluation report. It is intended to serve as a flexible guide for determining an evaluation report’s content. It should not be treated as a rigid set of requirements. An evaluation client’s or sponsor’s reporting requirements should take precedence over the checklist’s recommendations. Decisions about the order of content and level of detail in a report should be made with consideration of the audience’s information needs and priorities.
This checklist is strictly focused on the content of long-form technical evaluation reports
The Society for Science and the Public’s Advocate Grant Program provides selected Advocates with funding, resources, and information. Advocates include classroom teachers, school and district administrators, university professors, and informal science educators in community-based programs. The role of the Advocate is to support three or more underserved middle or high school students in the process of advancing from conducting a scientific research or engineering design project to entering a scientific competition. Advocates receive a stipend of $3,000; opportunities to meet and interact with
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through