This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This study researched whether and how affiliation with the Nanoscale Informal Science Education Network (NISE Net) led to change in informal science education organizations’ (ISEs) practices. The NISE Net provided an opportunity to look at how participation in a large but loosely-structured network of museums, science centers, educators, and scientists can influence museums to experience organizational change and adopt new practices.
By conducting qualitative case studies of a few selected partners, this research aimed to understand the conditions that facilitate or impede the influence of
Twenty-first century skills are vital for preparing youth for careers in science, technology, engineering, and math (STEM) fields. STEM out-of-school time (OST) programs play an important role in helping youth develop these skills, particularly the teamwork skills necessary for the growing collaborative nature of STEM jobs. However, there is a lack of appropriate measures to evaluate this key programmatic outcome in STEM OST settings. This dissertation research addresses the lack of measures through the development of an instrument to assess team communication skills in middle and high school
Ruff Family Science is an exploratory project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. More specifically, the project is undertaking a research and design process to create prototype
The Association of Science-Technology Centers (ASTC) aims to help member institutions inform and educate the public about science through a global lens. The World Biotech Tour (WBT) was a three-year initiative designed to not only promote a greater understanding of biotechnology through public outreach and programming led by science centers and museums, but also as an opportunity for ASTC to collect useful data on the resources required and challenges encountered at different science museums around the world when implementing a long-term, multi-country program. The WBT involved students
In 2015, the Swinomish Indian Tribal Community (SITC) received a two-year NSF-AISL Pathways Grant (#1516742) entitled “Developing an Informal Environmental Health Education Model in Tribal Communities,” designed to develop a process model and curriculum for community-based environmental health outreach, grounded in cultural values and practices. The project deliverables included a curriculum and guiding document, intended to inform and inspire other tribal communities wishing to create a culture-based environmental or public health curriculum.
SITC contracted the Lifelong Learning Group
As the maker movement is increasingly adopted into K-12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K-12 makerspaces and FabLabs.
Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence
DATE:
TEAM MEMBERS:
Paulo BliksteinZaza KabayadondoAndrew P. MartinDeborah A. Fields
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This poster, which was presented at the Association of Science and Technology Centers Annual Conference on October 22, 2017, compares and contrasts evaluation findings across components of the Beyond Spaceship Earth project at The Children's Museum of Indianapolis. The project focuses on educating families and students about life and work aboard the International Space Station and generating interest in STEM topics and careers. Project components reviewed include an exhibit, a space object theater, and workshop-style programs focused on engineering and robotics for both families and school
In partnership with the Center for Research on Lifelong STEM Learning, we completed year one of a multi-year study on the impact of the Curiosity Machine model on students. There is a specific focus on linking dosage to impact. The constructs that were explored were:
* STEM identities (e.g., how students think of themselves in science)
* “Possible selves” (see STEM as a component of their own career or future learning pathways, e.g., course taking in STEM areas)
* Self-efficacy (e.g., beliefs in their abilities in STEM subject areas, self-perception of confidence in STEM)
* Interest in
This study explored the effect of depth of learning (as measured in hours) on creativity, curiosity, persistence and self-efficacy. We engaged ~900 parents and 900 students across 21 sites in Washington, Chicago, Los Angeles, New York, Alabama, Virginia and the United Arab Emirates, in 5-week (10-hr) Curiosity Machine programs. Iridescent trained partners to implement the programs. Thus, this analysis was also trying to establish a baseline to measure any loss in impact from scaling our programs and moving to a “train-the-trainer” model. We analyzed 769 surveys out of which 126 were paired. On
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition