Twenty-first century skills are vital for preparing youth for careers in science, technology, engineering, and math (STEM) fields. STEM out-of-school time (OST) programs play an important role in helping youth develop these skills, particularly the teamwork skills necessary for the growing collaborative nature of STEM jobs. However, there is a lack of appropriate measures to evaluate this key programmatic outcome in STEM OST settings. This dissertation research addresses the lack of measures through the development of an instrument to assess team communication skills in middle and high school
The Museum of Science, Boston’s Research and Evaluation Department conducted a summative evaluation of The Hall of Human Life (HHL) exhibition. This 9,700 square foot exhibition is geared towards older children and adults. It is focused on human biology and human health with the main message, “Human beings are changing in a changing environment.” Visitors are able to use their own bodies and behaviors to understand biological mechanisms. Unique to this exhibition, visitors are able to use scannable wristbands to record and compare personal data with other Museum visitors to learn about their
As the maker movement is increasingly adopted into K-12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K-12 makerspaces and FabLabs.
Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence
DATE:
TEAM MEMBERS:
Paulo BliksteinZaza KabayadondoAndrew P. MartinDeborah A. Fields
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
In 2016, more than 120 National Park Service (NPS) units conducted BioBlitzes, supported by a collaboration between The National Geographic Society and the National Park Service. The Lawrence Hall of Science conducted an evaluation of participant and park outcomes at the cornerstone BioBlitz throughout the National Capital region, at the large (regional) Showcase BioBlitzes, and at additional events at National Parks across the US. The report includes a description of the evaluation project, case studies from 3 BioBlitzes, findings, recommendations, and the instruments used to measure
As part of its continuing effort to maximize efficiency by assessing the effectiveness of its efforts, NASA’s Office of Education contracted with Abt Associates in July 2009 to evaluate the Informal Education Program. The goals of the evaluation are twofold: (1) to gain insight into its investment in informal education; and (2) to clarify existing distinctions between its informal education and outreach efforts. The evaluation findings provide descriptive information about all the projects in the NASA’s education portfolio affiliated with Outcome 3 (Informal Education) and selected Outcome 2
The Art of Science Learning Project (AoSL) is a National Science Foundation (NSF)-funded initiative, founded and directed by Harvey Seifter, that uses the arts to spark creativity in science education and the development of an innovative 21st century STEM workforce. This research was guided by three main hypotheses: (1) Arts-based innovation training, compared to traditional innovation training, improves an individuals creative thinking skills including critical thinking, divergent thinking, problem identification, convergent thinking and problem solving; (2) Arts-based innovation training
“From Earth to the Universe” (FETTU) is a collection of astronomical images that showcase some of the most popular, current views of our Universe. The images, representing the wide variety of astronomical objects known to exist, have so far been exhibited in about 500 locations throughout the world as part of the International Year of Astronomy. In the United States, over 40 FETTU exhibits have occurred in 25 states in such locations as libraries, airports, nature centers, parks and college campuses. Based on preliminary evaluations currently underway, this project – a large-scale, worldwide
Commonly described as youth-led or youth-driven, the youth-adult partnership (Y-AP) model has gained increasing popularity in out-of-school time (OST) programs in the past two decades (Larson, Walker, & Pearce, 2005; Zeldin, Christens, & Powers, 2013). The Y-AP model is defined as “the practice of (a) multiple youth and multiple adults deliberating and acting together (b) in a collective (democratic) fashion (c) over a sustained period of time (d) through shared work (e) intended to promote social justice, strengthen an organization and/or affirmatively address a community issue” (Zeldin et al
DATE:
TEAM MEMBERS:
Heng-Chieh Jamie WuMariah KornbluhJohn WeissLori Roddy
This document contains the appendices and literature review from the report "Art+Science: Broadening Youth Participation in STEM Learning." It includes assessment tools used during the project.
This summative evaluation study examines visitors' experiences of the "Plastics Unwrapped" exhibit at the Burke Museum of Natural History, Seattle, WA. The exhibit explores the complicated legacy of plastic, and the ways in which it has improved life, but not without serious impact on people and the environment. Within a framework of four evaluation questions, this study used multiple methods to assess what visitors do and where they spend their time in the exhibit, what knowledge they take away, and whether the exhibit impacts visitors' attitude toward plastic and their perception of the