Goodman Research Group, Inc. (GRG), a research firm in Cambridge, Massachusetts specializing in program evaluation, has been conducting external evaluation of ZOOM for WGBH-TV Boston since 1998. GRG's Season VI evaluation comprised a pilot test to investigate the effectiveness of the new online ZOOMSCITM TRAINING: LEARN TO LEAD SCIENCE ACTIVITIES (ZOOMsci Training), a self-directed, online tutorial designed to help afterschool educators learn how to lead hands-on science activities with kids ages 8 to 11. The goal of the training is to motivate leaders, help them develop science-teaching
This report presents the findings of the summative evaluation of the Science Museum of Minnesota’s Big Back Yard (BBY), with a specific focus on Earthscapes Miniature Golf. Mary McEathron, Amy Grack, and Stacey Grimes, graduate students in the Evaluation Studies program at the University of Minnesota, carried out the evaluation during the summer of 2004. The purposes of the evaluation were to understand visitors’ experiences in the Big Back Yard and the quality of awareness or understanding acquired as a result of that experience. The evaluation was conducted to answer the following evaluation
Harvard Family Research Project's (HFRP) Issues and Opportunities in Out-of-School Time Evaluation briefs highlight current research and evaluation work in the out-of-school time field. These documents draw on HFRP's research work in out-of-school time to provide practitioners, funders, evaluators, and policymakers with information to help them in their work. Recognizing the critical role that staff play in promoting quality out-of-school time (OST) programs, in this brief we examine OST professional development efforts and offer a framework for their evaluation.
Thomas Kuhn's notion of a disciplinary matrix provides a useful framework for investigating the growth of research on family learning in and from museums over the last decade. To track the emergence of this disciplinary matrix we consider three issues. First are shifting theoretical perspectives that result in new shared language, beliefs, values, understandings, and assumptions about what counts as family learning. Second are realigning methodologies, driven by underlying disciplinary assumptions about how research in this arena is best conducted, what questions should be addressed, and
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
This paper describes a 2002 study conducted by Steve Tokar that was the first of its kind to evaluate universal design practice among North American museums with hands-on science exhibits. Tokar investigated the following questions: (1) For which audiences do museum exhibit professionals think their exhibitions are accessible?; (2) What is the current level of institutional commitment to creating exhibits that are universally designed and accessible for visitors with disabilities?; (3) Which areas need improvement?; and (4) Where have we succeeded? Evaluation methodologies, key findings, and
DATE:
TEAM MEMBERS:
Steve TokarVisitor Studies Association
This paper presents two perspectives that the author believes will contribute to an enhanced ability to describe and understand learning from museums. Arguably, a major strength of the past decade of research on learning from museums has been the description and investigation of many of the myriad factors that appear to influence learning from museums. However, though we now understand the factors, we do not yet know how to consider them holistically. We do not conduct research as if all these variables were important. In addition, we have not sufficiently incorporated scope and scale into our
DATE:
TEAM MEMBERS:
Institute for Learning InnovationJohn H Falk
In this Summative Evaluation, Goodman Research Group, Inc. found that PEEP effectively models science inquiry skills, including predicting, observing, and problem solving. Children who were exposed to PEEP interacted with materials in ways that were significantly more grounded in science inquiry than children who were not. By a margin of 71% to 22%, for example, children who watched PEEP were more likely to initiate a question to be explored. Children exposed to PEEP were also more likely to use problem-solving strategies (76% compared to 34%) and more likely to solve the problems they
Concept planning studies ("front-end" studies) are useful in finding out "where the audience is starting from" in their perceptions of particular subjects, themes or messages to be communicated in upcoming exhibitions. In this case, the exhibition team needed some clarifications about visitors' awareness, interests, and other perceptions of 'current science.' The priorities for this research were focused on: name and recognition of the topic (explore people's reactions to 10 preliminary "titles;" seek examples of topics that they associate with new/current science) interest in current science
DATE:
TEAM MEMBERS:
Jeff HaywardScience Museum of MinnesotaJolene Hart
Goodman Research Group, Inc. (GRG), an evaluation research firm specializing in the evaluation of educational programs, services, and materials, is conducting an evaluation of PEEP and the Big Wide World (PEEP). The primary focus of the evaluation is to assess PEEP's appeal and the extent to which the various components of PEEP (e.g., television series, Web site, and educators' print guide) contribute to encouraging children ages 3-5 years to engage in hands-on science explorations of their everyday environments. GRG employed several data collection methods to assess PEEP, including a children
DATE:
TEAM MEMBERS:
Jennifer BeckWGBH-TV BostonJennie MurackIrene F Goodman
This study is the first phase of a two-part summative evaluation of a National Science Foundation-funded research/development project to investigate the development of exhibits that elicit active prolonged engagement (APE) among casual museum visitors. Naturalistic methodology was used to frame the research. Methods included unobtrusive observations, depth interviews, and tracking-and-timing. Forty-six unobtrusive observations and 35 related depth interviews were conducted on site at the Exploratorium from August 5 through 10, 2003. After all observations/interviews had been completed
Going APE! is a National Science Foundation-funded research/development project to investigate how to develop Exploratorium exhibits that elicit active prolonged engagement (APE) among casual museum visitors. As part of this research/development process, Selinda Research Associates, Inc. (SRA) conducted a summative evaluation to assess how and to what extent the exhibit units developed by the Exploratorium team were in fact APE exhibits. This report is the second of two distinct phases of the summative evaluation study. The first phase of the summative evaluation compared visitor engagement at