The summative evaluation focuses on two project components: (1) an IMAX® Dome film, titled Coral Reef Adventure, and (2) an associated interactive exhibit, titled Weird, Wild and Underwater, intended to be displayed in museum and science center lobbies. The general goals for the summative evaluation study were to assess the appeal of "Coral Reef Adventure" film and the lobby exhibit; acquisition of scientific knowledge and understanding as related to the project’s learning goals and understanding of film topics; and the impact that the exhibit has on viewers of the film. A separate-sample
This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk radio show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the first study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ future increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not
This report presents the findings from a front-end evaluation for an exhibition about tuna, which is currently under development at the Monterey Bay Aquarium. Visitors were intercepted on the second floor of the Aquarium and invited to view tuna in the big tank from the lower level of the Aquarium and to review, and ultimately select, one of six prototype interpretive panels, all of which were about different aspects of tuna. The evaluation goals for this study were to determine: • what visitors overall reactions are when they view the tuna in the big tank from the lower level of the aquarium
The purposes of the STUDIO 3D evaluation were to collect information about the impact upon student learning as a result of participating in the STUDIO 3D Project, as well as to elicit information for program improvement. Areas of inquiry include recruiting and retention, impact on project participants, tracking student impacts, and the project as a whole.
Knight-Williams collaborated with five aquaria to solicit the reactions of a random sample of their aquaria members to the PBS broadcast of the Shape of Life series. The collaborating aquaria were located in geographically diverse regions of the country and included: The Seattle Aquarium, Cabrillo Marine Aquarium, Dauphin Island Sea Lab, Shedd Aquarium, and New York Aquarium. The report focuses on questionnaire data provided by both the non-viewer respondents and by viewers of two or more episodes from the series.
This article examines how people learn by actively observing and "listening-in" on ongoing activities as they participate in shared endeavors. Keen observation and listening-in are especially valued and used in some cultural communities in which children are part of mature community activities. This intent participation also occurs in some settings (such as early language learning in the family) in communities that routinely segregate children from the full range of adult activities. However, in the past century some industrial societies have relied on a specialized form of instruction that
DATE:
TEAM MEMBERS:
Barbara RogoffRuth ParadiseRebeca Mejia ArauzMarciela Correra-ChavezCathy Angelillo
Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the purpose of examining the extent to which these evaluations are participatory. Based on this examination, the paper proposes a model for implementing multi-site, participatory evaluation.
Community learning of science and technology has undergone radical review in the past few years. This paper outlines changes that have taken place in research methods that have addressed the informal learning of science, particularly in the museum sector. We discuss the shift in perspective that has occurred over the past three decades in the public understanding movement, examine some current issues, and suggest future directions for research. The paper concludes with a personal vision for the future of community learning about science and technology.
One method for studying visitors in museums is to audiotape their conversations while videotaping their behavior. Many researchers inform visitors of such recordings by posting signs in the areas under scrutiny. An earlier study tested the assumption that visitors notice, read and understand posted signs (Gutwill, 2003). Interviews revealed that 75 percent of visitors leaving a recording area had read and understood the signs. This article describes our attempt at increasing this percentage by placing additional signs on the exhibit elements being used, as well as on the camera itself
This article describes a front-end evaluation conducted by researchers at the Wildlife Conservation Society's Prospect Park Zoo in planning for the new "In Living Color" exhibit. The evaluation examined how the zoo's average young visitor--a 5.1 year old--thinks and feels about animal coloration.
This article describes an exhibit evaluation project at the San Diego Natural History Museum, funded by NSF in 2001, which took a participatory approach to better understand their audience. The authors, two participants in this project, discuss their motivations and goals, useful models and lessons learned from a special needs focus group.