In this paper, Jeff Bonner of the St. Louis Science Center discusses the merits of formal versus naturalistic evaluation within the museum context. Bonner also presents the approach and findings of a two-part study designed to compare the results of these two evaluation approaches. They compared the the results of a formal analysis of the holding power, ease of use, readability of text, and overall enjoyability of nine exhibits with a naturalistic study focused on how one volunteer, two part-time employees and a staff supervisor viewed the same exhibits.
The Project Jason Museum Network, comprising a group of some 10 science museums throughout the United States and represented in this proposal by the Franklin Institute, requests partial support of a major experiment in the use of electronic field trips organized by Dr. Robert Ballard and associates at the Woods Hole Oceanographic Institute. Over a two week period in May 1989, a series of satellite television transmissions will provide more than 150,000 students at some dozen museums with live, two way interactive TV coverage of a significant underwater archaeological expedition in the central Mediterranean Sea carried out by Dr. Ballard's group. The research expedition will be widely publicized, with public interest and attention similar to that obtained during his explorations of the Titanic. A variety of archaelological, oceanographic, and technological programs will be provided to museums through a Project Jason Satellite Network established for the purpose; participating schools, teachers and school children will already be familiar with the project and its methods through curriculum materials developed by NSTA with support from NSF's Instructional Materials Development program. An extensive evaluation program will accompany the first year's effort, and the Network plans to continue providing material from Project Jason for several additional years. In addition, other forms of distance learning will be investigated and developed using the infrastructure developed for Project Jason. Overall, more than a million individuals will view programs provided by the network in live presentations or later videotapes. Direct cost sharing by the Network Members is more than $3 million, with similar amounts contributed by Dr. Ballard's group at Woods Hole.
The middle-school and high-school years are a period of change and crystalization in terms of life goals, disciplinary and course preferences, and social and political attitudes. The literature provides a number of cross-sectional descriptions and models concerning cognitive and attitudinal development during adolescence and young adulthood, but there are no longitudinal data available to study these processes. The proposed longitudinal study will examine the (1) development of interest in science and mathematics, (2) the growth of scientific literacy, (3) the development of attentiveness to science and technology issues, and (4) the attraction to careers in science and engineering among two national cohorts of adolescents and young adults. One cohort will begin with a national sample of 3,000 seventh graders and follow them through the 10th grade. The second cohort will begin with a national sample of 3,000 10th graders and follow them for the next four years through the first full year after high school. Data will be collected from students, teachers, counselors, principals, and parents. A purposive sample of two or three school districts with exemplary elementary school science and mathematics education programs will be selected and comparable data will be collected in these districts. The analysis will consist of a series of expanding multivariate developmental models that will seek to understand cognitive and attitudinal growth and change in the context of family, school, and peer influences. Each wave of data collection will provide an opportunity to examine cognitive and attitudinal change measures in an increasingly rich context of previous measures. Periodic reports will be issued with each cycle of data collection and the data will be made available to other scholars on a timely basis. The first phase of the project, being funded at this time, provides approximately 15 months for instrument development and pilot testing, for sample selection, for monitor selection and training, and for working with the research advisory committee.