This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.
Dr. Barbara Flagg, Director, Multimedia Research, will conduct exploratory research to assess the feasibility and viability of presenting to the public an on-going review of new findings or issues in major fields of research. This research on the untested idea of providing the public with information about research on a regular, on-going basis through multiple media will provide information about the American public's current science media habits, their awareness of and interest in broad areas of research, and the presentation formats most likely to appeal to and reach the public on a regular basis.
Earth & Sky is a daily short-format science series for both commercial and public radio. Produced by EarthTalk, Inc. of Austin, TX, the series is hosted by Deborah Byrd and Joel Block and consists of 90-second programs on a wide variety of topics mostly drawn from environmental sciences, earth sciences and astronomy. With support from the National Science Foundation, Multimedia Research presents the first study of a two-part summative evaluation on the impact of Earth & Sky on public radio listeners, focusing on traditional formats as well as the new “Edge of Discovery” programming that
This document reports on the first phase of a summative evaluation of Science Friday's expansion to examine the importance of research as a theme underlying all science and technology changes. In this phase of the evaluation, in-depth qualitative discussions concerning public understanding of basic research were held with listeners of Science Friday. The study has two goals: (1) To provide feedback to producers as to the series’ current strengths and weaknesses with respect to the above stated goals; and (2) To guide the development of a written questionnaire to be mailed to random public
The Yellowstone Park Foundation is partnering with Yellowstone National Park (YNP) to develop and build a visitor education center at Old Faithful. Selinda Research Associates (SRA) worked with staff from Yellowstone's Division of Interpretation to plan and conduct a front-end evaluation of the exhibits for the new center. The evaluation was grounded in naturalistic methodology and used a variety of methods to triangulate on park visitors understanding of and reactions to a variety of issues. These methods included in-depth interviews with visitors both before and after their visits and card
This report presents the findings from a front-end evaluation for an exhibition being developed by The Tech Museum of Innovation about genetics, health, and technology. Front-end evaluation is conducted to help planners understand visitors’ thoughts and reactions to key themes, ideas, concepts, and activities being developed for an exhibition. Since front-end evaluation highlights both common ground and gaps between visitors and the exhibition’s concept, the evaluation findings may inform the team’s decisions as exhibition development progresses. The evaluation objectives were to: (1)
This evaluation of Mysteries of Çatalhöyük was commissioned by the Science Museum of Minnesota to provide objective feedback about the character of visitors’ experiences in this exhibition. The process of investigating visitors’ experiences included assessing and analyzing the extent of their use of the exhibition, awareness and perception of the interpretive messages presented, reactions to selected exhibit features, satisfaction with the experience, and characteristics of the audience who chose to see it; of these topics, the analysis of interpretive messages was considered to have primary
We used meta-analysis to review 55 evaluations of the effects of mentoring programs on youth. Overall, findings provide evidence of only a modest or small benefit of program participation for the average youth. Program effects are enhanced significantly, however, when greater numbers of both theory-based and empirically based "best practices" are utilized and when strong relationships are formed between mentors and youth. Youth from backgrounds of environmental risk and disadvantage appear most likely to benefit from participation in mentoring programs. Outcomes for youth at-risk due to
DATE:
TEAM MEMBERS:
David DuBoisBruce HollowayJeffrey ValentineHarris Cooper
This report provides a critical overview of impact evaluation in the museums, archives and libraries sector. The study, funded by Resource: The Council for Museums, Archives and Libraries, consisted largely of a review of the literature published during a five year retrospective period, with a particular emphasis on impact evaluations conducted within the UK. An advisory group, representing all three domains, was also established. The methodologies used in, and the evidence obtained from, these evaluation studies are discussed critically within the broad context of social, learning and
DATE:
TEAM MEMBERS:
Caroline WavellGraeme BaxterIan JohnsonDorothy Williams
One method for studying visitors in museums is to audiotape their conversations while videotaping their behavior. Many researchers inform visitors of the recordings by posting signs in the areas under scrutiny. This study tests the assumptions underlying that method—that visitors notice, read, and understand such signs. Signs were posted at the entrance to an Exploratorium exhibit which was being audio- and videotaped. Researchers interviewed 213 adult visitors as they exited the exhibit. The interviews revealed that 75 percent of the visitors had read and understood the sign. Of the 52
This book describes the similarities and differences between scientific inquiry in education and scientific inquiry in other fields and disciplines and provides a number of examples to illustrate these ideas. Its main argument is that all scientific endeavors share a common set of principles, and that each field including education research develops a specialization that accounts for the particulars of what is being studied. The book also provides suggestions for how the federal government can best support high-quality scientific research in education.
DATE:
TEAM MEMBERS:
National Research CouncilRich ShavelsonLisa Towne