The Tech Museum of Innovation (The Tech) in San Jose, California proposes to partner with NOAA to integrate Science On a Sphere (SOS) into The Tech's Exploration gallery and to facilitate the development of informal and formal learning programs. Exhibits and programs at The Tech focus on the integration of emerging technologies into hands-on visitor experiences. In 2004, The Tech partnered with NOAA, the Maryland Science Center (MSC), and a consortium of national science centers to explore the potential and effectiveness of SOS as a method of engaging and informing the general public about NOAA-related sciences. Initial testing of SOS at the Maryland Science Center revealed that SOS is a visually compelling and engaging medium for conveying complex scientific information to museum visitors. Ninety-eight percent of visitors tested regarded a facilitated SOS program as a good or excellent experience with strong visitor retention suggesting the potential of SOS as a compelling visitor tool. However, when the experience was not facilitated this retention dropped dramatically. Support from NOAA will enable The Tech to test SOS and NOAA data in a number of formats to determine the most effective ways to utilize this incredible technology. The results of this evaluation will be shared with other museums using SOS to improve its reach in teaching informal audiences and promoting interest in both STEM content and NOAA research. The SOS exhibit will bring together scientists, technologists, informal education specialists, and young users to unlock the educational potential of NOAA's datasets and further NOAA's educational plan. Hands-on experiences using SOS will engage visitors in meaningful explorations of NOAA data. The Tech Museum will make SOS accessible to people of all ages, backgrounds, and educational levels. All panel text, audio, and captions will be presented in both English and Spanish to allow greater accessibility for local audiences. SOS will provide the programming platform upon which to explore the educational opportunities of this gallery as it illustrates how data collected with remote sensing technologies is helping us understand and make predictions about our dynamic environment and the future of our planet. SOS will illustrate how these data collecting technologies assist us in developing our knowledge about our planet and its solar system.
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.
This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.
With support from the National Science Foundation, Denver Museum of Nature and Science and Thomas Lucas Productions have produced a planetarium show entitled, Black Holes: The Other Side of Infinity. The 20-minute full-motion program uses scientific simulations and data-based animations to illustrate the death of stars and the birth and characteristics of black holes.
Multimedia Research implemented a one-group pretest-posttest summative evaluation focused on appeal to and impact on upper elementary school students. Participating fourth graders (n = 104) and fifth graders (n = 64) were
The MyBEST (Mentoring Youth Building Employable Skills in Technology) project, funded by a grant from the National Science Foundation's Informal Science Education program, concluded its three years of operation in 2006. This youth-based program was intended to provide participants with in-depth learning experiences involving information and design technologies. These experiences had a dual focus: enabling youth participants to gain fluency in using these technologies while showing them how adults apply them in work and academic endeavors. Appendix includes survey.
During the spring of 2006, American Institutes for Research (AIR) conducted an evaluation study on behalf of WGBH. The purpose of the study was to gather data related to the effectiveness of the FETCH! Activity Guide, which was designed to extend the teachings of a new children’s show, “FETCH! with Ruff Ruffman.” The Activity Guide was developed for after-school program facilitators and other informal science educators to use at their facilities, either in conjunction with the television show or as stand-alone resources. Appendix includes instruments.
“Scaling up” involves adapting an innovation successful in some local setting to effective usage in a wide range of contexts. In contrast to experiences in other sectors of society, scaling up successful programs has proved very difficult in education. In this chapter, Chris Dede discusses the challenges in creating scalable and sustainable educational interventions.
DATE:
TEAM MEMBERS:
Chris Dede
resourceprojectProfessional Development, Conferences, and Networks
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
This paper details a long-term evolving effort to provide evaluation instruction designed to address specific information needs for selected target groups from a centralized location within a networked environment. Additionally, this paper examines a content design process that focuses on user-centered data-appropriate evaluation methods where the content of the instructional system is comprehensive, organized, and presented for use by library researchers and practitioners in a variety of library settings and situational contexts. Specific examples of web-based evaluation instructional systems
DATE:
TEAM MEMBERS:
John SneadCharles McClureJohn BertotPaul Jaeger
As the astronomy education community develops, a need has arisen for concrete research and evaluation methodologies, especially within informal educational settings. We propose one such methodology, action evaluation, which attempts to demystify the process of research/evaluation and recruit as partners those who are traditionally left out of this process. Based on the tradition of action research, this methodology incorporates research/evaluation into the fabric of programs and places the researcher/educator in a centralized role. We provide concrete examples of tools that we have used to
DATE:
TEAM MEMBERS:
Nicholas StroudMeghan GroomeRachel ConnollyKeith Sheppard
This article is a report of the impact assessment of two outreach programs to primary schools run by the Botswana National Museum. The oldest of the programs, Zebra-on-Wheels was officially launched in 1980 and has involved all the primary schools in the country at least twice. The study aimed to establish the impact of the two programs and make recommendations for possible improvements. Thirty-eight schools throughout Botswana participated in the study. Teachers in these schools were interviewed and classroom observation sessions were carried out. Teachers’ observations about the two programs
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.