This paper describes the Visitor Evaluation Program developed jointly by the Centre de Recherche Evaluation Social des Technologies (CREST) in Montreal (Bernard Schiele) and the CNRS in Paris (Jacqueline Eidelman). The purpose of the program is to ensure the successful installation of the future Galerie de l'Evolution at the Museum National d'Histoire Naturelle in Paris. The evaluation program is based on the application of principles and methods used in contemporary evaluation processes. This paper provides a brief description of the Galerie de l'Evolution project, the major stages of the
Backyard Mystery is an NSF-funded curriculum, focused on diseases, pathogens and careers, using interactive paper and physical activities. Content is for middle school participants in afterschool settings, like 4-H and other similar venues. The curriculum engages student interest in genetics and genomics and in the bioSTEM workforce. The curriculum storyline is placed in a familiar setting to students--the backyard--and explores fungi, bacteria, viruses and parasites in a way that is engaging fun and informative. It can be tailored to specific audiences, e.g. participants interested in animal science will gain from focusing on the parasite panel. The curriculum is available in two forms: a combined lesson that brings all of the elements together in one session and another in which the content is broken out into three separate lessons. We would like to share this curriculum with facilitators and educators for both out-of-school time and classroom settings. It is available electronically and free to use. We only ask for users to complete a brief survey to give us feedback, which is helpful for NSF.
Roto, an exhibition design and production firm, contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation of Speed, an exhibition being developed for The Science Museum of Virginia (SMV) in Richmond, Virginia. RK&A explored visitors’ thoughts, perceptions, and understandings of exhibition concepts related to speed, defined as change over time. How did we approach this study? RK&A worked closely with Roto to identify the goals and objectives for the Speed exhibition. Findings from the front-end evaluation were designed to help Roto and SMV find common ground between
Project LIFTOFF works with local, regional, and national partners to engineer statewide systems for Informal Science Education that inspire: YOUTH to pursue STEM education and careers through increased opportunities for quality, hands-on STEM learning. AFTERSCHOOL STAFF to facilitate STEM learning experiences that contribute to the overall STEM education and aspirations of youth in their programs. PROGRAM ADMINISTRATORS to encourage and support staff in the integration of STEM enrichment into the daily programming. STATE LEADERS to sustain and expand afterschool learning opportunities so that all students have access to engaging STEM experiences outside of the regular school day. Project LIFTOFF is dedicated to the development of the following essential elements of statewide systems for informal science education:
Access to appropriate STEM Curriculum for youth of all ages, abilities, and socio-cultural backgrounds that meets the needs and interests of individual community programs
Systematic STEM Professional Development that matches individual skills in positive youth development with abilities to facilitate discovery and science learning
A diverse Cadres of Trainers who will deliver the professional development, technical assistance and curriculum dissemination in their local communities
Authentic Evaluation of informal science efforts that determine the impacts on youth aspirations and the capacity of youth programs to provide quality STEM experiences
Local STEM education leadership to identify the ways in which collaborative education efforts can advance the development of 21st Century Skills and the preparedness for STEM workforce and higher education
Partnerships in support of youth development and informal science education that convene local, regional, and statewide organizations and stakeholders
To advance national initiatives and states' sySTEM engineering efforts, LIFTOFF coordinates an annual convening, the Midwest Afterschool Science Academy, that brings together national informal science experts, system leaders and youth development professionals to elevate the levels of science after school. The 5th MASA will be in the spring of 2014 in Kansas City, MO
DATE:
TEAM MEMBERS:
Missouri AfterSchool NetworkJeff Buehler
Arizona State University (ASU) in collaboration with Arizona Science Center, Boeing, Intel, Microchip, Motorola, Salt River Project, AZ Foundation for Resource Education, AZ Game & Fish Department, US Partnership for the Decade of Education for Sustainable Development, Mesa Public Schools, and Boys & Girls Clubs of the East Valley, offer a three-year extracurricular project resulting in IT/STEM-related learning outcomes for 96 participants in grades 7, 8, and 9. The project targets and engages female and minority youth traditionally under-represented in IT/STEM fields in multi-year out-of-school technological design and problem solving experiences. These include summer internships/externships and university research in the science center and industrial settings where participants develop socially responsible solutions for challenging real world problems. The program includes cognitive apprenticeships with diverse mentors, opportunities to practice workplace skills such as leadership, teamwork, time management, creativity and reporting, and use of technological tools to gather and analyze complex data sets. Participants simulate desert tortoise behaviors, research and develop designs to mitigate the urban heat island, build small-scale renewable energy resources, design autonomous rovers capable of navigating Mars-like terrain, and develop a model habitat for humans to live on Mars. Together with their families participants gain first-hand knowledge of IT/STEM career and educational pathways. In addition to youth outcomes, the adults associated with this project are better prepared to positively influence IT/STEM learning experiences for under-represented youth. The evaluation measures participant content knowledge, attitudes and interest in IT/STEM subjects, workplace skills and intentions to pursue IT/STEM educational and career pathways to understand participant reactions, learning, transfer and results. Informal curricula developed through this project, field-tested with youth at Boys & Girls Clubs and youth at Arizona Science Center will be available on the project website.
DATE:
-
TEAM MEMBERS:
Tirupalavanam GaneshMonica ElserStephen KrauseDale BakerSharon Robinson-Kurplus
The Santa Maria Experiment exhibit concerns the original and successful invisibility research that initially took place in Columbus, OH in 1994 and documents the scientific principles behind how and why this research worked. It consists of two display panels filled with charts, articles and photographs and is written so that elementary children can easily read and understand the information. It also includes a video documentary for viewing that shows the research in progress and demonstrates its abilities as well as limitations. The exhibit gets its name from the fact that the largest target used for the invisibility tests in 1994, was the full scale replica of Christopher Columbus' flag ship, the Santa Maria. The ship was made to appear almost complete invisible when viewed through a special light bending material that lead investigator, Marshall Barnes, used to see if refracted light would indeed produce "mirages of invisibility". The story about this research eventually went around the world and in 2006 it was suggested that a permanent exhibit be set-up for educational purposes and be a positive draw for visitors. Housed at the Santa Maria Seeds of Change Visitor Education Center on the Scioto riverfront in downtown Columbus, OH,and officially opened on Columbus Day 2007, this is the only exhibit in the world that brings this much fantasized, as well as scientifically misunderstood subject, into accurate, scientific focus.
This summative evaluation of the exhibition Robots & Us was designed to investigate how visitor audiences used and experienced this exhibition in relation to the project’s objectives and challenges. Visitors’ expectations and perceptions in relation to the project’s content goals prompted the summative evaluation to focus on specific challenges including: attitudes and perceptions about technology, connections between robots and people, appeal to a broad audience, and reactions to specific exhibits.
DATE:
TEAM MEMBERS:
Jeff HaywardJolene HartScience Museum of Minnesota
The WGBH Educational Foundation together with the Association of Computing Machinery (ACM) and dozens of partners, proposes a major new initiative to reshape the image of computing among college-bound high school students, with a special focus on Latina girls and African-American boys. Image is seen as an important factor in the lack of interest in computing majors among high school and college students, who often see computer scientists as geeks and nerds with boring jobs and equally boring lives. Latina girls and African-American boys--among the most underrepresented groups in computing--represent particularly important and challenging audiences. The New Image for Computing project will research and design a "communications make-over"--a new set of messages that will accurately and positively portray the field and will be widely tested for their emotional appeal to and intellectual connection with the targeted audiences. Experienced marketing professionals will help create the messaging campaign using proven marketing and communications strategies. WGBH, a leading producer of programming for public television and non-broadcast educational media, is uniquely positioned to lead this initiative, as they have a current, similar project called Engineer Your Life that aims to encourage academically prepared high school girls to consider engineering as an attractive option for both post-secondary education and as a career choice.
Twin Cities Public Television will produce six new episodes for the Dragonfly TV GPS (Going Places in Science) series in order to inform a mass audience of children, adults and educators about the revolutionary advances taking place in nanoscience and nanotechnology. The new programs will shine the DragonflyTV GPS spotlight on the network of science museums in the NISE Network, showcasing the new nanoscience programs and exhibits that are currently being developed. DragonflyTV, a weekly science television series targeted at children ages 8-12, presents children engaged in inquiry-based investigations, on-location in science centers across America. Each investigation will demonstrate the direct connection between learning experiences in science centers and the application of those lessons in everyday life. Each Nanoworld episode will apply the Dragonfly "Real Kids . . . Real Science" model, communicating both the scientific process and basic concepts in nanoscience. The DragonflyTV GPS will involve collaboration with the NISE Network, led by the Museum of Science in Boston, the Exploratorium, and the Science Museum of Minnesota. The episodes will be distributed by PBS Plus. Ancillary products will include an Educator's Guide, a Nanoworld poster, and a website featured on pbskids.org/go. Multimedia Research and will conduct formative and summative evaluations of the television production. Inverness Research will evaluate the collaborative process between TPT and the museum partners, and identify specific lessons learned by each group.
The institution is The Ohio State University at Lima, the university partners are the University of North Carolina at Greensboro and Fayetteville State University. It's About Discovery is a unique partnership to engage students and teachers in critical thinking skills in STEM content areas. The Ford Partnership for Advanced Studies (PAS) new science curriculum is the foundation for the project which will include over 700 students and 20-25 teachers. While the primary focus is on students, throughout the life of the project all teachers will participate in professional development focusing on the PAS units to ensure the quality teaching and understanding of the content. Technology will be integrated throughout the program to enable students to create inquiry based projects across state lines and for teachers to continue their professional development opportunities. Community partners will serve as mentors, host field trips, and engage in on-line conversations with students. An interactive website will be created for both teachers and students. The focus is on 8th grade science as it relates to STEM careers, 9th grade physical science and 10th science and mathematics. We are implementing a new Ford PAS curriculum module, Working Towards Sustainability, which comprises of four modules: We All Run on Energy, Energy from the Sun, Is Hydrogen a Solution? and The Nuclear Revolution. Teachers across states will engage in a new professional development model. Students will create projects through on-line conversations. A website will be created for project participants and the ITEST community. These hands-on, inquiry-based learning experiences engage students and prepare and encourage them to pursue science, engineering, and technology in high school and beyond. All PAS curricula use real world experiences, open-ended problems and result in real world applications. Assessments are on-going and inquiry driven. Teamwork and on-line resources and research are built into the curriculum design. The evaluation consists of a multi-method pre-post design. Teachers complete a Pre Survey at the beginning of the program and then again at the end of the school year. Students complete a Pre Survey at the beginning of the school year and a post survey at the end of the school year. In addition, teachers share students' scores on curriculum assessments completed throughout the year, including student scores on the Comprehensive Adult Student Assessment System's (CASAS) Assessment of Critical Thinking in Science writing tasks.
The "Salmon Research Team: A Native American Technology, Research and Science Career Exposure Program" is a three-year, youth-based ITEST project submitted by the Oregon Museum of Science and Industry. The project seeks to provide advanced information technology and natural science career exposure and training to 180 middle level and high school students. Mostly first-generation college-bound students, the target audience represents the Native American community and those with Native American affiliations in reservation, rural and urban areas. Students will investigate computer modeling of complex ecological, hydrological and geological problems associated with salmon recovery efforts. Field experiences will be provided in three states: Oregon, Washington and northern California. The participation of elders and tribal researchers will serve as a bridge between advanced scientific technology and traditional ecological knowledge to explore sustainable land management strategies. Students will work closely with Native American and other scientists and resource managers throughout the Northwest who use advanced technologies in salmon recovery efforts. Student participation in IT-dependent science enrichment and research activities involving natural science fields of investigation will occur year round. Middle school students are expected to receive at least 330 contact hours including a one-week summer research experience, a one-week spring break program, and seven weekends of residential programs during the school year. The high school component consists of 460 contact hours reflecting one additional week for the summer research experience. In addition to watershed and salmon recovery related research, students will be involved in other ancillary research projects. A vast array of partners are positioned to support the field research experience including, for example, the U.S. Department of the Interior, Redwood National State Park, College of Natural Resources and Sciences at Humboldt State University, Confederated Tribes of the Warm Springs, University of Oregon Institute of Marine Biology, University of Washington Columbia Basin Research project, the Northwest Center for Sustainable Resources at Chemeketa Community College and the Integrated Natural Resource Technology program at Mt. Hood Community College. The project is intended to serve as a model for IT-based youth science programs that address national and state education standards and are relevant to the cultural experience of Native American students. Two mentors will provide continued support to students: an academic mentor at the student's schools and a professional mentor from a local university or natural resource agency. Incentives will be provided for student participation including stipends and internships. Career exposure and work-related skills are integrated throughout the project activities and every program component. Creative strategies are used to encourage family involvement including, for example, salmon bakes and museum discounts.
DATE:
-
TEAM MEMBERS:
Travis Southworth-NeumeyerDaniel Calvert
The Oregon Museum of Science and Industry (OMSI), in partnership with the Native American Youth Association (NAYA), Intel Oregon, the National Park Service, and National Oceanic and Atmospheric Administration, will the expand the existing Salmon Camp Research Team (SCRT), a youth-based ITEST project targeting Native American and Alaskan Native youth in middle and high school. SCRT uses natural resource management as a theme to integrate science and technology and provide students with opportunities to explore local ecosystems, access traditional American Indian/Native Alaskan knowledge, and work closely with researchers and natural resource professionals. The project is designed to spark and sustain the interest of youth in STEM and IT careers, provide opportunities to use IT to solve real world problems, and promote an understanding of the complementary nature of western and native science. The original SCRT project included summer residential programs, spring field experiences, weekend enrichment sessions, parental involvement, college preparatory support, and internship placement. The renewal will increase the IT content for participants by adding an afterschool component, provide opportunities for greater parental involvement, enhance the project website, and develop a SCRT toolkit. Students are exposed to a variety of technologies and software including Trimble GeoExplorer XM GPS units, PDAs with Bluetooth GPS antennae, YSI Multi-Probe Water Quality Field Meters, GPS Pathfinder, ArcMap, ArcPad, Terrasync, and FishXing. It is anticipated that this project will serve 500 students in Oregon, Washington, California, Idaho, Montana, and Alaska, proving them with over 132 contact hours.
DATE:
-
TEAM MEMBERS:
Travis Southworth-NeumeyerSteven TritzDaniel CalvertNicole Croft