Exploration Place, with funding from the National Aeronautics and Space Administration (NASA), contracted RK&A to conduct a summative evaluation of Design Build Fly, an exhibition and program series that explores what happens behind-the-scenes in Wichita’s aircraft plants. The goals of the study were to identify how visitors use the exhibition, explore what meaning visitors make from Design Build Fly, and understand to what extent visitors’ meaning-making aligns with intended outcomes.
How did we approach this study? RK&A conducted timing and tracking observations of visitors to the
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
My Sky is a joint project between Boston Children’s Museum (BCM) and the Smithsonian Astrophysical Observatory (SAO). This three-year project was supported by NASA’s NRA/ROSES 2011 (NNX12AB91G) program, and resulted in the creation of My Sky, a 1,500 sq. ft. traveling astronomy exhibit designed for adults and children, ages 5 – 10. My Sky emphasizes authentic experiences that encourage the development of skills and content foundational to later appreciation and understanding of astronomical science. My Sky includes interactive explorations of objects and phenomena visible in the sky, encouraging families to “look up” not only when they visit the exhibit, but as a practice they might adopt in their everyday lives. This is all punctuated by real NASA data and assets, including a 5’ diameter model Moon created using the latest Lunar Reconnaissance Orbiter measurements; and high-resolution images from NASA’s Solar Dynamics Observatory satellite. This project also developed a series of public programs, museum staff training programs, and family workshops, all utilizing NASA resources and existing curriculum.
Flying Higher will develop a permanent hands-on exhibit that conveys the fundamentals of flight, technology, materials science, and NASA’s role in aeronautics for learners ages 3-12 years and their parents/caregivers and teachers. The exhibit, public programs, school and teacher programs, and teacher professional development will develop a pipeline of skilled workers to support community workforce needs and communicate NASA’s contributions to the nation and world. An innovative partnership with Claflin University (an historically black college) and Columbia College (a women’s liberal arts college) will provide undergraduate coursework in informal science education to support pre-service learning opportunities and paid employment for students seeking careers in education and/or STEM fields. The projects goals are:
1) To educate multi-generational family audiences about the principles and the future of aeronautics; provide hands-on, accessible, and immersive opportunities to explore state-of-the-art NASA technology; and demonstrate the cultural impact of flight in our global community.
2) To provide educational standards-based programming to teachers and students in grades K–8 on NASA-driven research topics, giving the students opportunities to explore these topics and gain exposure to science careers at NASA; and to offer teachers support in presenting STEM topics.
3) To create and implement a professional development program to engage pre-service teachers in presenting museum-based programs focused on aeronautics and engineering. This program will provide undergraduate degree credits, service learning, and paid employment to students that supports STEM instruction in the classroom, explores the benefits of informal science education, and encourages post-graduate opportunities in STEM fields.
The purpose of the Lenses on the Sky project is to create diverse skywatching-related experiences for youth across Oregon with a special focus on underserved Hispanic, African American, Native American, and rural communities. The Oregon Museum of Science and Industry (OMSI) will create and implement the project in collaboration with Portland’s Rose City Astronomers amateur astronomy club, Rosa Parks Elementary School in Portland, the Libraries of Eastern Oregon (LEO), and ScienceWorks Hands-On Museum in southern Oregon. The goals of the project are for participants to 1) understand the “big idea” that “humans have used observational tools and techniques across culture and time to understand space phenomena”, 2) recognize the relevance, value, and scientific achievements of NASA missions, and 3) be inspired to learn more about topics related to space science, STEM careers, and NASA. Audiences will explore these topics through three main “lenses” or frames: a NASA lens, a tools lens, and a cultural lens. The project will result in 1) a small, permanent, bilingual (Spanish/English) exhibition in OMSI’s free, public spaces adjacent to its planetarium, 2) three observational astronomy events held in Portland, Southern Oregon, and Eastern Oregon, 3) hands-on activities conducted at partner museums/libraries and shared with other educational institutions, 4) an Educator's Guide including lesson plans aligned with Next Generation Science Standards (NGSS), and 5) over 150 email communications to hundreds of recipients featuring space news updates.
Discover NASA is the Discovery Museum’s endeavor to engage students in grades K through 12 as well as members of the general public in innovative space science and STEM-focused learning through the implementation of two modules: upgrades to the Challenger Learning Center, and the creation of K through 12 amateur rocketry and spacecraft design programming. The programming will be piloted at the Discovery Museum and Planetarium, and at the Inter-district Discovery Magnet School and the Fairchild-Wheeler Multi-Magnet High School, with an additional strategic partnership with the University of Bridgeport, which will provide faculty mentors to high school seniors participating in the rocketry program. Through these two modules, the Discovery Museum and Planetarium aims to foster an early interest in STEM, increase public awareness about NASA, promote workforce development, and stimulate an interest in the future of human space exploration. Both modules emphasize design methodologies and integration of more advanced space science into the STEM curriculum currently offered by Discovery Museum to visitors and public schools. The Challenger Learning Center upgrades will enable the Museum to deliver simulated human exploration experiences related to exploration of the space environment in Low Earth Orbit and simulated human exploration of Moon, Mars, and beyond, which will increase public and student awareness about NASA and the future of human space exploration. The development of an amateur rocketry and spacecraft development incubator for education, the general public, and commercial space will stimulate the development of key STEM concepts.
Summative Evaluation of the Science on a Sphere exhibit at the Denver Museum of Nature & Science. The evaluation looks at the effectiveness of two topics; Earth Systems and Comparative Planetology using Docent lead facilitation, a scripted show, and data sets running in auto-mode (with no recorded narration).
Virtual Missions and Exoplanets (vMAX) will develop and test a three-dimensional, virtual world environment that will engage middle school students and educators from high-poverty schools in NASA-related exoplanet mission simulations. The Patricia and Phillip Frost Museum of Science will serve as the lead institution, in partnership with the following institutions: U.S. Space and Rocket Center, New York Hall of Science, Chabot Space & Science Center, and Sci-Port: Louisiana¹s Science Center; Aimee Weber Studios will be responsible for virtual exhibit fabrication, and WestEd will serve as the project¹s formative and summative evaluator. The overall goal of the project is to create a NASA resource on exoplanet astronomy that will engage students, educators, and the general public in NASA¹s search for worlds beyond our own. The project aims to increase underserved students¹ engagement in STEM, knowledge of exoplanet missions, and awareness of NASA-related careers; and advance the growing body of knowledge on the use of virtual world technologies to provide opportunities for students to participate in NASA Mission-related science teaching and learning. The project will result in the development of vMAX world, a virtual world with simulations related to exoplanet astronomy designed for use as the core content of a 30-hour out-of-school learning experience for middle school students. An Educator Implementation Guide will be developed and made available online for download by secondary school teachers and science museum educators. In addition, an interactive, multiuser exhibit kiosk, utilizing the simulations created for vMAX world, will be developed and made available to interested Visitor Centers, museums and planetariums.
The Nature Research Center is a project through which the North Carolina Museum of Natural Sciences provides NASA with a permanent presence through the creation of NASA-themed exhibits in its new wing (the Nature Research Center), hosting special events, educator workshops and special programming, all of which serve the general population and seek to improve understanding of and engagement with science. The lead institution is the North Carolina Museum of Natural Sciences. Goals, expected and actual outcomes are as follows: Exhibits in the new wing were expected to reach 200,000 individuals in its inaugural year; in only 8 months, the Museum has welcomed over 1 million visitors. Astronomy Days’ goal was to reach 20,000 people per year and is on target for meeting this goal. Educator Workshops’ goal was to reach 32 educators per workshop and is on target for meeting this goal. The Museum’s visitor base has demonstrated an insatiable desire for NASA-themed programs. Attendance at Astronomy Days remains impressive and special space events (such as the transit of Venus, or live downlinks with the International Space Station) attract larger-than-expected audiences. The Museum appreciates NASA’s support and is eager to continue providing NASA with an ongoing presence in Raleigh, NC.
The Dynamic Earth: You Have To See it To Believe It is a public exhibition and suite of programming designed to educate and excite K-8 students, teachers, and families about weather and climate science, plate tectonics, erosion, and stream formation. The Dynamic Earth program draws attention to the importance of large-scale earth processes and the human impacts on these processes, utilizing real artifacts, hands-on models, and NASA earth imagery and data. The program includes the exhibition, student workshops, family workshops, annual professional development opportunities for classroom teachers, innovative theater shows, lectures for adults by visiting scientists, and interpretive activities. The Montshire Museum of Science has partnered with Chabot Space and Science Center (CA) and the US Army Corps of Engineers Cold Regions Research and Engineering Laboratory (NH) on various components. The project has broadened our internal capacity for providing quality earth science programming by greatly expanding our program titles and allowing us to create hands-on materials for use by our educators and to loan to schools in our Partnership Initiative. Programming developed during the grant period continues to reach thousands of students and teachers each year, both on-site and as part of our rural outreach efforts.
The Iowa Children’s Museum designed and built a new aviation exhibit, Take Flight: The Science of Aviation, that delivers NASA’s Informal Education Program to the public by providing high-quality active learning experiences for children and their families outside the formal school classroom setting. This exhibit is a vehicle through which NASA and the Museum build public understanding of the key science, technology, engineering, and math disciplines that make it possible for humans to safely fly through the atmosphere.
The Museum has developed the following products/deliverables to support our project goals.
1. Created a comprehensive Take Flight! Exhibit Guide will be developed for three different types of users: Adult and Child Museum Visitors, Educators, and Museum Staff
2. Created revised curriculum for a week-long Summer Day Camp Aeronautics program and girl and boy scout programs
3. Created additional “Fun-tivities” themed around aviation for general public
Partners include University of Iowa Science Education Center, University of Iowa Delta Center for Brain Development , University of Iowa Women in Engineering, University of Iowa Engineering School, Iowa State University Extension, Grantwood Area Education Agency, 21st Century After School Program, Iowa After School Alliance, Mississippi Valley Girl Scouts, Boy Scouts of America, Iowa City and Cedar Rapids Community School Districts, and STEM Regional Networks of Iowa.