This project includes the development of a toolkit of new hands-on facilitated museum activities, and a mobile app with both app-based activities and do-it-yourself (DIY) activities. This evaluation report focuses on the formative evaluation of three app activities that are being added to the DIY app series.
With funding from the National Science Foundation, Secrets of the Universe (SOTU) is a multimedia project that has at its core a 40-minute 3D giant screen film directed by a collaboration of K2 Communications Inc., The Stephen Low Company, and University of California Davis Department of Physics. To support and extend the impact of the film for these audiences, the project features an educational website with a variety of resources, including online videos of science content and characters from the film.
The independent evaluation team from Knight Williams Inc. conducted a summative
The SciGirls in Space Front End Evaluation included surveys with project advisors, girls and families about the nature and extent of partner program offerings to help inform production of media and use of media in outreach. Question 1: To what extent do advisors, girls and their family members find the girls and professionals featured in the (existing) episodes and role model videos to be effective role models? Question 2: To what extent do they find episode topics and stories relevant to their everyday lives?
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
Informal learning opportunities are increasingly being recognized as important for youth participation in authentic experiences at the intersection of science, technology, engineering, and math (STEM) (Dorsen, Carlson, and Goodyear 2006). These experiences may involve specialized equipment and dedicated time for learners to gain familiarity with the relevant scientific and engineering practices (i.e., designing experiments on their own, struggling to make sense of data, learning from their own mistakes and the results of peers), which often go beyond the classroom. However, the educators who
DATE:
TEAM MEMBERS:
Kathryn WilliamsonSue Ann HeatherlyVivian HoetteEva Erdosne TothDavid Beer
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. The third season of the national PBS series, SciGirls, is the first national children’s television series and website designed to engage and educate millions of children about citizen science. In each half-hour episode, a female mentor guides a group of ethnically diverse middle school girls as they learn about citizen science protocols and collect and share data for an established citizen science project. In addition to the videos, the SciGirls website presents
Moving Beyond Earth Programming: “STEM in 30” Webcasts. The Smithsonian’s National Air and Space Museum (NASM) will develop nine “STEM in 30” webcasts which will be made available to teachers and students in grades 5-8 classrooms across the country. The primary goal of this program is to increase interest and engagement in STEM for students. Formative and summative evaluations will assess the outcomes for the program, which include the following:
Increased interest in STEM and STEM careers, Increased understanding of science, technology, engineering and mathematics (STEM), Increased awareness and importance of current and future human space exploration, and Increased learning in the content areas.
This series of live 30-minute webcasts from the National Air and Space Museum and partner sites focus on STEM subjects that integrate all four areas. The webcasts will feature NASA and NASM curators, scientists, and educators exploring STEM subjects using museum and NASA collections, galleries, and activities. During the 30-minute broadcasts, students will engage with museum experts through experiments and activities, ask the experts questions, and answer interactive poll questions. After the live broadcasts, NASM will also archive the webcasts in an interactive “STEM in 30” Gallery.
Great Lakes Science Center (GLSC), home of the NASA Glenn Visitor Center, is dedicated to sharing NASA content to inform, engage, and inspire students, educators, and the public. To further this goal, GLSC will develop a digital experience focused on collaboration and teamwork, emphasizing the benefits of a systems approach to STEM challenges. At the recently, fully renovated NASA Glenn Visitor Center, GLSC visitors will embark on an exciting mission of discovery, working in teams to collect real data from NASA objects and experiences. Mobile devices will become scientific tools as students, teachers, and families take measurements, access interviews with NASA scientists, analyze results from Glenn Research Center (GRC) test facilities, and link to NASA resources to assemble mission-critical information. This initiative will provide experiences that demonstrate how knowledge and practice can be intertwined, a concept at the core of the Next Generation Science Standards. GLSC’s digital missions will engage students and families in STEM topics through the excitement of space exploration. In addition, this project has the potential to inform the design of future networked visitor experiences in science centers, museums and other visitor attractions.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.