In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Education Development Center (EDC) conducted the external evaluation of this second phase of NASA@ My Library. Library staff from partner libraries increased their confidence and ability to facilitate library programming related to Earth, space, and engineering.
The SciGirls in Space: Exploring the Moon, Mars and NASA Careers Implementation Evaluation Report focuses on the STEM outreach component of the project for 15 girl-serving organizations who used research-based gender equitable and culturally responsive instructional strategies,NASA-aligned media and STEM activities with a focus on integrating of NASA women role models.
For a second year, Kera Collective measured the effectiveness of a summer camp designed by the Smithsonian’s National Air and Space Museum to empower underrepresented youth to succeed in STEAM.
Overview
In the winter, spring, and summer of 2022, Kera Collective again worked with the Smithsonian’s National Air and Space Museum to evaluate the Soaring High Explorers (S.H.E.) Can STEAM Camp, which serves traditionally underserved youth in the District of Columbia, Maryland, and Virginia. We explored the effectiveness of the camp activities and facilitation strategies to boost participants’
With funding from the National Science Foundation, Secrets of the Universe (SOTU) is a multimedia project that has at its core a 40-minute 3D giant screen film directed by a collaboration of K2 Communications Inc., The Stephen Low Company, and University of California Davis Department of Physics. To support and extend the impact of the film for these audiences, the project features an educational website with a variety of resources, including online videos of science content and characters from the film.
The independent evaluation team from Knight Williams Inc. conducted a summative
The SciGirls in Space Front End Evaluation included surveys with project advisors, girls and families about the nature and extent of partner program offerings to help inform production of media and use of media in outreach. Question 1: To what extent do advisors, girls and their family members find the girls and professionals featured in the (existing) episodes and role model videos to be effective role models? Question 2: To what extent do they find episode topics and stories relevant to their everyday lives?
Summary
Girlstart’s mission is to increase girls’ interest and engagement in STEM through innovative, nationally-recognized informal STEM education programs. Girlstart examines in this report how STEM education directed toward elementary school girls influences long-term readiness and participation to math and science learning. This report compares Girlstart After School participants’ academic performance to nonparticipant performance. Specifically, it examines how Girlstart After School influences science STAAR performance and course enrollment in subsequent elementary and early middle
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. The third season of the national PBS series, SciGirls, is the first national children’s television series and website designed to engage and educate millions of children about citizen science. In each half-hour episode, a female mentor guides a group of ethnically diverse middle school girls as they learn about citizen science protocols and collect and share data for an established citizen science project. In addition to the videos, the SciGirls website presents
Brigham Young University and the University of Maryland, in partnership with the Smithsonian Institution, the Computer History Museum, and NASA, plus leading game designers, educators, scientists, and researchers, will conduct research on the design and development of two large-scale Alternate Reality Games (ARGs) based on deep-time science in astrobiology, astrophysics, and interplanetary space travel. The project will iteratively design and test two distinct types of ARGs (closed- and open-ended) to study the effects of these ARGs on STEM learning. The ARGs will be based upon the Next Generation Science Standards (NGSS), affording learners with intensive, self-driven, and scaffolded scientific learning and will be aimed at attracting girls and other groups historically underrepresented in science and technology. Each ARG will be designed by NASA scientists, educators and education researchers, and game-based learning experts and will be highly interactive: engaging learners in collaborative investigations in real and virtual worlds to collect scientific data, conduct data analysis, and contribute scientific evidence that will help solve scientific questions within a science-based narrative derived from real world problems that will develop learners' computational thinking skills in a collaborative, participatory virtual learning environment. Combining data from web and social media analytics, player interviews, surveys, and user-generated content, researchers, and evaluation experts at UXR who will provide an outcomes-based evaluation, including front-end, formative, remedial, and summative evaluations, will establish the properties of ARGs that most effectively advance informal STEM learning outcomes. By comparing open-ended and closed-ended ARGs, the PIs will be able to assess the relative strengths and weaknesses of two distinct approaches to Alternate Reality Game design. The project team will test the hypothesis that open-ended, user-generated content will support inquiry-based learning, peer-to-peer learning, and life-wide and life-deep learning, while close-ended, narrative-rich ARGs will support specific transfer of STEM knowledge, collaboration, and problem solving. To help ensure that the games appeal to their target audiences, the project team will adopt co-design methods, enlisting the creative input of participating teens at each stage of the design process. Supplementary materials and lesson plans developed in close consultation with teachers, librarians, teens, and external stakeholders will enable the ARGs to be widely and effectively used as a model in museums, classrooms, libraries, and after-school programs. The proposed ARGs represent a unique environment to test learning principles that enable players to bridge their learning through transmedia across multiple contexts and test the effects of collaboration with massive numbers of concurrent players. As a result, the project should yield insights on how learning principles can be adopted and re-appropriated for emerging learning environments, including those that that might be crowd-sourced. The research is well grounded in the literature and the PIs do an excellent job of mapping ARG design principles to the pertinent learning science research, providing a clear sense of the particular affordances of the genre that should lead to new understandings. The approach has profound implications for the way we might teach the next generation of students. The ability to mix problem solving and learning in virtual spaces with experiences and data derived from the physical world could dramatically change how we understand the role of technology in education.
SciGirls and Citizen Science: Real Data, Real Kids, Real Discoveries SciGirls is showcasing Citizen Science! From their own backyards to a NASA research center, the bright, relatable, real girls featured on the groundbreaking PBS series are seriously into science, technology, engineering and math, or STEM. And Season Three of SciGirls finds these STEM adventurers tracking toads, counting clouds and much more, all in the name of citizen science. The brand-new season of the Emmy-winning show, featuring six stand-out episodes, debuted April 2015 on PBS KIDS (check local listings) and online at http://pbskids.org/scigirls. Citizen science is the newest STEM frontier that engages the general public –and kids – in real science. Scientists worldwide invite ordinary people—like the SciGirls—to observe and record data about everything from birds to beaches, monarch butterflies to maple trees. The data is then shared with scientists, who use it to generate new scientific knowledge. In six exciting new episodes, middle school girls and their female STEM professional mentors hit the great outdoors, cataloging frog calls, tracking the changing seasons, verifying satellite imagery of clouds, monitoring fragile butterfly populations, improving urban bird habitats, and advocating for healthy oceans. In addition, animated characters Izzie and Jake are back and finding themselves in sticky situations that can only be solved by STEM—and the SciGirls. When the SciGirls share their data with professional scientists, they save the day for Izzie and Jake and help save the environment! The new mobile-friendly website at http://pbskids.org/scigirls lets kids play new games, watch episodes and videos, and connect with fellow STEM explorers anywhere, anytime. “Collaboration is the key to successful citizen science,” said SciGirls executive producer Richard Hudson. “Since SciGirls’ beginning, working together—making discoveries, mistakes and friends—is one of the important research-based methods we use to engage girls around STEM. This new season underscores the importance of collaboration within the scientific research community and workforce. SciGirls is fortunate to have powerful partners advising us about citizen science, including the Cornell Lab of Ornithology, NASA and SciStarter.” The SciGirls creative team is headed by Twin Cities Public Television’s Director of Science Content Richard Hudson, Executive Producer of the long-running PBS children’s science series Newton's Apple and creator of DragonflyTV and the SciGirls initiative. Animation is created by Soup2Nuts, producers of PBS’ WordGirl. Strategic partners for the new series are the Cornell Lab of Ornithology, Rick Bonney co-PI, and the National Girls Collaborative Project, co-PI Karen Peterson. SciGirls is made possible by a major grant from the National Science Foundation. Additional funding is provided by INFOR, Northrop Grumman Foundation, and PPG Industries Foundation.
This report presents an evaluation study of Soundprint Media's project, Out of This World (#0741737), which was funded by the National Science Foundation's Informal Science Education Program. The mission of the project was to introduce adult radio listeners and youth participants in museum events to the historical context and challenges faced by African-Americans and women who were involved as professionals in the United States' space program in the 1960's. The project website, capecosmos.com, included an interactive menu of activities set within the context of a NASA mission control center
This project will be conducted by a team of investigators from North Carolina State University. The principal investigator proposes to examine the characteristics, motivations, in and out-of-school experiences, informal science activities, and career trajectories of 1000 science hobbyists and "master hobbyists." Master hobbyists are individuals who have developed science expertise and spend considerable free time engaging in science as a leisure activity. Master science hobbyists are found across most areas of science (e.g. birdwatchers, amateur astronomers). This research will determine who these individuals are, their career pathways, how they engage in science activities and what motivates, sustains, and defines their science interests. One of the particular goals of this research is to develop new understandings of how science hobby interests develop for women and underserved minorities. In the proposed research investigators will use the results of interviews and surveys to identify contextual factors that influence the motivational processes that, in turn, influenced choices of careers and contribute to ongoing choices in hobby and citizen science activities. Of interest in this study is how citizen scientists who are also serious hobbyists differ from master science hobbyists. Research on citizen scientists has shown that this group is highly motivated by collective motives (such as a desire to help others and further science), whereas this may not be the case with the master science hobbyist. Two groups will be sampled: a) birdwatchers and b) amateur astronomers. This sampling model will allow investigators to contrast their findings by: 1) those who have selected a science career versus those that did not select a science career, 2) those who participate in citizen science activities and those that do not, and 3) those who are birdwatchers (greater mathematical components) and those who are amateur astronomers (lesser mathematical components). Additional coding and analyses will examine any differences in the evolution of bird watching and astronomy hobbies. The results of this research will be examined in light of existing motivational and sociocultural models of career selection. This research will document differences in the perceived motivational elements that influenced master science hobbyists/citizen scientists to choose a science career or not. The results can inform federal, state, and local policies for supporting youth and adults engaged in free choice learning. Results of this research will inform the design of intervention/recruitment programs and ISE outreach initiatives. Potential audiences include ISE institutions (e.g. museums and science centers), organizations with links to STEM (e.g. scouts, boys/girls clubs) and pre- and college initiatives that seek to influence career choices and life-long science interests. The proposed cross-disciplinary approach will promote new understandings of complex issues related to motivation, retention, career selection, leisure activities, engagement with formal and informal educational environments, gender and ethnicity, communities of practice and changes in interests over time. Members of the advisory board have expertise in assessment and measurement and will work closely with the project team to conduct a detailed examination of methodologies and analyses at all phases of the project.