Summative Evaluation of the Science on a Sphere exhibit at the Denver Museum of Nature & Science. The evaluation looks at the effectiveness of two topics; Earth Systems and Comparative Planetology using Docent lead facilitation, a scripted show, and data sets running in auto-mode (with no recorded narration).
Goodman Research Group, Inc. (GRG), a Cambridge-based research firm specializing in the evaluation of educational programs, conducted the summative evaluation of StarTalk. The overall focus was to examine how well the joint presentation of science and humor reaches a public audience, including an audience not typically exposed to informal science learning, and how well it engages and informs them, such that they are motivated to continue learning more. Primary evaluation research questions included: 1. To what extent does exposure to StarTalk lead to increased interest in and knowledge of
Explore the Galaxy involved teens from Chicago Public Schools (CPS) in planning for an upcoming exhibition and its interpretation. The Adler Planetarium worked with teens from several CPS high schools, with a special focus on the CPS Air Force Academy High School (AFAHS). The goals were to develop institutional partnerships and capacity for a teen docent program as well as to do formative evaluation for an upcoming exhibition. All goals were met. The Adler is now in year 4 of a comprehensive partnership with the AFAHS involving students from all four grades in field trips, activities, after-school clubs and Adler internships. The AFAHS students are now participants in an active teen internship program that places students in different Adler professional departments every summer. As well the Adler employs volunteer and paid teen interpreters on school year weekends. These relationships and programs depend on the foundations laid through the work of this grant. In the realm of exhibition design, teens also interviewed visitors about prior conceptions and interest in several areas related to cosmology including how gravity works and the size and age of the universe. Their comments influenced design of, The Universe a Walk through Space and Time, which opened in summer of 2012.
In 2007, Chabot Space & Science Center, with partners LodeStar Astronomy Center and the Institute for Learning Innovation, received a National Science Foundation grant (#0610253) to develop, create, distribute, and conduct research on a full-dome planetarium show titled Tales of the Maya Skies. This physically immersive show was designed to transport viewers to ancient Maya civilizations and to push the boundaries of narrative approach in planetariums by presenting the film with a “cultural wrapper” of the Maya people and their achievements in archaeo-astronomy. The research conducted three
In this study, the instructional effectiveness of the planetarium in astronomy education was explored through a meta-analysis of 19 studies. This analysis resulted in a heterogeneous distribution of 24 effect sizes with a mean of +0.28, p<.05. The variability in this distribution was not fully explained under a fixed effect model. As a result, a random effects model was applied. However, a large random effect variance component indicated that study differences were indeed systematic. The findings of this meta-analysis showed that the planetarium has been an effective astronomical teaching tool
The Zooniverse projects turn everyday people into "citizen scientists" who work online with real data to assist scientists in conducting research on a variety of topics related to galaxies, exoplanets, lunar craters, and solar flares, among others. This paper describes our initial study to assess the conceptual knowledge and reasoning abilities of citizen scientists participating in two Zooniverse projects: Galaxy Zoo and Moon Zoo. In order to measure their knowledge and abilities, we developed two new assessment instruments, the Zooniverse Astronomical Concept Survey (ZACS) and the Lunar
DATE:
TEAM MEMBERS:
Edward PratherSebastien CormierColin WallaceChris LintottJordan RaddickArfon Smith
Citizen science, in which volunteers work with professional scientists to conduct research, is expanding due to large online datasets. To plan projects, it is important to understand volunteers' motivations for participating. This paper analyzes results from an online survey of nearly 11 000 volunteers in Galaxy Zoo, an astronomy citizen science project. Results show that volunteers' primary motivation is a desire to contribute to scientific research. We encourage other citizen science projects to study the motivations of their volunteers, to see whether and how these results may be
DATE:
TEAM MEMBERS:
M. Jordan RaddickGeorgia BraceyPamela GayChris LintottCarie CardamonePhil MurrayKevin SchawinskiAlexander SzalayJan Vandenberg
In 2011, the Space Science Institute (SSI) engaged Insight Evaluation Services (IES) to conduct a summative evaluation of an online, multi-user space science game called MyStar. The game, which was developed with funding from the National Aeronautics and Space Administration (NASA), was designed to introduce late middle school-early high school students to the basic concepts of stellar and planetary evolution. IES assessed the effectiveness of MyStar in meeting specific learning goals, including in particular (1) The galaxy has “habitable zones” where planetary formation and/or life is more
Brigham Young University and the University of Maryland, in partnership with the Smithsonian Institution, the Computer History Museum, and NASA, plus leading game designers, educators, scientists, and researchers, will conduct research on the design and development of two large-scale Alternate Reality Games (ARGs) based on deep-time science in astrobiology, astrophysics, and interplanetary space travel. The project will iteratively design and test two distinct types of ARGs (closed- and open-ended) to study the effects of these ARGs on STEM learning. The ARGs will be based upon the Next Generation Science Standards (NGSS), affording learners with intensive, self-driven, and scaffolded scientific learning and will be aimed at attracting girls and other groups historically underrepresented in science and technology. Each ARG will be designed by NASA scientists, educators and education researchers, and game-based learning experts and will be highly interactive: engaging learners in collaborative investigations in real and virtual worlds to collect scientific data, conduct data analysis, and contribute scientific evidence that will help solve scientific questions within a science-based narrative derived from real world problems that will develop learners' computational thinking skills in a collaborative, participatory virtual learning environment. Combining data from web and social media analytics, player interviews, surveys, and user-generated content, researchers, and evaluation experts at UXR who will provide an outcomes-based evaluation, including front-end, formative, remedial, and summative evaluations, will establish the properties of ARGs that most effectively advance informal STEM learning outcomes. By comparing open-ended and closed-ended ARGs, the PIs will be able to assess the relative strengths and weaknesses of two distinct approaches to Alternate Reality Game design. The project team will test the hypothesis that open-ended, user-generated content will support inquiry-based learning, peer-to-peer learning, and life-wide and life-deep learning, while close-ended, narrative-rich ARGs will support specific transfer of STEM knowledge, collaboration, and problem solving. To help ensure that the games appeal to their target audiences, the project team will adopt co-design methods, enlisting the creative input of participating teens at each stage of the design process. Supplementary materials and lesson plans developed in close consultation with teachers, librarians, teens, and external stakeholders will enable the ARGs to be widely and effectively used as a model in museums, classrooms, libraries, and after-school programs. The proposed ARGs represent a unique environment to test learning principles that enable players to bridge their learning through transmedia across multiple contexts and test the effects of collaboration with massive numbers of concurrent players. As a result, the project should yield insights on how learning principles can be adopted and re-appropriated for emerging learning environments, including those that that might be crowd-sourced. The research is well grounded in the literature and the PIs do an excellent job of mapping ARG design principles to the pertinent learning science research, providing a clear sense of the particular affordances of the genre that should lead to new understandings. The approach has profound implications for the way we might teach the next generation of students. The ability to mix problem solving and learning in virtual spaces with experiences and data derived from the physical world could dramatically change how we understand the role of technology in education.
SciGirls and Citizen Science: Real Data, Real Kids, Real Discoveries SciGirls is showcasing Citizen Science! From their own backyards to a NASA research center, the bright, relatable, real girls featured on the groundbreaking PBS series are seriously into science, technology, engineering and math, or STEM. And Season Three of SciGirls finds these STEM adventurers tracking toads, counting clouds and much more, all in the name of citizen science. The brand-new season of the Emmy-winning show, featuring six stand-out episodes, debuted April 2015 on PBS KIDS (check local listings) and online at http://pbskids.org/scigirls. Citizen science is the newest STEM frontier that engages the general public –and kids – in real science. Scientists worldwide invite ordinary people—like the SciGirls—to observe and record data about everything from birds to beaches, monarch butterflies to maple trees. The data is then shared with scientists, who use it to generate new scientific knowledge. In six exciting new episodes, middle school girls and their female STEM professional mentors hit the great outdoors, cataloging frog calls, tracking the changing seasons, verifying satellite imagery of clouds, monitoring fragile butterfly populations, improving urban bird habitats, and advocating for healthy oceans. In addition, animated characters Izzie and Jake are back and finding themselves in sticky situations that can only be solved by STEM—and the SciGirls. When the SciGirls share their data with professional scientists, they save the day for Izzie and Jake and help save the environment! The new mobile-friendly website at http://pbskids.org/scigirls lets kids play new games, watch episodes and videos, and connect with fellow STEM explorers anywhere, anytime. “Collaboration is the key to successful citizen science,” said SciGirls executive producer Richard Hudson. “Since SciGirls’ beginning, working together—making discoveries, mistakes and friends—is one of the important research-based methods we use to engage girls around STEM. This new season underscores the importance of collaboration within the scientific research community and workforce. SciGirls is fortunate to have powerful partners advising us about citizen science, including the Cornell Lab of Ornithology, NASA and SciStarter.” The SciGirls creative team is headed by Twin Cities Public Television’s Director of Science Content Richard Hudson, Executive Producer of the long-running PBS children’s science series Newton's Apple and creator of DragonflyTV and the SciGirls initiative. Animation is created by Soup2Nuts, producers of PBS’ WordGirl. Strategic partners for the new series are the Cornell Lab of Ornithology, Rick Bonney co-PI, and the National Girls Collaborative Project, co-PI Karen Peterson. SciGirls is made possible by a major grant from the National Science Foundation. Additional funding is provided by INFOR, Northrop Grumman Foundation, and PPG Industries Foundation.
The conference, Indigenous Worldviews in Informal Science Education, is designed to advance research on the integration of Native and Western science in relation to informal science learning. The goals of the conference are to integrate and synthesize research and theory, formulate a research agenda, and share the results with the STEM education community. The conference is organized around six strands: Collaboration, Policy, Holistic Education, Next Generation Youth, and Evaluation. A six-week preconference online discussion of conference issues leads into the two-day conference, held at Imiloa Astronomy Center in Hilo, Hawaii. The meeting brings together sixty participants including educators, research scientists, learning researchers, policymakers, and Native youth. The conference includes keynotes, workshops and synthesis discussion groups, which will be synthesized and presented at a policy outcome meeting held in Washington, DC that follows the conference. Conference results will be further disseminated at relevant conferences, in publications, and through online discussions. A full evaluation process will inform the detailed planning of the conference and will evaluate the effectiveness of the conference, based on responses from conference participants.
This report addresses findings from the Bilingual Exhibit Research Initiative (BERI), a National Science Foundation-‐funded project (NSF DRL#1265662) through the Advancing Informal STEM Learning (AISL) program. This Pathways (planning grant) project was a 3-‐year project designed to better understand current practices in bilingual exhibitions and Spanish-‐speaking visitors’ uses and perceptions of bilingual exhibitions. Responding to a lack of extensive evaluation or audience research in informal science education (ISE) bilingual interpretation, the Bilingual Exhibit Research Initiative