Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
The Luce Foundation Center (LFC) of the Smithsonian American Art Museum (hereafter, American Art or the Museum) ran an alternate reality game (ARG) titled PHEON (http://pheon.org/, http://apps.facebook.com/playpheon/register/) from September 2010 through August 2011. The game built upon the success of the Museum's previous ARG, Ghosts of a Chance (GOAC; http://ghostsofachance.com/; Goodlander, 2009), and was intended to increase familiarity with the Museum's collections, programs, and resources; highlight connections between the Museum and its collections with peoples' lives; and attract new
DATE:
TEAM MEMBERS:
Jes KoepflerSmithsonian American Art Museum
The Luce Foundation Center (LFC) of the Smithsonian American Art Museum (hearafter, American Art or the Museum) ran an alternate reality game (ARG) titled PHEON as an online game application on Facebook from October 2010 through September 2011. The game built upon the success of the Museum's previous ARG, Ghosts of a Chance (GOAC; Goodlander, 2009). In the Facebook game, players accepted missions inspired by the Museum's collections, completed them in the real world, and uploaded evidence in order to win points and progress through the game. Despite an established audience of GOAC players
DATE:
TEAM MEMBERS:
Jes A. KoepflerSmithsonian American Art Museum
The Cryptoclub: Cryptography and Mathematics Afterschool and Online is a five-year project designed to introduce middle school students across the country to cryptography and mathematics. Project partners include the Young Peoples Project (YPP), the Museum of Science and Industry in Chicago, and Eduweb, an award-winning educational software design and development firm. The intended impacts on youth are to improve knowledge and interest in cryptography, increase skills in mathematics, and improve attitudes towards mathematics. The secondary audience is leaders in afterschool programs who will gain an increased awareness of cryptography as a tool for teaching mathematics and adopt the program for use in their afterschool programs. Project deliverables include online activities, online cryptography adventure games, interactive offline games, a leader\'s manual, and training workshops for afterschool leaders. The project materials will be developed in collaboration with YPP staff and pilot tested in Year 3 at local afterschool programs and YPP sites in Chicago in addition to four national sites. Field testing and dissemination occurs in Year 4 at both local sites in Chicago and national locations such as afterschool programs, science centers, and community programs. Six 3-day training workshops will be provided (2 per year in Years 3-5) to train afterschool leaders. It is anticipated that this project will reach up to 11,000 youth, including underserved youth in urban settings, and 275 professional staff. Strategic impact resulting from this project includes increased awareness of cryptography as a STEM topic with connections to mathematics as well a greater understanding of effective strategies for integrating and supporting web-based and offline activities within informal learning settings. The Cryptoclub project has the potential to have a transformative impact on youth and their understanding of cryptography and may serve as a national model for partnerships between afterschool and mentoring programs.
DATE:
-
TEAM MEMBERS:
Janet BeissingerSusan GoldmanDaria TsoupikovaBonnine Saunders
The New York Hall of Science, in collaboration with the Tufts Center for Engineering Education, the Learning Games Network, and New York City departments of education and of parks and recreation, is creating and testing two innovative science games to support student learning about frictional force and linear motion. SciGames integrates rigorous, highly motivating, data collection activities conducted in museum and playground settings, with in-depth data analysis and additional scientific investigation in the classroom. The primary goals of the SciGames project are to increase student motivation and interest in science and improve student learning about core physical science concepts. This exploratory project targets underrepresented urban students and their teachers from 20 schools in New York City (NYC) and through its partnership with NYC department of parks and recreation has great potential for scale-up throughout NYC, as well as dissemination to other urban communities. The SciGames model creates experiences for students that build on the positive, fun, free-choice learning characteristics of informal settings; promotes learning through repeated game-like experimentation and play; and supports students' sustained interest and learning in science classrooms where core concepts are formalized. The project is based on four design principles: (1) SciGames turns students' informal experiences into a game, (2) SciGames makes science content an integral part of game play, (3) SciGames generates data for further analysis during game play, and (4) SciGames, through the use of digital apps, supports students inquiring into data back in their classrooms. Researchers are developing the games using rigorous, well constructed, iterative cycles of design, development, testing, evaluation, and revision with different groups of NYC students and teachers. Pre and post data on students\' science learning and affect are being used to inform the design cycles. Over a two-year period, SciGames will produce two science games and associated digital apps, and a portable kit that supports game implementation, data collection and analysis. SciGames is an important experiment, combining the informal, engaging aspects of play with more formal science investigation to encourage and sustain the interest, participation, and learning of underrepresented students in STEM. This project has the potential to transform how we think of and structure science learning for middle school students.
This project will create and study Kids' Survey Network as an exemplar of a new, replicable model of informal learning called an apprenticeship network. The project will develop the data literacy of future learners, workers, and citizens by empowering participants aged 11-14 to develop survey projects to address their own questions about local community issues. Research on the project will illuminate core questions relating to the design and potential impact of the apprenticeship network, including social and motivational dynamics, community and technology-based scaffolding, educational game genres, and conditions of effective use. The project deliverables include four components: (1) a web-based community of practice; (2) a common set of tools; (3) a suite of learning games and tutorials; and (4) structures for tiered, team-based advancement. Tertl Studios LLC and MIT's Education Arcade will develop the learning games, SRI International will conduct the evaluation, leading regional and national informal education organizations will provide test bed sites, and professional survey research organizations will provide technical and volunteer assistance.
DATE:
-
TEAM MEMBERS:
Elizabeth RoweDiana NunnaleyChristopher Hancock
This planning effort, a collaboration of teams at the University of Maryland, Cornell University, Carnegie Mellon University and the Sciencenter of Ithaca, deals with the development and testing of a unique methodology for educating youth in computer programming. Through a mobile robot that is cleverly disguised as a small animal, participants will learn to manipulate the system by physically moving it as well as setting variables via electronic buttons thereby learning programming and design. The eventual use of this system and methodology is in museum exhibits so preliminary survey data will be gathered from various venues that presently use less capable devices. Iterative testing will be done at the Sciencenter in its exhibits.
Video games have been heralded as models of technology-enhanced learning environments as they exemplify many of the ideas emerging from contemporary learning sciences research. In particular, such games promote learning through goal-directed action in simulated environments, through producing as well as consuming information, embedded assessments, and through participation in self-organizing learning systems. Research suggests that participation in such environments involves many forms of scientific thinking and may lead to increased civic engagement, although to date, there are few examples of game-based learning environments that capitalize on these affordances. This project will investigate the potential of online role playing games for scientific literacy through the iterative design and research of Saving Lake Wingra, an online role playing game around a controversial development project in an urban area. Saving Lake Wingra positions players as ecologists, department of natural resources officials, or journalists investigating a rash of health problems at a local lake, and then creating and debating solutions. Players will solve challenges within an interactive, simulated lake ecosystem as they attempt to save the lake, working for one of several constituencies. This design-based research project will span the full life cycle of a project, from case studies of learning in small, constrained settings to controlled experimental studies of games implemented across classrooms. In addition to asking if participation in scientific role-playing games can produce robust conceptual understandings, it will also examine if role playing games might serve as assessment tools for comprehending scientific texts, assessing conceptual understandings within scientific domains, and designing innovative solutions to environmental problems that draw upon scientific understandings. The education plan includes the production of game-based media that can be used to support a variety of research studies, an online professional development community of educators using games for learning, support for graduate students trained in game theory, the learning sciences, and new forms of assessment, and new courses in game-based learning and assessment.
Life on Earth aims to advance (1) public understanding of the history of life on Earth and biodiversity, and (2) our knowledge of how people interact and learn from large interactive science data visualizations on multi-touch displays in public settings. Our multi-institutional project team has developed the DeepTree, the FloTree, and Build-A-Tree (BAT). The focal exhibit, called the DeepTree, utilizing large data sets from four online databases including Tree of Life web project (www.tolweb.org), Encyclopedia of Life (www.eol.org), National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/) and Time Tree (www.timetree.org), allow museum visitors to explore the relationships of 70,000 species, spanning over 3.5 billion years of evolutionary history using touch gestures on a large multi-touch computer display. Embedded inside the DeepTree, the "FloTree" encourages exploration of evolutionary processes within a single population. "Build-a-Tree" (BAT) is a multi-level phylogenetic tree-building game. These learning experiences are designed to target core evolutionary concepts and be self-directed, physically interactive, embodied, and collaborative. The Life on Earth exhibit has been installed at California Academy of Sciences in San Francisco, the Field Museum in Chicago, University of Nebraska State Museum in Lincoln Nebraska, and Harvard Museum of Natural in Cambridge Massachusetts. Please visit the Life on Earth website at https://lifeonearth.seas.harvard.edu/ to find more details on publications, and the ongoing learning research and summative evaluation. The Life on Earth project brings together a team of interdisciplinary researchers in human-computer interaction and information visualization, learning sciences, museum exhibit design, cognitive and developmental psychology, and evolutionary biology.
This full-scale development project would use a multi-platform approach (TV, Field School, and Web site) to engage public audiences and underserved youth in archaeology research and discovery. The project will advance knowledge and practice in the field of ISE by establishing the utility of archaeology as an entry point to multiple STEM fields showing how it answers important questions about human origins-culture, history, and the natural environment. The target audience includes a broad demographic of viewers who will watch the PBS broadcasts. The other key audience is underserved youth who will participate in the archeology digs and be featured in the national broadcast. They will engage other underserved youth who will have the opportunity to participate in the interactive online virtual field school. Primary organizational partners include the Crow Canyon Archaeology Center in Colorado and other archeology organizations at the 4 field sites. Deliverables include four hours of PBS programming filmed at four archaeological sites telling the stories of diverse cultures (Native American, African American, Hispanic); field schools designed for underrepresented youth both onsite and online; blogs, online discussions, and user-generated videos. The evaluation will determine the impact of the television series, online content, and the on-site Field School on audiences' understanding of, interest in, and interactions around STEM topics within the context of archaeology. Formative evaluation will provide input and help refine the television programs, web site, and field school. The summative evaluation will use a variety of methods and artifacts to determine the degree to which the process of the TV series, web site, and Field School was successful. The television programs are expected to reach 13 million viewers via broadcast, 300,000 via streaming video and 50,000 unique web site visitors. The lessons learned from this project will be disseminated to other media and ISE organizations.
This project will develop a prototype intelligent cyberlearning platform for middle school audiences at a museum location to test and evaluate the use of virtual learning technologies. The content for this test is focused on sustainability issues that enable students to develop an age-appropriate understanding of the relationships between specific conservation decisions, energy use, human health, and population growth within Earth's ecosystem. The prototype cyberlearning system will demonstrate how users can learn about science topics by interacting with a display of environmental factors that enable them to explore the impact of social, economic, and technological forces that may change one existing state and condition to another. The system will enable users to understand the interrelationships of those elements by enabling them to change conditions and then observing the effect of the changes they make on the conditions presented in the initial model. The prototype intelligent cyberlearning system will provide a unique integration of a sophisticated agent-based modeling simulation of environmental, social, and economic phenomena with three advanced learning technologies: game-based learning systems, intelligent tutoring systems, and narrative-centered learning systems. The game-based and narrative aspects of the project are embodied in the interactive time-travel focus of the 3D display on a multi-touch surface computing table in which users will play the role of environmental scientists who have been charged with helping earth become a thriving green planet. They will go back in time and be given the opportunity to make different decisions on any range of options. After they make their decisions, they will travel forward in time to see the results of their decisions. All of the interactions will be used to dynamically generate their time-travel adventures. The intelligent tutoring system will track user\'s problem-solving activities in the simulated world. As users make decisions, the intelligent tutoring system will draw inferences about their level of understanding of key environmental concepts. Given the current problem-solving goal (e.g., reduce green house gases) and the current state of the environment (e.g., climatological state, earth's population, factory emissions), the intelligent tutoring system will draw on its knowledge of common environmental misconceptions to assist students as they progress through the sustainability narratives. The intelligent tutoring system will receive the updated state from the agent-based simulation, which will then provide explanatory commentary and advice through the virtual human to the users about the causal connections underlying the results of the decisions they have made. Similarly, during the course of decision-making, users will be able to request advice, and the same computational framework will drive the virtual human\'s advice generation functionalities. The project will design, development, deploy, and evaluate a prototype intelligent cyberlearning platform for sustainability that supports independent, but guided, exploration of science topics. Because all users interactions will be accompanied by a virtual environmental scientist who will narrate their journeys and offer problem-solving advice, users will be afforded rich learning opportunities that support independent inquiry but also provided guided exploration of complex science topics. With a focus on group learning experiences in the out-of-school setting, the virtual environmental scientist will answer questions that will engage groups of users in a collaborative effort to understand the rich interrelationships of sustainability. The project will demonstrate the transformative potential of intelligent cyberlearning systems that integrate agent-based modeling with game-based learning, intelligent tutoring systems, and narrative-centered learning in an out-of-school setting to enable users to experience science in fundamentally new ways.
DATE:
-
TEAM MEMBERS:
James LesterBradford MottJames MinoguePatrick Fitzgerald
In this full-scale research and development project, Oregon State University (OSU), Oregon Sea Grant (OSG) and the Hatfield Marine Science Center Visitors Center (HMSCVC) is designing, developing, implementing, researching and evaluating a cyberlaboratory in a museum setting. The cyberlaboratory will provide three earth and marine science learning experiences with research and evaluation interwoven with visitor experiences. The research platform will focus on: 1) a climate change exhibit that will enable research on identity, values and opinion; 2) a wave tank exhibit that will enable research on group dynamics and problem solving in interactive engineering challenges; and 3) remote sensing exhibits that will enable research on visitor interactions through the use of real data and simulations. This project will provide the informal science educaton community with a suite of tools to evaluate learning experiences with emerging technologies using an iterative process. The team will also make available to the informal science community their answers to the following research questions: For the climate change exhibit, "To what extent does customizing content delivery based on real-time visitor input promote learning?" For the wave tank exhibit, "To what extent do opportunities to reflect on and share experiences promote STEM reasoning processes at a build-and-test exhibit?" For the data-sensing exhibit, "Can visitors' abilities to explain or use visualizations be improved by shaping their visual searches of images?" Mixed-methods using interviews, surveys, behavioral instruments, and participant observations will be used to evaluate the overall program. Approximately 60-100 informal science education professionals will discuss and test the viability of the exhibit's evaluation tools. More than 150,000 visitors, along with community members and local middle and high school students, will have the opportunity to participate in the learning experiences at the HMSCVC. This work contributes to the fields of cyberlearning and informal science education. This project provides the informal science education field with important knowledge about learning, customized content delivery and evaluation tools that are used in informal science settings.