Sense-making with data through the process of visualization—recognizing and constructing meaning with these data—has been of interest to learning researchers for many years. Results of a variety of data visualization projects in museums and science centers suggest that visitors have a rudimentary understanding of and ability to interpret the data that appear in even simple data visualizations. This project supports the need for data visualization experiences to be appealing, accommodate short and long-term exploration, and address a range of visitors’ prior knowledge. Front-end evaluation
AHA! Island is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. This research is intended to examine the extent to which the prototyped media and activity sets support the project’s learning goals. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative study with 16 English-speaking families (children and their caregivers) to test out these media and activity set prototypes. During the in-person video
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
This project will capitalize on the power of story to teach foundational computational thinking (CT) concepts through the creation of animated and live-action videos, paired with joint media engagement activities, for preschool children and their parents. Exposure at a young age to CT is critical for preparing all students to engage with the technologies that have become central to nearly every occupation. But despite this recognized need, there are few, if any, resources that (1) introduce CT to young children; (2) define the scope of what should be taught; and (3) provide evidence-based research on effective strategies for bringing CT to a preschool audience. To meet these needs, WGBH and Education Development Center/Center for Children and Technology (EDC/CCT) will utilize an iterative research and design process to create animated and live-action videos paired with joint media engagement activities for parents and preschool children, titled "Monkeying Around". Animated videos will model for children how to direct their curiosity into a focused exploration of the problem-solving process. Live-action videos will feature real kids and their parents and will further illustrate how helpful CT can be for problem solving. With their distinctive visual humor and captivating storytelling, the videos will be designed to entice parents to watch alongside their children. This is important since parents will play an important role in guiding them in explorations that support their CT learning. To further promote joint media engagement, hands-on activities will accompany the videos. Following the creation of these resources, an experimental impact study will be conducted to capture evidence as to if and how these resources encourage the development of young children's computational thinking, and to assess parents' comfort and interest in the subject. Concurrent with this design-based research process, the project will build on the infrastructure of state systems of early education and care (which have been awarded Race to the Top grants) and local public television stations to design and develop an outreach initiative to reach parents. Additional partners--National Center for Women & Information Technology, Code in Schools, and code.org (all of whom are all dedicated to promoting CT)--will further help bring this work to a national audience.
Can parent/child engagement with digital media and hands-on activities improve children's early learning of computational thinking? To answer this question, WGBH and EDC/CCT are collaborating on a design-based research process with children and their parents to create Monkeying Around successive interactions. The overarching goal of this mixed-methods research effort is to generate evidence that supports the development of recommendations around the curricular, instructional, and contextual factors that support or impede children's acquisition of CT as a result of digital media viewing and hands-on engagement. Moving through cycles of implementation, observation, analysis, and revision over the course of three years, EDC/CCT researchers will work closely with families and WGBH's development team to determine how children learn the fundamentals of CT, how certain learning tasks can demonstrate what children understand, how to stimulate interest in hands-on activities, and the necessary scaffolds to support parental involvement in the development of children's CT. Each phase of the research will provide rich feedback to inform the next cycle of content development and will include: Phase 1: the formulation of three learning blueprints (for algorithmic thinking, sequencing, and patterns); Phase 2: the development of a cohesive set of learning tasks to provide evidence of student learning, as well as the production of a prototype of the digital media and parent/child engagement resources (algorithmic thinking); Phase 3-Part A: pilot research on the prototype, revisions, production of two additional prototypes (sequencing and patterns); Phase 3-Part B: pilot research on the three prototypes and revisions; and Phase 4: production of 27 animated and live-action videos and 18 parent/child engagement activities and a study of their impact. Through this process, the project team will build broader knowledge about how to design developmentally appropriate resources promoting CT for preschool children and will generate data on how to stimulate interest in hands-on activities and the necessary scaffolds to support parental involvement in the development of children's CT. The entire project represents an enormous opportunity for WGBH and for the informal STEM media field to learn more about how media can facilitate informal CT learning in the preschool years and ways to broaden participation by building parents' capacity to support STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Moving Beyond Earth Programming: “STEM in 30” Webcasts. The Smithsonian’s National Air and Space Museum (NASM) will develop nine “STEM in 30” webcasts which will be made available to teachers and students in grades 5-8 classrooms across the country. The primary goal of this program is to increase interest and engagement in STEM for students. Formative and summative evaluations will assess the outcomes for the program, which include the following:
Increased interest in STEM and STEM careers, Increased understanding of science, technology, engineering and mathematics (STEM), Increased awareness and importance of current and future human space exploration, and Increased learning in the content areas.
This series of live 30-minute webcasts from the National Air and Space Museum and partner sites focus on STEM subjects that integrate all four areas. The webcasts will feature NASA and NASM curators, scientists, and educators exploring STEM subjects using museum and NASA collections, galleries, and activities. During the 30-minute broadcasts, students will engage with museum experts through experiments and activities, ask the experts questions, and answer interactive poll questions. After the live broadcasts, NASM will also archive the webcasts in an interactive “STEM in 30” Gallery.
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
When it comes to STEM education, the nation’s K–12 public schools cannot do it all. The nature of 21st century proficiency in science, technology, engineering, and mathematics is too complex for any single institution. The good news is that schools do not have to do it alone. Museums, zoos, nature centers, aquariums, and planetariums are among the several thousand informal science institutions in the United States that regularly engage young people in observing, learning, and using STEM knowledge and skills. Providing a richness of resources unavailable in any classroom, informal science
DATE:
TEAM MEMBERS:
Community for Advancing Discovery Research in Education (CADRE)
This Science Learning+ Planning Project will develop a prototype assessment tool (based on a mobile technology platform) to map STEM learning experiences across different learning ecologies (e.g. science centers, mass media, home environment) and to develop research questions and designs for a Phase 2 Science Learning+ proposal. The tool will focus on the impact of the learning ecologies on knowledge, interest, identity and reasoning rather than emphasize learning in a specific content area. The proposing team will develop and conduct a small scale usability study during the planning period, which will inform what is proposed in the Phase 2 research. A key focus of the planning period will be to identify and develop the theoretical constructs (i.e., outcomes) to be measured by the prototype App. As a starting point, the project will start with four of the six strands identified in Learning Science in Informal Environments (National Research Council, Bell et al., 2009): (1) interest triggered by a STEM experience; (2) understanding scientific knowledge; (3) engaging in scientific reasoning; and (4) identifying with the scientific enterprise. Discussion among the project partners during the planning process will revolve around how these strands should be measured in the Phase 2 research across ecologies. The measurement tool will assess the goal(s) that people set as they engage in STEM learning within each ecology and will measure the individuals' duration and level of engagement. The project will strive to utilize measures that: (1) are nonobtrusive; (2) are embedded in STEM experiences; (3) can be used across ecologies; (4) can be scaled for other ecologies than the ones examined in Phase 2 research; and (5) will be easy to use by researchers and practitioners.
DATE:
-
TEAM MEMBERS:
Bradley MorrisJohn DunloskyGreat Lakes Science CenterUniversity of LimerickIdeaStream (UK)Irish Independent newspaper
Young people's participation in informal STEM learning activities can contribute to their academic and career achievements, but these connections are infrequently explicitly recognized or cultivated. More systemic approaches to STEM education could allow for students' experiences of formal and informal STEM learning to be aligned, coordinated, and supported across learning contexts. This Science Learning+ planning project brings together stakeholders in two digital badge systems--one in the US and one in the UK--to plan for a study to identify the specific structural features of the systems that may allow for the alignment of learning objectives across institutions. Digital badge systems may offer an inventive solution to the challenge of connecting and building on youth's STEM-related experiences in multiple learning contexts. When part of a defined system, badges could be used to represent and communicate evidence of individual learning, as well as provide youth and educators with evidence-supported indicators for other activities in the system that might be interesting or valuable. Properly designed and supported badge systems could transmit critical information within a network of informal STEM programs and schools that (1) recognize context-dependent, interest-driven learning and (2) provide opportunities to explore those interests across multiple settings. This project advances the field of informal STEM learning in two ways. First, the project documents and analyzes the processes by which two small groups of informal science education organizations and schools negotiate the meaning and value of badges, as proxies for learning objectives, and how they decide to recognize badges awarded by other institutions. This process builds capacity within the target systems while also beginning to identify the institutional, cultural, and material capacity issues that facilitate or constrain the alignment process. Second, the project conducts a pilot study with a small number of youth in the US and UK to investigate factors associated with an individual youth's likelihood of: a) identifying badges of interest; b) connecting the activities of various badge systems to each other and to non-badging institutions, such as school or industry; c) determining which badges to pursue; and d) persisting in a particular badge pathway. Findings from this pilot study will help identify institution- and individual-level factors that might be associated with advancing student interest and progression in STEM fields. Deepening and validating the understanding of those factors and their relative impact on student experiences and outcomes will be the focus of investigations in future studies.
DATE:
-
TEAM MEMBERS:
James DiamondNew York City Hive Learning NetworkMOUSEDigitalMeKatherine McMillan