As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This Research in Service to Practice project will address the issues around Informal Education of rural middle school students who have high potential regarding academic success in efforts to promote computer and IT knowledge, advanced quantitative knowledge, and STEM skills. Ten school districts in rural Iowa will be chosen for this study. It is anticipated that new knowledge on rural informal education will be generated to benefit the Nation's workforce. The specific objectives are to understand how informal STEM learning shapes the academic and psychosocial outcomes of rural, high-potential students, and to identify key characteristics of successful informal STEM learning environments for rural, high-potential students and their teachers. The results of this project will provide new tools for educators to increase the flow of underserved students into STEM from economically-disadvantaged rural settings.
The President's Council of Advisors on Science and Technology predicts a rapid rise in the number of STEM jobs available in the next decade, describing an urgent need for students' educational opportunities to prepare them for this workforce. In 2014, 62% of CEOs of major US corporations reported challenges filling positions requiring advanced computer and information technology knowledge. The project team will use a mixed methods approach, integrating comparative case study and mixed effects longitudinal methods, to study the Excellence program. Data sources include teacher interviews, classroom observations, and student assessments of academic aptitude and psychosocial outcomes. The analysis and evaluation of the program will be grounded in understanding the local efforts of school districts to build curriculum responsive to the demands of their high-potential student body. The project design, and subsequent analysis plan, utilizes a mixed methods approach, incorporating case study and longitudinal quantitative methods to analyze naturalistic data and build robust evidence for the implementation and impact of this program. This project will provide significant insights in how best to design, implement, and support informal out-of-school learning environments to broaden participation in the highest levels of STEM education and careers for under-resourced rural students.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This proposed effort embraces broad participation by the three Ute tribes, History Colorado, and scientists in the field of archaeology to investigate and integrate traditional ecological knowledge and contemporary Western science. The project will preserve knowledge from the Ute peoples of Colorado and Utah, including traditional technology, ethnobotany, engineering and math. Results from this project will inform educational efforts in similar communities.
This project will build on the long-standing collaborations between History Colorado (HC), the Southern Ute Indian Tribe, Ute Mountain Ute Tribe and Ute Indian Tribe, Uintah & Ouray Reservation, and the Dominguez Archaeological Research Group DARG). HC will implement and evaluate a regional informal learning collaboration focused on Ute traditional and contemporary STEM knowledge serving over 128,000 learners through tribal programs, local history museums and educational networks. This project will advance the understanding of integrated knowledge and the role of Ute people as STEM learners and practitioners. This Informal Science Learning project will increase lifelong STEM learning in rural communities and create a replicable model for collaboration among tribes, history museums, and scientists.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This research project leverages ongoing longitudinal research to investigate whether, and if so how, youth from ages 10 to 15 in a diverse, under-resourced urban community become interested and engaged in STEM. The project addresses a global issue; fewer youth choose to major in scientific fields or take science coursework at high school or university levels. These declining numbers result in fewer STEM professionals and fewer scientifically literate citizens who are able to function successfully in an increasingly scientific and technological society. These declines are observed for youth as a whole, but are most pronounced for girls and particular non-white ethnic minorities. Data collected from youth in this community of study, including non-white ethnic minorities, mirrors this decline. NSF funding will support a five-year systematic and systemic process in which project researchers work collaboratively with existing informal and formal educational partners (e.g., museums, libraries, afterschool providers, schools) to develop sets of customized, connected, and coordinated learning interventions, in and out of school, for youth with different backgrounds, needs, and interests, all with the goal of averting or dampening this decline of STEM interest and participation during early adolescence. In addition to new research and community STEM networks, this project will result in a Community Toolkit that includes research instruments and documentation of network-building strategies for use by other researchers and practitioners nationally and internationally. This mixed methods exploratory study has two distinct but interrelated populations - youth and educators from across informal and formal institutions. To develop a clearer understanding of the factors that influence youths' STEM interest development over time, particularly among three youth STEM Interest Profiles identified in a secondary analysis (1-Dislike Math, 2-Like all STEM, 3-Dislike all STEM), the design combines surveys with in-depth interviews and observations. To study educators and institutions, researchers will combine interviews, focus groups, and observations to better understand factors that influence community-wide, data-driven approaches to supporting youth interest development. Research will be conducted in three phases with the goal of community-level change in youth STEM interest and participation. In Phase 1 (Years 1 & 2) four educational partners will develop interventions for a 6th and 7th grade youth cohort that will be iteratively refined through a design-based approach. Educational partners and researchers will meet to review and discuss interest and participation data and use these data to select content, as well as plan activities and strategies within their programs (using a simplified form of conjecture mapping). By Phase 2 (Years 3 & 4) four additional partners will be included, more closely modeling the complex system of the community. With support from researchers support and existing partners, new educational partners will similarly review and discuss data, using these to select content, as well as plan activities consistent with program goals and strategies. Additional interventions will be implemented by the new partners and further assessed and refined with a new 6th and 7th grade cohort, along with the existing interventions of the first four partners. In Phase 3 (Year 5) data will be collected on pre-post community-level changes in STEM interest and participation and the perceived effectiveness of this approach for youth. These data will inform future studies.