As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project would expand the informal STEM learning field's understanding of how to use digital science media to increase STEM educational experiences and opportunities for English language learners. Across the U.S. there are significant STEM opportunity and achievement gaps for English learners with varying levels of English proficiency. This is at a time when the U.S. is facing a shortage of STEM professionals in the workforce including the life and physical science fields. This project aims to close these gaps and improve English learners' STEM learning outcomes using digital media. Within community colleges, there are multiple site-based programs to provide content to help English learners to learn English and to improve their math and literacy skills. Involving the state community college networks is a critical strategy for gathering important feedback for the pedagogical approach as well as for recruiting English learner research participants. The team will initially study an existing YouTube chemistry series produced by Complexly then produce and test new videos in Spanish using culturally relevant instructional strategies. The target audience is 18-34-year-old English learners. Project partners are Complexly, a producer of digital STEM media and EDC, a research organization with experience in studying informal STEM learning.
The project has the potential to advance knowledge about the use of culturally relevant media to improve STEM opportunities and success for English language learners. Using a Design-Based Implementation Research framework the research questions include: 1) what are the effective production and instructional strategies for creating digital media to teach science to English learners whose native language is Spanish? 2) what science content knowledge do English learners gain when the project's approach is applied to a widely available set of YouTube videos? and 3) how might the findings from the research be applied to future efforts targeting English learners? The project has the potential to significantly broaden participation in science and engineering. Phase 1 of the research will be an exploration of how to apply strategic pedagogical approaches to digital media content development. Interviews will be conducted with educators in 3 focal states with high numbers of English language learners (NY, CA, TX) to reflect on pedagogical foundations for teaching science to English learners. A survey of 30 English learners will provide feedback on the perceived strengths and weaknesses of a selection of existing YouTube chemistry videos. Phase 2 will create/test prototypes of 6 adapted chemistry videos. Forty students (ages 18-34) will be recruited and participate in cognitive interviews with researchers after viewing these videos. Based on this input additional videos will be produced with revised instructional strategies for further testing. Additional rounds of production and testing will be conducted to develop an English learners mini chemistry series. Phase 3 will be a pilot study to gauge the science learning of 75 English learners who will view an 11-episode chemistry miniseries. It will also identify gaps in expected learning to determine whether any further adjustments are necessary to the instructional approach.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Kelsey SavageCeridwen RileyStan MullerHeather LavigneCaroline ParkerKatrina Bledsoe
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.
Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.
The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The pilot and feasibility study will develop instructional workshops for an adult population of quilters to introduce them to computational thinking. By leveraging pre-existing social structures, skill sets, and engagement in quilting, the researchers hope to help participants develop computer science and computational thinking knowledge and skills. The long-term goal is to broaden public awareness of computational thinking and build links between computer science and other areas of interest. By leveraging the social structure and existing skills held by practicing quilters, the workshops have the potential to reach an audience of millions of quilters around the nation and worldwide, the majority of whom are adult women. The research will be developed and tested with two groups: the Orlando Modern Quilt Guild in Orlando, FL, and an informally gathered quilting class in the Worcester, MA area. Outcomes for the project include workshop materials that can be used in a variety of quilting group contexts nationwide, a deeper understanding of the processes and mechanisms for adult computer science education through crafts, and evaluation of the pilot workshop focused on the impact on participants' engagement, self-identity, and learning for computational thinking. The research especially focuses on leveraging pre-existing knowledge, interests, and social structures to draw connections to computational thinking, and studying how this impacts participants' self-described identity, attitude, and engagement with computer science. The project also assesses a novel method for teaching computational thinking that has potential for broad applicability in a variety of social and creative hobbies. Participants will use and modify generative design software that creates quilt designs and, in doing so, learn how creative interests can be expanded through computer science. By focusing on the hobby of quilting, which is not typically associated with computer science, the knowledge built through designing and evaluating the research offers strategies for altering public perception of computer science. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.