This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project would expand the informal STEM learning field's understanding of how to use digital science media to increase STEM educational experiences and opportunities for English language learners. Across the U.S. there are significant STEM opportunity and achievement gaps for English learners with varying levels of English proficiency. This is at a time when the U.S. is facing a shortage of STEM professionals in the workforce including the life and physical science fields. This project aims to close these gaps and improve English learners' STEM learning outcomes using digital media. Within community colleges, there are multiple site-based programs to provide content to help English learners to learn English and to improve their math and literacy skills. Involving the state community college networks is a critical strategy for gathering important feedback for the pedagogical approach as well as for recruiting English learner research participants. The team will initially study an existing YouTube chemistry series produced by Complexly then produce and test new videos in Spanish using culturally relevant instructional strategies. The target audience is 18-34-year-old English learners. Project partners are Complexly, a producer of digital STEM media and EDC, a research organization with experience in studying informal STEM learning.
The project has the potential to advance knowledge about the use of culturally relevant media to improve STEM opportunities and success for English language learners. Using a Design-Based Implementation Research framework the research questions include: 1) what are the effective production and instructional strategies for creating digital media to teach science to English learners whose native language is Spanish? 2) what science content knowledge do English learners gain when the project's approach is applied to a widely available set of YouTube videos? and 3) how might the findings from the research be applied to future efforts targeting English learners? The project has the potential to significantly broaden participation in science and engineering. Phase 1 of the research will be an exploration of how to apply strategic pedagogical approaches to digital media content development. Interviews will be conducted with educators in 3 focal states with high numbers of English language learners (NY, CA, TX) to reflect on pedagogical foundations for teaching science to English learners. A survey of 30 English learners will provide feedback on the perceived strengths and weaknesses of a selection of existing YouTube chemistry videos. Phase 2 will create/test prototypes of 6 adapted chemistry videos. Forty students (ages 18-34) will be recruited and participate in cognitive interviews with researchers after viewing these videos. Based on this input additional videos will be produced with revised instructional strategies for further testing. Additional rounds of production and testing will be conducted to develop an English learners mini chemistry series. Phase 3 will be a pilot study to gauge the science learning of 75 English learners who will view an 11-episode chemistry miniseries. It will also identify gaps in expected learning to determine whether any further adjustments are necessary to the instructional approach.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Kelsey SavageCeridwen RileyStan MullerHeather LavigneCaroline ParkerKatrina Bledsoe
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayM.J. NehasilCathy Whitlock
Charles Darwin is largely unknown and poorly understood as a historical figure. Similarly, the fundamental principles of evolution are often miss-stated, misunderstood, or entirely rejected by large numbers of Americans. Simply trying to communicate more facts about Darwin, or facts supporting the principles of evolution is inadequate; neither students nor members of the public will care or retain the information. On the contrary, building facts into a one-on-one conversational narrative creates an memorable opportunity to learn. Here, we create a digital-media, self-guided question and answer
DATE:
TEAM MEMBERS:
David J. LampeBrinley KantorskiJohn Pollock
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
The Jackprot is a didactic slot machine simulation that illustrates how mutation rate coupled with natural selection can interact to generate highly specialized proteins. Conceptualized by Guillermo Paz-y-Miño C., Avelina Espinosa, and Chunyan Y. Bai (New England Center for the Public Understanding of Science, Roger Williams University and the University of Massachusetts, Dartmouth), the Jackprot uses simplified slot-machine probability principles to demonstrate how mutation rate coupled with natural selection suffice to explain the origin and evolution of highly specialized proteins. The
Ways of Knowing, Inc. is developing "The Writing Project," two one-hour television documentary programs about the science (the archeology and written history, anthropology, and cognitive science) of writing systems and, at the same time, about "creative writing," from cuneiform tablets to e:mail. The programs will show how writing is a different thing from speech, and how it did not evolve, like speech, but had to be invented. The goal of the project is to inform a wide, general audience about the most important technological invention since the beginning of civilization, to introduce them to the science of writing systems (grammatology), and to create an original "Introduction to Writing" for colleges and high schools. During this planning phase, the staff will conduct the research needed to bring order and focus to the topic and develop a treatment for presenting the topic in the two films. The PI and his colleagues would draw upon the wisdom of numerous experts in the field of science of writing including three world renowned scholars: William Bright, University of Colorado, Professor Emeritus, UCLA, and editor of "Written Language and Literacy;" Peter Daniels, author, scholar, lecturer on grammatology, and editor of "The World's Writing Systems;" and Victor Mair, Professor of Chinese at U-Penn. On the literary side, writers to be interviewed in the planning phase include Kurt Vonnegut, Elmore Leonard, and Helen Vendler. Specific costs involved in the nine-month planning phase include travel; producer, writer, and researcher fees; fees to consultants; and mini conferences of experts.
This Communicating Research to Public Audiences (NSF 03-509) project is based on the PI's current NSF award: SBE-0545361- ADVANCE: Determining national science faculty demographics in order to empower women and guide solutions. This project will help address the need for underrepresented female faculty as role models and mentors in science and engineering. Although the number of female under-represented minority students (URM) in college has been increasing, there are astonishingly low numbers of female URM faculty in each science discipline. This project would produce a series of female URM faculty biographical videos to substitute for the lack of personal contact young women have with these role models. The videos would be widely disseminated through schools, colleges, and minority serving organizations to reach young women.
Rutgers University is developing a large-format, scientific, documentary film about the evolving scientific investigation of deep-sea hydrothermal vents. Volcanoes of the Abyss (working title) will be produced in conjunction with Volcanic Ocean Films and produced/directed by Stephen Low. It will examine the communities these vents support and their relationship to the surrounding environment. It also will consider the implications vent discoveries have for our understanding of the evolution of life and our search for life elsewhere in the Cosmos. Much of the filming will be done from on board the Alvin deep ocean research vessel. The companion Educational Outreach Program will reach students in middle and secondary schools and at the college level. Print-based and web-based material also will be designed for use by families. The film and the outreach materials together will be the basis of a substantive educational effort to inform the public about the intricacies and significance of the fascinating, but largely unknown, ecosystem.
DATE:
-
TEAM MEMBERS:
Richard LutzAlexander LowStephen LowBarbara Flagg