This poster was presented at the 2021 NSF AISL Awardee Meeting.
The project's activities include regular forums of journalists and social scientists (Slack & Zoom), experimentation with different ways of presenting stats in news graphics and text, focus groups and experiments with audiences, and resources to support journalists beyond our team.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project would expand the informal STEM learning field's understanding of how to use digital science media to increase STEM educational experiences and opportunities for English language learners. Across the U.S. there are significant STEM opportunity and achievement gaps for English learners with varying levels of English proficiency. This is at a time when the U.S. is facing a shortage of STEM professionals in the workforce including the life and physical science fields. This project aims to close these gaps and improve English learners' STEM learning outcomes using digital media. Within community colleges, there are multiple site-based programs to provide content to help English learners to learn English and to improve their math and literacy skills. Involving the state community college networks is a critical strategy for gathering important feedback for the pedagogical approach as well as for recruiting English learner research participants. The team will initially study an existing YouTube chemistry series produced by Complexly then produce and test new videos in Spanish using culturally relevant instructional strategies. The target audience is 18-34-year-old English learners. Project partners are Complexly, a producer of digital STEM media and EDC, a research organization with experience in studying informal STEM learning.
The project has the potential to advance knowledge about the use of culturally relevant media to improve STEM opportunities and success for English language learners. Using a Design-Based Implementation Research framework the research questions include: 1) what are the effective production and instructional strategies for creating digital media to teach science to English learners whose native language is Spanish? 2) what science content knowledge do English learners gain when the project's approach is applied to a widely available set of YouTube videos? and 3) how might the findings from the research be applied to future efforts targeting English learners? The project has the potential to significantly broaden participation in science and engineering. Phase 1 of the research will be an exploration of how to apply strategic pedagogical approaches to digital media content development. Interviews will be conducted with educators in 3 focal states with high numbers of English language learners (NY, CA, TX) to reflect on pedagogical foundations for teaching science to English learners. A survey of 30 English learners will provide feedback on the perceived strengths and weaknesses of a selection of existing YouTube chemistry videos. Phase 2 will create/test prototypes of 6 adapted chemistry videos. Forty students (ages 18-34) will be recruited and participate in cognitive interviews with researchers after viewing these videos. Based on this input additional videos will be produced with revised instructional strategies for further testing. Additional rounds of production and testing will be conducted to develop an English learners mini chemistry series. Phase 3 will be a pilot study to gauge the science learning of 75 English learners who will view an 11-episode chemistry miniseries. It will also identify gaps in expected learning to determine whether any further adjustments are necessary to the instructional approach.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Kelsey SavageCeridwen RileyStan MullerHeather LavigneCaroline ParkerKatrina Bledsoe
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.
Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.
The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
This multiplatform media and science center project is designed to engage audiences in humanity's deepest questions like the nature of love, reality, time and death in both scientific and humanistic terms. Project deliverables include 5 hour-long radio programs for broadcast on NPR stations, public events/museum exhibits at the Exploratorium in San Francisco, kiosks in venues throughout the city, and a social media engagement campaign. The audience of the project is large and diverse using mass media and the internet. But the project will specifically target young, online, and minority audiences using various strategies. The project is designed to help a diverse audience understand the impact of new scientific developments as well as the basic science, technology, engineering and math needed to be responsible, informed citizens. Innovative elements of the project include the unique format of the radio programs that explore complex topics in an engaging and compelling way, the visitor engagement strategy at the Exploratorium, and the social media strategy that reaches niche audiences who might never listen to the radio broadcasts, but find the podcasts and blogs engaging. The Exploratorium will be opening a new building in 2013 and will include exhibits and programs that are testing grounds for this project. This is a new model that aligns the radio content with exhibitions, social media, and in person events at the Exploratorium, providing a unique holistic approach. The project is designed to inspire people to think and talk about science and want to find out more. The evaluation will measure the impacts on the targeted audiences reached by each of the key delivery methods. Data will be collected using focus groups; intercept interviews with people in public places, and longitudinal panels. The focus will be on 5 targeted audiences (young adults, families with children, non-NPR listeners, underrepresented minorities, and adults without college experience). This comprehensive evaluation will likely contribute important knowledge to the field based on this multiple-platform collaborative model.
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. It describes the PBS NewsHour STEM Learning project, a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience.
This is the summative evaluation of Statistics for Action (SfA). The mixed-methods evaluation included both process (project implementation) and impact (project effectiveness) assessments. It was posited a cascade-like impact of SfA, in which new materials would be developed by TERC staff; a host of environmental organizations would be trained to utilize them with grass roots community groups; and these groups would then incorporate SfA into their ongoing environmental campaigns. Ultimately, it was theorized, the public messaging around environmental issues would be strengthened by SfA’s
DATE:
TEAM MEMBERS:
Arbor Consulting PartnersMargaret ConnorsMindy FriedMadeleine Taylor
The Adult Literacy Media Alliance (ALMA), producer of TV411 and the NSF-funded Think Math, will undertake a planning process for the development of a ten part series, TV411 Cook Smart, which will incorporate lessons in math, biochemical and physical processes into a cooking show format. The television series is geared towards low-literate adults and builds on ALMA's prior experience in producing science/math-based programming. The deliverables include a standards-based curriculum outline for the series; outreach and training plans with the project's broadcast partner, Kentucky Educational Television; development of strategic partnerships with community organizations, including Head Start programs and Neighborhood Networks National Consortium; and evaluation strategies to study the impact of the TV411 Cook Smart on adult learners.
The PBS NewsHour STEM Learning project is a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience. The multi-platform project goals are to: (1) increase and improve the knowledge of the audience with respect to science and technology; (2) stimulate the active engagement of the audience with science and technology through interactive tools; and (3)position the PBS NewsHour as a regular destination for in-depth and innovative science reporting; (4) deploy new and creative digital tools to extend the impact of NewsHour science reporting, especially for youth. The PBS NewsHour is produced by MacNeil/Lehrer Productions and distributed by PBS to PBS television and radio stations across the country, five nights per week. This project is informed by an expert advisory board and other consultants. Project evaluation will be conducted by City Square Associates. The formative evaluation in year one will employ focus groups of adults from the general audience and teens as well as a quantitative survey online to determine a benchmark of current science knowledge, attitudes and behaviors. The evaluation in year two will test digital components of the project in a usability lab setting to gather information to help improve the quality and effectiveness of these deliverables. The summative evaluation will administer a tracking study with the same population surveyed in the first year. Deliverables include: a minimum of 26 science documentary reports broadcast per year plus additional in-studio interviews and coverage of breaking science news; a revamped website, notably "Science and Tech To Go"; a weekly STEM interview or report online featuring Hari Sreenivasan or other reporters; additional weekly digital STEM reporting; and an expanded and redesigned outreach program for teens and educators including an innovative, cloud-based student editing and content-sharing initiative in collaboration with several science centers. Six new PBS NewsHour Student Reporting Labs, established in high-need urban schools, will shoot, edit, and post their videos on the web. The PBS NewsHour science reports will be broadcast and featured on the NewsHour iPhone app, as well as disseminated on the NewsHour's YouTube Channel, Disqus and UStream, Hulu.com, with new science material updated daily on the web. The NewsHour is seen by more than 7 million viewers each week, with additional audiences being reached by radio, the Online NewsHour website, podcasts, and other social media. New community-based programs expand the audience farther. The final summative report will outline the impact of the project and identify the strategies and tactic found to be most effective in making use of digital media to support project goals.
This project is designed to bridge the "public understanding of science" radio model with a "public engagement with science" approach using a new public media tool - the "Public Insight Network". Radiolab, an innovative hour-long radio program has developed a highly innovative and successful format over the past 5 years that fosters interest and understanding in STEM based on audiences' natural curiosity. It has exposed non-science attentive listeners to transformative STEM concepts such as Stochasticity (physics, statistics, neuroscience), Musical Language (behavioral science, neurology, acoustics) and Space (mathematics, astronomy, technology, engineering). This project will expand the model using innovative online strategies that will connect listeners with working scientists, with each other and with the Radiolab hosts. This new model is grounded in the direct interaction of audiences and scientists which positions listeners as active creators and curators of content rather than passive recipients. The target audience is young adults 18 years old and above. Key organizational partners are The Public Insight Network (and their affiliation with the National Academies of Science), American Public Media, the Borough of Manhattan Community College and Brooklyn College. Project deliverables include 30 hour-long Radiolab programs for broadcast on public radio stations; interactive, user generated articles for the web site; live online chats, engagement "apps" for mobile smart phones; and live events at college campuses and science centers. In addition, the project will implement a mentorship program to train college-aged underrepresented students that have demonstrated an interest in science and/or science journalism. Formative evaluation will gather actionable information from audiences and scientists than can inform the design of the deliverables.The summative evaluation will assess the success of the strategy for engaging audiences in ongoing science learning. Audiences are projected to increase from the current base of 1 million radio listeners per season and 2 million podcast downloads per month. The intended learning outcomes for the audience include their gaining greater knowledge and exposure to current scientific research, and increased engagement by becoming participatory learners through online interactions with science professionals and other listeners.
DATE:
-
TEAM MEMBERS:
Ellen HorneJad AbumradRobert KrulwichSoren Wheeler
TERC is partnering with the Toxics Action Center to enhance the capacity of environmental organizations to teach mathematical literacy skills to low-income citizens, mostly women of color. Secondary collaborators include four environmental organizations around the country. The project is (1) developing math- and statistics-rich educational materials that help non-scientists interpret environmental test results, (2) developing training materials that help environmental organization personnel provide quantitative literacy training to citizens, (3) helping environmental organizations institutionalize project resources, and (4) evaluating the impact of project activities on environmental organizers, community members, and the general public. Project deliverables include bilingual, print- and web-based instructional materials (including videos) for environmental organizations to use with staff and community members; training sessions to create a cadre of environmental organization leaders who can conduct environment-focused, math training workshops; a communications toolkit for dissemination to journalists who cover environmental issues; and a resource-rich project web site.