For an award-winning, public media YouTube science and nature series like KQED’s Deep Look, which delights its audiences by exploring unusual, tiny animals and plants up-close in ultra-high definition, how do you quantify and assess the value of different kinds of behind-the-scenes content when your original short videos are so fantastic at engaging your target audience?
Below is a summary of the key findings of the behind-the-scenes survey. Attached is the full report.
1. The measurable benefits of appending a fully produced behind-the-scenes video to a Deep Look episode appear to
The KQED digital video team explored why they have gender disparity in viewership of their YouTube series Deep Look. For almost every one of our episodes, the percentage of women who watch is considerably lower than the percentage of men, a disparity that also happens on other science shows distributed by PBSDS. On average, about 70% of Deep Look’s YouTube audience is male and only 30% is female. Our audience’s disparity is even more pronounced than that of YouTube’s average audience, which is 60% male.
Below is a summary of the survey’s findings. You can read the full report, called “A
This NOVA multiplatform media initiative consisted of a 2-hour nationally broadcast PBS documentary, Polar Extremes; a 10-part original digital series, Antarctic Extremes; an interactive game, Polar Lab; accompanying polar-themed digital shorts, radio stories, text reporting, and social media content; a collection of educational resources on PBS LearningMedia; and community screening events and virtual field trips for science classrooms. Across multiple media platforms the project’s video content had nearly 13 million views.
The research explored the potential for informal STEM learning
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The major public policy of social distancing relies, in part, on the cooperation of younger and healthier people who may not experience symptoms and can spread the virus unknowingly to more vulnerable populations. Science journalists, who are on the front lines of covering the pandemic, can play an important role in educating millennial audiences about the science behind the virus, how it is transmitted and effective ways to prevent the virus from spreading. This award will help the STEM field better understand how to engage millennial audiences with effective COVID-19 media content and to urgently capture professional knowledge on crisis reporting. KQED and Texas Tech University are suited to rapidly implement a science media informal science learning project targeting millennials and younger audiences in light of their current NSF-funded "Cracking the Code: Influencing Millennial Science Engagement" collaborative research and evaluation project (DRL 1810990 and 1811091). The project team has built a functional research protocol for its media practitioner and academic researcher collaboration, and will apply these new RAPID funds to complement on-going efforts, mobilize the existing team, research protocol, and research tools to respond to the communication challenge of reaching younger adults posed by COVID-19. Content to be created includes: 1) Radio broadcasts - daily news coverage, live talks; 2) A real-time blog - live Coronavirus updates and 3) Social media content on Facebook, Instagram and Twitter.
The project team will explore the following research questions:
How could COVID-19 coverage be designed to best inform, engage and educate millennials and younger audiences about the science of virus transmission and prevention?
What are some best practices for crisis reporting, as journalists respond to both constantly updated information and changing audience needs, that can be used by media outlets (such as advisors PBS Digital Studios, PBS NewsHour, NOVA, NPR Science, and more)?
The research protocol centers around "media testing cycles," which are time-bounded studies (5 months long) exploring a subset of research questions about the effectiveness of KQED's science content (articles, videos, social media posts and radio reporting) at reaching younger audiences. Steps include identifying problems that are suited for empirical examination; formulating plausible competing hypotheses on the nature of those problems and their potential solutions; and crafting study designs calculated to support valid, realistic inferences on the relative strength of those hypotheses. Data will be gathered from COVID-19 audience "chatter" from Twitter and Facebook through Crimson Hexagon, a social media listening platform. In addition to the social media listening, researchers will conduct a thematic analysis of the questions currently being collected through the audience engagement platform Hearken, where KQED has gathered nearly 2,000 questions to date about the virus and lifestyle changes. This data will also help the project team understand knowledge gaps about prevention and transmission of the virus. These two qualitative studies will be conducted concurrently and reported to KQED journalists quickly to inform reporting.
Texas Tech researchers will create a virus transmission and prevention knowledge assessment. This assessment will be validated using a national online survey. The project will examine knowledge differences based on, for example, generation and gender. TTU will examine relationships between performance on this assessment and two relevant measures: science curiosity and ordinary science intelligence. The national survey will help identify what knowledge gaps are present in which audiences. Using this information, KQED journalists will develop "explainers" and other news content, to meet audience needs and to fill knowledge gaps.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The National Academy of Sciences’ LabX program came into existence in 2017 with a directive to develop programming meant to engage with a young-adult (18-37 years old) target audience who are active decision-makers and whose actions impact current and future policies. While conducting preliminary research, the LabX staff and advisory board discovered that available research on young adults’ relationship with science was sadly lacking in detail, beyond obvious conclusions about high levels of interest in technology and social experiences.
To fill these knowledge gaps, gain a deeper
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.
Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.
The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Explore the Science of Spring: A Live Media Event is an Innovations in Development project produced by the signature PBS series Nature. The new primetime series Spring LIVE (working title) will break the frame of a traditional documentary, letting viewers themselves explore the dramatic seasonal changes of spring through the immediacy of live television. On-camera hosts, scientists and naturalists in locations across the U.S., and scores of citizen scientists will use observation and scientific inquiry to explore the workings of nature during this season of rebirth. The unfolding stories of seasonal change will illuminate larger scientific insights--into the biodiversity of species in habitats, the interconnectedness of plants and animals in diverse ecosystems, the global phenomenon of species migration, and how spring "green-up" can be affected by environmental change--while inspiring appreciation for species conservation and habitat preservation. Spring LIVE is conceived as an ongoing series, with this inaugural season composed of three one-hour programs broadcast live on three consecutive nights, along with real-time interactions via Facebook. Reaching long-standing Nature viewers (2.5 million per episode), Spring LIVE will seek to turn mature adults and diverse families into citizen science doers, and leverage younger Nature online audiences through social media and community engagement in partnership with citizen science projects.
Spring LIVE will build public knowledge of and engagement in phenology and citizen science. The project will also conduct knowledge-building research on the effectiveness of Facebook as a science learning tool. It will experiment with eliciting audience participation via Facebook within the live shows to generate synchronous, second-screen thought and discussion. An exploratory study by Multimedia Research will look at the impact of this feature, addressing the question: To what extent and how does Facebook interactivity within live science shows impact adult engagement, learning and motivation? Spring LIVE will also engage multiple partners to expand reach and impact and build capacity in their fields. National partners include the National Park Service and Next Avenue; citizen science partners include Celebrate Urban Birds, National Phenology Network, Monarch Blitz, and SciStarter, among others. PBS stations will work with these organizations to involve diverse, intergenerational audiences in observation of nature and seasonal change. Project evaluation, implemented by Knight Williams Research Communications, will focus on the impact of live television on science learning, and the success of the integration of citizen science projects on air, online, and in communities. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will research and produce science media based on the role that interest, motivations, identify, and values play in engaging diverse, millennial audiences in a dynamic media environment. Using a design-based research approach the project team will develop Millennial Science Media Engagement Profiles (a set of categories describing different audience types who engage with science media in different ways). It will design and test science media content (text, audio, graphics, video), placement and platform use for millennials; and make conclusions around science media storytelling and outreach tactics that spark interest and engagement, the precursors to learning. Broader impacts include contributing significant new knowledge about millennials interest and engagement in science while they are at a stage in life making critical career decisions. It will also provide a model for other science media producers providing new protocols for creating targeted digital media for this specific audience. And further impacts include reaching a large national audience through social media. The project is a collaboration between KQED and researchers at Texas Tech.
The research will focus on the distinctive experience and interest of "millennial" science consumers. It builds on a previously funded national survey and series of focus groups with millennials looking at their science media preferences versus other generations. With these survey results this project will build profiles of millennial audiences based on two factors: level of science curiosity and level of science media engagement. The researchers will use a previously validated Science Curiosity Scale. The Millennial Profiles will be validated in two ways: through performance-based survey questions and through internet audience behavior analysis using existing digital analysis tools. KQED will produce different science media content and send it to certain groups conducting A/B testing to validate profiles online. The profile assumptions will continue to be tested until the team can effectively predict the kinds of science content that different profile groups prefer. The research will use a study protocol used in other domains to bridge the gap between lab and real-world settings. The protocol involves four steps: initial hypothesis development; ante experimental simulation; real-world communication; and ex post experimental simulations. Following the profile validation, the protocol will be used to test the efficacy of new KQED Science content, testing the variables that contribute to millennial engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.