The Brains On! exploratory research study was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On! listeners using the podcast and engaging with its content?
What kinds of impacts does Brains On! have on its audiences?
These questions were answered through a three-phase mixed-methods research design. Each phase informed the next, providing additional insights into answering the research questions. Phase 1 was a review of a sample of secondary data in the
The SciGirls in Space Front End Evaluation included surveys with project advisors, girls and families about the nature and extent of partner program offerings to help inform production of media and use of media in outreach. Question 1: To what extent do advisors, girls and their family members find the girls and professionals featured in the (existing) episodes and role model videos to be effective role models? Question 2: To what extent do they find episode topics and stories relevant to their everyday lives?
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The goal of this award is to advance understanding of how children's science podcasts can provide families with information to help ease children's anxiety and fears during a pandemic. The project's hypothesis is that through listening to Brains On! coronavirus-related episodes, children will increase their understanding of science concepts related to the pandemic. As they gain this understanding, it is predicted that their overall fear and anxiety about the pandemic will diminish, they will feel empowered to ask pandemic-related questions and will engage in more science- based conversations with their family members. The project will develop three Brains On! podcast episodes focused specifically on the COVID-19 pandemic for kids aged 5 to 12 and their families. The research questions include:
How and to what extent do Brains On!'s coronavirus-based episodes help children and their families understand and talk about science-related pandemic topics? What kind of conversations are sparked by these episodes?
What kinds of questions do children have after listening to the Brains On! coronavirus episodes and what are the reasons for their questions? What can the questions tell us about the impact of listening on kids' science engagement and learning?
What resources do parents need to answer children's questions and help them understand science topics related to the pandemic?
This project is a collaboration between a media producer, Minnesota Public Radio and researchers at The Science Museum of Minnesota. Brains On! already has a large listening audience, with 7 million downloads a year, and more than 200,000 unique listeners a month and these new episodes are likely to increase listenership further. The research findings will be quickly disseminated to a wide range of audiences that can immediately apply the findings to create media and other coronavirus-related educational resources for families.
The PI's prior NSF funded projects have found that previous Brains On! podcasts with a range of STEM content increase the number and sophistication of the science questions children ask and lead to science-based conversations with family members. This project will study the impacts in relation to a singular topic, COVID-19. Three online surveys of Brains On! listeners (families with children ages 5 - 12 years old) will be conducted. The first survey to be conducted as soon as the project begins will focus on parents reflecting on what information is needed at that stage of the pandemic. Two additional listener surveys will occur immediately after new COVID-19 podcast episodes are released. These surveys will ask content-specific questions to understand how well the episode conveys that information to children and their families, what conversations were sparked from the content, and what additional information needs families have. Prior to administering each of the three surveys, video-based think-aloud interviews with 10 families will test and revise survey questions.
Survey participants will be recruited using language in Brains On! episodes, social media, website, and newsletters. A sample size of around 1,000 for each of the surveys is planned (based on a 95% confidence interval and ±3% sampling error). Analyses will include descriptive statistics and thematic coding of open-ended survey questions. Subgroup samples, when large enough will look at differences in responses by demographic variables (e.g. race/ethnicity, household income, highest level of education in the household, an adult in the household with a STEM career, gender of child, geographic location). The researchers and Brains On! staff will work together to identify how the findings can be applied to the development of subsequent coronavirus-related episodes and shared with the ISE field to further support families? education and information needs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Seeking to use narrative as a vehicle for getting more young people interested in STEM, the National Science Foundation supported a WETA/PBS NewsHour initiative to adapt their Student Reporting Labs (SRL) curriculum to feature a focus on STEM content in 2015. NewsHour selected Knology to run a four-year evaluation of the project from 2015 to 2019. Building on earlier research about student-led science journalism (e.g. Polman & Hope, 2014; Nicholas, 2017), this project suggests that having students develop and produce narratives about complex STEM topics may make these topics far less
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
This report presents findings of the Latina SciGirls mixed methods study, investigating the experiences of young Latinas participating in informal STEM programs across the U.S. that utilized the SciGirls educational model (including the SciGirls Seven strategies) and augmented with materials and practices intended to better serve Hispanic girls. The project was led by Twin Cities Public Television with funding from the National Science Foundation as an AISL Innovations in Development project. The STEM-related identity framework and research model used to guide this investigation is presented
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
Twin Cities PBS BRAINedu: A Window into the Brain/Una ventana al cerebro, is a national English/Spanish informal education project providing culturally competent programming and media resources about the brain’s structure and function to Hispanic middle school students and their families. The project responds to the need to eliminate proven barriers to Hispanic students’ STEM/neuroscience education, increase Hispanic participation in neuroscience and mental health careers and increase Hispanic utilization of mental health resources.
The program’s goals are to engage Hispanic learners and families by
empowering informalSTEM educators to provide culturally competent activities about the brain’s structure and function;
demonstrating neuroscience and mental health career options; and
reducing mental health stigma, thus increasing help-seeking behavior.
The hypothesis underpinning BRAINedu’s four-year project plan is that participating Hispanic youth and families will be able to explain how the brain works and describe specific brain disorders; demonstrate a higher level of interest of neuroscience and mental health careers and be more willing to openly discuss and seek support for brain disorders and mental health conditions.
To achieve program goals, Twin Cities PBS (TPT) will leverage existing partnerships with Hispanic-serving youth educational organizations to provide culturally competent learning opportunities about brain health to Hispanic students and families. TPT will partner with neuroscience and mental health professionals, cultural competency experts and Hispanic-serving informal STEM educators to complete the following objectives:
Develop bilingual educational resources for multigenerational audiences;
Provide professional development around neuroscience education to informal educators, empowering them to implement programming with Hispanic youth and families, and
Develop role model video profiles of Hispanic neuroscience professionals, and help partner organizations produce autobiographical student videos.
We will employ rigorous evaluation strategies to measure the project’s impact on Hispanic participants: a) understanding of neuroscience and brain health, particularly around disorders that disproportionately affect the Hispanic community; b) motivation to pursue neuroscience or mental health career paths; and c) mental health literacy and help-seeking behavior. The project will directly reach 72 Hispanic-serving informal STEM educators and public health professionals, and 200 children and 400 parents in underserved urban, suburban and rural communities nationwide.
For public health to improve, all sectors of society much have access to the highest quality health science news and information possible. How that information is translated, packaged and disseminated is important: the stories matter. Our journalism and mentoring program will grow the health science literacy of the nation by building the next generation of science communicators, ensuring that cadre of youth from historically disadvantaged groups have the discipline, creativity and critical thinking skills needed to be successful health science-literate citizens and advocates within their own communities.
Using a combination of youth-generated videos, broadcast reporting and online curriculum resources, PBS NewsHour will engineer successful educational experiences to engage students from all backgrounds, and particularly underserved populations, to explore clinical, biomedical, and behavioral research. The PBS NewsHour’s Student Reporting Labs program, currently in 41 states, will create 10 health science reporting labs to produce unique news stories that view health and science topics from a youth perspective. We will incorporate these videos into lesson plans and learning tools disseminated to the general public, educators and youth media organizations. Students will be supported along the way with curricula and mentorship on both fundamental research and the critical thinking skills necessary for responsible journalism. This process will ensure the next generation includes citizens who are effective science communicators and self-motivated learners with a deep connection to science beyond the textbook and classroom.
PBS NewsHour will develop a STEM-reporting curriculum to teach students important research skills. The program will include activities that expose students to careers in research, highlight a diverse assortment of pioneering scientists as role models and promote internship opportunities. The resources will be posted on the PBS NewsHour Extra site which has 170,000 views per month and our partner sites on PBS Learning Media and Share My Lesson—the two biggest free education resource sites on the web—thus greatly expanding the potential scope of our outreach and impact.
NewsHour broadcast topics will be finalized through our advisory panel and the researchers interviewed for the stories will be selected for their expertise and skills as effective science communicators, as well as their diversity and ability to connect with youth. Finally, we will launch an outreach and community awareness campaign through strategic partnerships and coordinated cross promotion of stories through social media platforms.
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.