Engineering is arguably one of the most critical skills in any society, from building bridges and homes, to designing cell phones and life-saving medical devices. Yet many Americans do not consider engineering to be essential or relevant to their everyday lives, and may even question its positive impact on society. While there have been gains in the number of women and underrepresented minorities in STEM professions over the past few decades, their numbers in the field remain disproportionately low. The Built World integrated multimedia and research project therefore aims to expand access to engineering content through the lens of “inclusive engineering,” which highlights how problem-solvers of all ages, genders, backgrounds, and perspectives approach and overcome challenges to innovate. The project applies this concept through the creation of Built World, a three-hour documentary series for broadcast on PBS stations nationwide, and a complementary interactive escape game streamed live on Twitch, where individuals of all ages and backgrounds can play and solve engineering challenges together. There is a need for effective remote and virtual interaction to support informal STEM learning, and live streaming game platforms present a promising approach to filling this need. Built World is poised to advance the field through: (1) content - creating high-quality inclusive engineering content across multiple platforms to reach a wide audience (Built World documentary, digital reporting and short form videos, community outreach campaign); (2) applied research - designing and studying how live-streaming, collaborative platforms can serve as safe and inclusive spaces for engineering learning; and (3) best practices - exploring how audiences engage with inclusive engineering on different platforms—a traditional documentary format (Built World) versus an interactive, collaborative space (Twitch game)—and identifying what learning outcomes might be expected on each.
A three-phase research design aims to understand what motivates users to engage with STEM content on Twitch; how to define and measure learning outcomes associated with the platform; and how to mitigate the risk of toxic environments in online communities by fostering safe spaces for a diversity of gamers. Phase 1 informs the initial design of the Twitch game and audience interaction strategies and seeks to answer: What is the best way to measure informal learning on Twitch? What is the best way to design a Twitch channel to create an inclusive space while optimizing learner engagement? Phase 2 is the core focus of the research and uses a semi-experimental design to answer questions such as: Is there evidence of learning on Twitch, and what type of learning is happening? What is the digital culture that emerges? Phase 3 assesses the pairing of the documentary series with the Twitch game to maximize informal STEM learning and is guided by questions such as: How does inclusive engineering content presented on two platforms (Twitch game and Built World series) mediate learning outcomes? How does inclusive engineering content presented on two platforms shape learners’ experiences of inclusivity and belonging? Knowledge generated through the Built World project will offer tools and best practices to other STEM media producers so that they may also leverage live streaming platforms for learning.
This poster was presented at the 2021 National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) Awardee Meeting.
The project’s goal is to create media-rich citizen science experiences for girls, particularly girls of color and/or from rural areas, which broaden their STEM participation, build positive STEM identity and increase understanding of scientific concepts, while leveraging the citizen science endeavors occurring at 16 diverse National Parks.
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Increasing greater diversity, equity, and inclusion in science not only presents a social justice goal, but is also vital to the financial and social success of the nation. The stereotype of the older white male scientist has obscured the contributions of women and people of color. This project seeks to remedy these perceptions which are barriers to entry into STEM fields. The project will create a large-scale hub for STEM themed video content on YouTube and other social media platforms, featuring 100+ original STEM videos produced by PBS partners. This hub and accompanying research seeks to identify the characteristics of online STEM content that attract (or fail to attract) underrepresented groups, specifically Black and Hispanic communities as well as women of all races. The objectives of this project are to 1) provide a unified online science-themed hub, PBS Terra, on YouTube and other platforms for hosting, sharing, and distributing digital STEM series from diverse producers from across the PBS system; 2) conduct surveys and focus groups to examine and understand the needs and expectations of women, Black and Hispanic communities and their consumption of STEM video content online and 3) test hypotheses about the communicative strategies of STEM videos that feature Black and Hispanic female scientists. Project collaborators include PBS, researchers at the University of Utah and the University of Georgia, and consultants and advisors with expertise in broadening participation and inclusion in STEM.
Little is known about how or why adult Americans seek science content on YouTube, especially the motivations of adults from underrepresented minorities and females. The key research questions in this project are: 1) Why do Black and Hispanic audiences and women of all races seek science video content online? 2) How does showing Black and Hispanic female scientists in science video content on YouTube impact viewers’ identification with and sense of belonging in STEM? 3) How does the use of humor by Black and Hispanic scientists in YouTube science content affect viewers’ perceptions of the communicator and their engagement with STEM content? 4) How does the appearance and manner of dress of Black and Hispanic scientists in YouTube science content affect viewers’ perceptions in the aforementioned areas? A nationally representative baseline survey will be conducted. A probability sample of 2000 respondents will be obtained including oversampling of Black and Hispanic audiences. To complement findings from the survey, focus groups will be conducted in eight different regions of the country to learn why these targeted audiences do or do not seek science content on YouTube and what motivates them to share the content with their social media network. In addition, an experiment embedded in an online survey will test the hypothesis that greater on-screen representation of women and scientists of color will broaden existing perceptions about scientists. The experiment will consist of a 3 (scientist’s race: Black/Hispanic/White) × 2 (science issue: controversial/non-controversial) × 2 (style: casual/professional) between-subjects design. Survey participants will be randomly assigned to the experimental conditions. These factors (science issue and host appearance) can be altered by content producers to better reach and engage the targeted audiences. The project not only investigates theoretical questions at the intersection of STEM stereotypes and race, but findings related to these experimental conditions will offer practical insight into strategies that can be used by science communication practitioners.
DATE:
-
TEAM MEMBERS:
Adam DylewskiSara YeoMichael Cacciatore
On October 1, 2015, Oregon Public Broadcasting (OPB) was awarded a 3‑year grant of 2.7 million dollars from the National Science Foundation (NSF) to fund the project Hacking Your Mind (award number 1515520). A major public and social media project, Hacking Your Mind (HYM) planned to engage Americans with the new discoveries being made in the social, behavioral, and economic sciences and the remarkable insights these discoveries offer into how individuals make numerous daily decisions and judgments, as well as the broader impact of this highly personal phenomenon on nearly every aspect of
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
This report presents findings of the Latina SciGirls mixed methods study, investigating the experiences of young Latinas participating in informal STEM programs across the U.S. that utilized the SciGirls educational model (including the SciGirls Seven strategies) and augmented with materials and practices intended to better serve Hispanic girls. The project was led by Twin Cities Public Television with funding from the National Science Foundation as an AISL Innovations in Development project. The STEM-related identity framework and research model used to guide this investigation is presented
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.