Researchers at Arizona State University (ASU), in partnership with the Smithsonian Museum on Main Street (MoMS), the Arizona Science Center, and eight tribal and rural museum sites around Arizona, will help educate and empower communities living in the Desert Southwest on water sustainability issues through the creation of WaterSIMmersion, a mixed reality (MR) educational game and accompanying museum exhibit.
DATE:
-
TEAM MEMBERS:
Claire LauerScotty CraigMina Johnson-GlenbergMichelle Hale
DuPage Children’s Museum will conduct an in-depth, iterative evaluation of the museum’s Questioneers traveling exhibit and create a permanent 2,000 square-foot, bi-lingual Questioneers exhibit along with related programming that promotes inclusivity and ignites children’s interest in mathematics, science, engineering, and architecture. The exhibit and programming also will help reduce the impact of socioeconomic disparities that are known to discourage underrepresented and underserved populations from pursuing their interest in STEM fields. The exhibit and its related programming will feature characters, activities, and challenges from bestselling children’s books. The museum will coordinate exhibit design and fabrication with community partners.
The University of Montana will create “Transforming Spaces” to foster a more inclusive, culturally responsive space for Missoula’s urban Indian population and to better meet the community’s needs. The project will explore cross-cultural, collaborative approaches to STEM and Native Science. In collaboration with Montana’s tribal communities, the museum’s education team and advisory groups will design and implement hands-on activities that engage visitors with Native Science. The project will engage tribal role models and partner with tribal elders to create a library of videos for tribal partners, K–12 schools, and organizations. The project will offer teachers professional development designed to fulfill the statewide mandate of Indian Education for All. The exhibit will connect Native and non-Native museum visitors, close opportunity and achievement gaps, and ensure that all Missoula children feel a sense of belonging in museums, higher education, and STEM.
This project engages pre-college Latinx, Black, and Indigenous learners, educators, and collaborating undergraduates in an international, project-based learning and media-making community in areas of science, technology, engineering, and mathematics (STEM). The project addresses key challenges including broadening participation in informal STEM learning, developing capacity for leading informal STEM programs, and building stronger connections between STEM learning and personal and social identity formation during adolescence. The project’s community of participants is an asset-based learning environment that treats each participant, their background, skills, and interests as uniquely beneficial to the whole. Led by mentors at each hub (teachers, leaders from science organizations, or other out-of-school learning environments), participants collaborate with peers from the US and from other countries. The collaborations encompass a broad spectrum of STEM projects. Participants also create digital media to communicate their projects. The project activities reflect a focus on STEM content, collaboration, and communication, in a global context that includes school-age learners from the US and peers from Central and South America, the Middle East, Asia, and Sub-Sahara. The combination of the sophisticated STEM competencies skills for collaborating across international and cultural boundaries, and media-savvy communication abilities are essential to the nation’s future STEM workforce and to building a scientifically vibrant citizenry.
The project addresses two primary research questions co-developed with teachers and other informal science providers. The first research question involves understanding and optimizing conditions for broadening participation through this type of distributed or virtual collaboration across boundaries of culture, race, gender, ability, nationality, and socioeconomic status. The project features a design experiment by which the overall community of participants comprises four separate hubs, each hosted by the different project partners (primarily teachers). Educators devise, test, and revise alternative designs for organizing STEM collaborations. Publication of these teacher-led designs and their evaluation are among the primary outputs of the project. The designs modify and improve a template developed under this project’s proof-of-concept precursor (NSF1612824). The second research question addresses how growth in STEM abilities, collaboration, and communication mutually reinforce adolescent personal and social identity formation. Participating students in the US will intentionally reflect heterogeneous backgrounds. The project analysis will focus on whether cultural and national cross-boundary collaboration can strengthen the development of learners' personal identity and academic performance. The project methodology relies heavily on quantitative ethnography and epistemic network analysis. This approach enables the creation of visual models that highlight the presence or absence of connections between constructs relevant to each research question, along with changes between and within groups. The constructs include variations of autonomy, competence, and connection (pillars of self-determination theory) in tracing identity formation and STEM abilities. The quantitative ethnography approach provides statistically reliable scaffolding and insights about the hub designs and their efficacy in promoting goals of broadening participation and fostering mutually reinforcing STEM competencies and identity formation. This type of virtual collaboration, crossing boundaries of culture, nationality, ethnicity, age, gender, economic strata, or ability, can realistically be expected to play a significant role in next-generation learning environments, especially through out-of-school activities. The project is expected to reach 120 U.S. and 80 non-U.S. students annually. Research findings, design principles and curricula will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
DATE:
-
TEAM MEMBERS:
Eric HamiltonNastassia JonesDanielle EspinoSeung Lee
Despite decades of policies and programs meant to increase the representation of girls and women in science, technology, engineering, and mathematics (STEM), girls and women of color still represent a much smaller percent of the STEM workforce than they do in the US population. This lack of representation is preventing the US STEM workforce from reaching its true potential. Intersecting inequalities of gender, race, ethnicity, and class, along with stereotypes associated with who is successful in STEM (i.e., White men), lead to perceptions that they do not belong and may not succeed in STEM. Ultimately, these issues hinder girls’ STEM identity development (i.e., sense of belonging and future success), lead to a crisis of representation for women of color and have compounding impacts on the STEM workforce. Research suggests there are positive impacts of in-person STEM learning after-school and out-of-school time programs on girls’ sense of belonging. The increasing need for online learning initiated by the COVID-19 pandemic means it is vital to investigate girls’ STEM identity development within an online community. Thus, the project will refine and test approaches in online learning communities to make a valuable impact on the STEM identity development of girls of color by 1) training educators and role models on exemplary approaches for STEM identity development; 2) implementing a collaborative, girl-focused Brite Online Learning Community that brings together 400 girls ages 13-16 from a minimum of 10 sites across the United States; and 3) researching the impact of the three core approaches -- community building, authentic and competence-demonstrating hands-on activities, and interactive learning with women role models -- on participating girls’ STEM identities in online settings.
The mixed methods study is guided by guided by Carlone & Johnson’s model of STEM identity involving four constructs: competence, performance, recognition, and sense of belonging. Data collection sources for the quantitative portion of the project include pre- and post-surveys, while qualitative data sources will be collected from six case study sites and will include observations, focus group interviews with girls, artifacts created by girls and educators, educator interviews, and open-ended survey responses. This approach will enable the research team to determine how and the extent to which the Brite Online Learning Community influences STEM identity constructs, interpreting which practices lead to meaningful outcomes that can be linked to the development of STEM identity for participating girls in an online environment. The products of this work will include research-based, tested Brite Practices and a toolkit for fostering girls’ interest, identification, and long-term participation in STEM. The resulting products will increase the reach of informal STEM education programming to girls of color across the nation as online spaces can reach more girls, potentially increasing the representation of women of color in the STEM workforce.
Few people realize that the largest part of our planet’s biosphere remains virtually unexplored and unknown. This enormous habitat, accounting for an area of 116 million square miles or the equivalent size of roughly 30 times the area of the United States, is the abyssal zone of the deep ocean. The abyssal sea floor, at about 6000 ft., contains more than four times as much habitat for animal life as all of the dry mountains, forests, deserts, plains and jungles combined. Microscopic larvae in the deep ocean, are essential for the renewal and replenishment of life and they repopulate areas damaged by human activities such as mining and trawling, and they make marine protected areas both feasible and important. The National Science Foundation has funded intensive studies of oceanography related to larval recruitment for decades. However, findings from this large NSF investment of personnel, technology and funding have never been widely presented to the public. This project proposes to remedy this by developing a 40 minute giant screen film to be shown in science centers across the country, supported by virtual reality and augmented reality learning tools. The film will cover select deep ocean science expeditions using the deep-sea vehicles Alvin and ROV Jason. Content will include elements of the research process, activities related to the design and operation of deep-sea vehicles as well as interviews with scientists and technologists. The companion activities, Deep-Ocean Pilot (a VR-360° viewing station) and Plankton Quest (an AR biology treasure hunt) will extend the audience experience of the deep ocean out of the giant screen theater and into the surrounding museum environment. The website and social media will extend awareness and resources into homes. The project will be appropriate for a broad general audience, with particular appeal for the target audience of women and girls (ages 7-20). The larval biologist team is led by the PI at the University of Oregon, in collaboration with scientists from North Carolina State University, Western Washington University and the University of Rhode Island. Several young women scientists will be featured in the film providing role models. The production company, Stephen Low Productions, Inc. will use the latest technology on the Alvin and other cinematic tools to capture the visual images in the abyss. Collaborating museums will participate in the development and implementation of the Virtual and Augmented Reality learning tools as well as showing the film in their theaters.
Broader impact project goals include 1) Advancing public awareness of the abyssal ocean, the role of microscopic larvae, and what scientists are learning from expeditions that use deep submergence technologies; 2) Introducing public audiences and young women specifically to the wide range of STEM-related occupations encompassed in the field of ocean exploration and research; and 3) Advancing STEM learning research and practice in the area of immersive media in conveying STEM concepts and enhancing audience identification with STEM. Oregon State University’s STEM Research Center will build new knowledge by conducting formative and summative evaluation of the film and its associated support products (e.g., Virtual and augmented reality activities, website resources), addressing the following evaluation questions: 1)What do audiences take away from their experience in terms of fascination/interest, awareness and understanding related to ocean science exploration? 2) To what degree does the film alone or in combination with supplemental experiences trigger career awareness in girls and young women, and youth of racial/ethnic backgrounds? 3) To what degree do immersive experiences (a sense of “being there”) contribute to learning from the film? 4) How enduring are outcomes with audiences past the onsite immediate experience? Formative evaluation will be designed as ongoing improvement informed by empirical evidence in which evaluators work with team members to answer decision-relevant questions in a timely and project-focused way. The summative evaluation will be structured as an effectiveness study using mixed methods and ascertaining whether key programmatic outcomes have been reached and the degree to which particular program elements will have contributed to the results.
DATE:
-
TEAM MEMBERS:
Craig YoungAlexander LowStephen LowGeorge von DassowTrish Mace
Engineering is arguably one of the most critical skills in any society, from building bridges and homes, to designing cell phones and life-saving medical devices. Yet many Americans do not consider engineering to be essential or relevant to their everyday lives, and may even question its positive impact on society. While there have been gains in the number of women and underrepresented minorities in STEM professions over the past few decades, their numbers in the field remain disproportionately low. The Built World integrated multimedia and research project therefore aims to expand access to engineering content through the lens of “inclusive engineering,” which highlights how problem-solvers of all ages, genders, backgrounds, and perspectives approach and overcome challenges to innovate. The project applies this concept through the creation of Built World, a three-hour documentary series for broadcast on PBS stations nationwide, and a complementary interactive escape game streamed live on Twitch, where individuals of all ages and backgrounds can play and solve engineering challenges together. There is a need for effective remote and virtual interaction to support informal STEM learning, and live streaming game platforms present a promising approach to filling this need. Built World is poised to advance the field through: (1) content - creating high-quality inclusive engineering content across multiple platforms to reach a wide audience (Built World documentary, digital reporting and short form videos, community outreach campaign); (2) applied research - designing and studying how live-streaming, collaborative platforms can serve as safe and inclusive spaces for engineering learning; and (3) best practices - exploring how audiences engage with inclusive engineering on different platforms—a traditional documentary format (Built World) versus an interactive, collaborative space (Twitch game)—and identifying what learning outcomes might be expected on each.
A three-phase research design aims to understand what motivates users to engage with STEM content on Twitch; how to define and measure learning outcomes associated with the platform; and how to mitigate the risk of toxic environments in online communities by fostering safe spaces for a diversity of gamers. Phase 1 informs the initial design of the Twitch game and audience interaction strategies and seeks to answer: What is the best way to measure informal learning on Twitch? What is the best way to design a Twitch channel to create an inclusive space while optimizing learner engagement? Phase 2 is the core focus of the research and uses a semi-experimental design to answer questions such as: Is there evidence of learning on Twitch, and what type of learning is happening? What is the digital culture that emerges? Phase 3 assesses the pairing of the documentary series with the Twitch game to maximize informal STEM learning and is guided by questions such as: How does inclusive engineering content presented on two platforms (Twitch game and Built World series) mediate learning outcomes? How does inclusive engineering content presented on two platforms shape learners’ experiences of inclusivity and belonging? Knowledge generated through the Built World project will offer tools and best practices to other STEM media producers so that they may also leverage live streaming platforms for learning.
Data is increasingly important in all aspects of people’s lives, from the day-to-day, to careers and to civic engagement. Preparing youth to use data to answer questions and solve problems empowers them to participate in society as informed citizens and opens doors to 21st century career opportunities. Ensuring equitable representation in data literacy and data science careers is critical. For many girls underrepresented in STEM, developing a "data science identity" requires personally meaningful experiences working with data. This project aims to promote middle school-aged girls’ interest and aspirations in data science through an identity-aligned, social game-based learning approach. The goals are to create a more diverse and inclusive generation of data scientists who see data as a resource and who are equipped with the skills and dispositions necessary to work with data in order to solve practical problems. The research team will run 10 social clubs and 10 data science clubs mentored by women in data science recruited through the University of Miami’s Institute for Data Science and Computing. Participants will be 250 middle school-aged girls recruited in Miami, FL, and Yolo County, CA, through local and national girls’ organizations. Youth will participate in a data science club and will learn key data science concepts and skills, including data structures, storage, exploration, analysis, and visualization. These concepts will be learned from working with their own data collected in personally meaningful ways in addition to working with data collected by others in the same social game eco-system. The project will also develop facilitator materials to allow adult volunteers to create game-based informal data science learning experiences for youth in their areas. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments and is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST), which seeks to engage underrepresented students in technology-rich learning environments, including skills in data literacy, and increase students’ knowledge and interest in information and communication technology (ICT) careers.
Researchers will focus on two primary research questions: 1) Across gameplay and club experiences, in what ways do participants engage with data to pursue personal or social goals? 2) How do gameplay and club experiences shape girls’ perceptions of data, data science, and their fit with data and data science? The project will use design-based research methods to iteratively design the game and social club experiences. To ensure that uses of data feel personally and socially meaningful to young girls, the virtual world’s goals, narratives, and activities will be co-designed with girls from groups underrepresented in data science. The project will research engagement with game data in two informal, game-based learning scenarios: organic, self-directed, social play club, and structured, adult-facilitated data science clubs. The research will use a combination of quantitative and qualitative methods including surveys, focus groups, interviews, and gameplay and club observations. Project evaluation will determine how gameplay and club experiences impact participants' attitudes toward and interest in data-rich futures. The project holds the potential for broadening participation and promoting interest in data science by blending game-based learning with the rich social and adult mentoring through club participation. The results will be disseminated through conference presentations, scholarly publications, and social media. The game and facilitator materials will be designed for dissemination and made freely available to the public.
DATE:
-
TEAM MEMBERS:
Lisa HardyGary GoldbergerJennifer Kahn
This project is funded by the EHR Core Research (ECR) program, which supports work that advances fundamental research on STEM learning and learning environments, broadening participation in STEM, and STEM workforce development. It responds to continuing concerns about racial and social inequities in STEM fields that begin to emerge in the early childhood years. The overarching goal of the project is to identify cultural strengths that support early science learning opportunities among Spanish-speaking children from immigrant Latin American communities, a population that is traditionally underrepresented in STEM educational and career pursuits. Building on a growing interest in the ways stories can promote early engagement in and understanding of science, this project will investigate the role of oral and written stories as culturally relevant and potentially powerful tools for making scientific ideas and inquiry practices meaningful and accessible for young Latinx children. Findings will reveal ways that family storytelling practices can provide accessible entry points for Latinx children's early science learning, and recommend methods that parents and educators can use to foster learning about scientific practices that can, in turn, increase interest and participation in science education and fields.
The project will advance knowledge on the socio-cultural and familial experience of Latinx children that can contribute to their early science learning and skills. The project team will examine the oral story and reading practices of 330 Latinx families with 3- to 5-year-old children recruited from three geographic locations in the United States: New York, Chicago, and San Jose. Combining interviews and observations, the project team will investigate: (1) how conversations about science and nature occur in Latinx children's daily lives, and (2) whether and to what extent narrative and expository books, family personal narratives, and adivinanzas (riddles) engender family conversations about scientific ideas and science practices. Across- and within-site comparisons will allow the project team to consider the immediate ecology and broader factors that shape Latinx families’ science-related views and practices. Although developmental science has long acknowledged that early learning is culturally situated, most research on early STEM is still informed by mainstream experiences that largely exclude the lived experiences of children from groups underrepresented in STEM, especially those who speak languages other than English. The proposed work will advance understanding of stories as cultural resources to support early science engagement and learning among Latinx children and inform the development of high quality, equitable informal and formal science educational opportunities for young children.
The Ice Worlds media project will inspire millions of children and adults to gain new knowledge about polar environments, the planet’s climate, and humanity’s place within Earth’s complex systems—supporting an informed, STEM literate citizenry. Featuring the NSF-funded THOR expedition to Thwaites glacier, along with contributions of many NSF-supported researchers worldwide, Ice Worlds will share the importance of investments in STEM with audiences in giant screen theaters, on television, online, and in other informal settings. Primary project deliverables include a giant screen film, a filmmaking workshop for Native American middle school students that will result in a documentary, a climate storytelling professional development program for informal educators, and a knowledge-building summative evaluation. The project’s largest target audience is middle school learners (ages 11-14); specific activities are designed for Native American youth and informal science practitioners. Innovative outreach will engage youth underserved in science inspiring a new generation of scientists and investigative thinkers. The project’s professional development programs will build the capacity of informal educators to engage communities and communicate science. The Ice Worlds project is a collaboration among media producers Giant Screen Films, Natural History New Zealand, PBS, and Academy Award nominated film directors (Yes/No Productions). Additional collaborators include Northwestern University, The American Indian Science and Engineering Society, the Native American Journalism Association, a group of museum and science center partners, and a team of advisors including scientific and Indigenous experts associated with the NSF-funded Study of Environmental Arctic Change initiative.
The goals of the project are: 1) to increase public understanding of the processes and consequences of environmental change in polar ecosystems, 2) to explore the effectiveness of the giant screen format to impart knowledge, inspire motivation and caring for nature, 3) to improve middle schoolers’ interest, confidence and engagement in STEM topics and pursuits—broadly and through a specific program for Native American youth, and 4) to build informal educators’ capacity to share stories of climate change in their communities. The main evaluation questions are 1) to what extent does the Ice World film affect learning, engagement, and motivation around STEM pursuits and environmental problem solving 2) what is the added value of companion media for youth’s giant screen learning over short and longer term, and 3) what are the impacts of the culturally based Native American youth workshops.
The evaluation work will involve a Native American youth advisory panel and a panel of science center practitioners in the giant screen film’s development and evaluation process. Formative evaluation of the film will involve recruiting youth from diverse backgrounds, including representation of Native youth, to see the film in the giant screen theater of a partner site. Post viewing surveys and group discussions will explore their experience of the film with respect to engagement, learning, evoking spatial presence, and motivational impact. A summative evaluation of the completed film will assess its immediate and longer term impacts. Statistical analyses will be conducted on all quantitative data generated from the evaluation, including a comparison of pre and post knowledge scores. An evaluation of the Tribal Youth Media program will include a significant period of formative evaluation and community engagement to align activities to the needs and interests of participating students. Culturally appropriate measures, qualitative methods and frameworks will be used to assess the learning impacts. Data will be analyzed to determine learning impacts of the workshop on youth participants as well as mentors and other stakeholder participants. Evaluation of the community climate storytelling professional development component will include lessons learned and recommendations for implementation.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Despite the rich scientific evidence of adaptations and their evolutionary basis, there are concerning public misconceptions about evolution, processes of natural selection, and adaptations in the biodiverse world. Such misconceptions begin early. Younger elementary school children are often resistant to the idea that one “kind” of animal could descend from a completely different kind of animal, and they see features as having always existed. Other misconceptions lead to an inaccurate belief that changes in individual organisms acquired in a lifetime are passed directly on to offspring or that entire populations transform as a whole. These cognitive biases and "intuitive” misunderstandings can persist into adulthood. This Innovations in Development project will counter that narrative through an informal science project focusing on the blue whale one of nature’s most spectacular stories of adaptation. It is a species that lives life at extremes: a long-distance migrator, a deep diver, an extravagant eater, the largest animal to ever exist. With its awe-inspiring size and rich mosaic of anatomical, physiological, and behavioral specializations, it serves as a bridge to an enriched understanding of universal concepts in elementary biology and can begin to dispel the deeply rooted misconceptions. The project deliverables include a giant screen film documenting the field work of research scientists studying the blue whales in the Indian Ocean and Gulf of Mexico; multi-platform educational modules and programs that will build on the blue whale content from the film for use in science center programs and rural libraries; and professional development webinars that will offer content utilization and presentation skills for ISE facilitators. Project partners include California Science Center, STAR Library Education Network, HHMI Tangled Bank Studios and SK Films.
The external evaluation studies will gather data from 20 participating rural libraries and 6 science museums. A formative evaluation of the film will be conducted in a giant screen theater setting with 75 families. After viewing a fine-cut version of the film they will complete age-appropriate post-viewing surveys on the film’s engagement, storytelling, content appeal and clarity, and learning value in communicating key science concepts. An external summative evaluation will include three studies. Study 1 will assess the implementation of the project at the 26 organizations, addressing the question: To what extent is the project implemented as envisioned in the libraries and science center settings? Baseline information will be collected, and later partners will complete post-grant surveys to report on their actual implementation of the project elements. In addition, the study will examine outcomes relating to professional development. Study 2 will be an evaluation of the film as experienced by 400 youth and parents in science centers and examining the question: To what extent does experiencing the film engage youth and parents and affect their interest, curiosity, and knowledge of blue whales, adaptations, and the scientific process? Study 3 will examine: To what extent and how does experiencing an educational module (virtual field trips, hands on activities, augmented reality) affect youth and parents’ interest, curiosity, and knowledge of adaptations and scientific process?
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu