Skip to main content

Community Repository Search Results

resource evaluation Exhibitions
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
DATE:
TEAM MEMBERS: Karen Peterman Keshia Martin Jane Robertson Evia Sally Brummel Holly L. Menninger
resource research Public Programs
This paper attempts to reframe popular notions of “failure” as recently celebrated in the Maker Movement, Silicon Valley, and beyond. Building on Vossoughi et al.’s 2013 FabLearn publication describing how a focus on iterations/drafts can serve as an equity-oriented pedagogical move in afterschool tinkering contexts, we explore what it means for afterschool youth and educators to persist through unexpected challenges when using an iterative design process in their tinkering projects. More specifically, this paper describes: 1) how young women in a program geared toward increasing equitable
DATE:
TEAM MEMBERS: Jean Ryoo Nicole Bulalacao Linda Kekelis Emily McLeod Ben Henriquez
resource research Public Programs
Supporting more equitable participation in science, technology, engineering, and mathematics (STEM) remains a key, persistent educational challenge. This paper employs a sociological Bourdieusian lens to explore how equitable youth outcomes might be supported through informal science learning (ISL). Drawing on multimodal, ethnographic data from four case study youth aged 11–14 from two ISL programs, we identify four areas of practice that were enacted to a greater or lesser extent in the programs in support of equitable youth outcomes. We identify how the equitable potential of these practices
DATE:
TEAM MEMBERS: Louise Archer Spela Godec Angela Calabrese Barton emily dawson Ada Mau Uma Patel
resource research Media and Technology
Educational programming on digital video platforms such as YouTube wrestle with gender disparities in viewership. When men engage with science and technology content on digital platforms more than women, gender gaps in the understanding of, engagement with, and interest in STEM may intensify. Therefore, there is a critical need for more research aiming to aid in our understanding of these gender differences. This study provides evidence that the gender gaps may exist not in the use of YouTube itself, but with the engagement with science and technology content on the platform. Furthermore
DATE:
TEAM MEMBERS: Asheley Landrum
resource evaluation Media and Technology
With funding from the National Science Foundation, Secrets of the Universe (SOTU) is a multimedia project that has at its core a 40-minute 3D giant screen film directed by a collaboration of K2 Communications Inc., The Stephen Low Company, and University of California Davis Department of Physics. To support and extend the impact of the film for these audiences, the project features an educational website with a variety of resources, including online videos of science content and characters from the film. The independent evaluation team from Knight Williams Inc. conducted a summative
DATE:
TEAM MEMBERS: Valerie Knight-Williams Barbara Flagg Rachael Dobrowolski Dale McCreedy Divan Williams Jr.
resource project Public Programs
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.

This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE: -
TEAM MEMBERS: Ayana Allen-Handy Jacqueline Genovesi Loni Tabb
resource project Media and Technology
Despite decades of policies and programs meant to increase the representation of girls and women in science, technology, engineering, and mathematics (STEM), girls and women of color still represent a much smaller percent of the STEM workforce than they do in the US population. This lack of representation is preventing the US STEM workforce from reaching its true potential. Intersecting inequalities of gender, race, ethnicity, and class, along with stereotypes associated with who is successful in STEM (i.e., White men), lead to perceptions that they do not belong and may not succeed in STEM. Ultimately, these issues hinder girls’ STEM identity development (i.e., sense of belonging and future success), lead to a crisis of representation for women of color and have compounding impacts on the STEM workforce. Research suggests there are positive impacts of in-person STEM learning after-school and out-of-school time programs on girls’ sense of belonging. The increasing need for online learning initiated by the COVID-19 pandemic means it is vital to investigate girls’ STEM identity development within an online community. Thus, the project will refine and test approaches in online learning communities to make a valuable impact on the STEM identity development of girls of color by 1) training educators and role models on exemplary approaches for STEM identity development; 2) implementing a collaborative, girl-focused Brite Online Learning Community that brings together 400 girls ages 13-16 from a minimum of 10 sites across the United States; and 3) researching the impact of the three core approaches -- community building, authentic and competence-demonstrating hands-on activities, and interactive learning with women role models -- on participating girls’ STEM identities in online settings.

The mixed methods study is guided by guided by Carlone & Johnson’s model of STEM identity involving four constructs: competence, performance, recognition, and sense of belonging. Data collection sources for the quantitative portion of the project include pre- and post-surveys, while qualitative data sources will be collected from six case study sites and will include observations, focus group interviews with girls, artifacts created by girls and educators, educator interviews, and open-ended survey responses. This approach will enable the research team to determine how and the extent to which the Brite Online Learning Community influences STEM identity constructs, interpreting which practices lead to meaningful outcomes that can be linked to the development of STEM identity for participating girls in an online environment. The products of this work will include research-based, tested Brite Practices and a toolkit for fostering girls’ interest, identification, and long-term participation in STEM. The resulting products will increase the reach of informal STEM education programming to girls of color across the nation as online spaces can reach more girls, potentially increasing the representation of women of color in the STEM workforce.
DATE: -
TEAM MEMBERS: Roxanne Hughes Karen Peterson Abimbola Olukeye Qian Zhang
resource project Media and Technology
Few people realize that the largest part of our planet’s biosphere remains virtually unexplored and unknown. This enormous habitat, accounting for an area of 116 million square miles or the equivalent size of roughly 30 times the area of the United States, is the abyssal zone of the deep ocean. The abyssal sea floor, at about 6000 ft., contains more than four times as much habitat for animal life as all of the dry mountains, forests, deserts, plains and jungles combined. Microscopic larvae in the deep ocean, are essential for the renewal and replenishment of life and they repopulate areas damaged by human activities such as mining and trawling, and they make marine protected areas both feasible and important. The National Science Foundation has funded intensive studies of oceanography related to larval recruitment for decades. However, findings from this large NSF investment of personnel, technology and funding have never been widely presented to the public. This project proposes to remedy this by developing a 40 minute giant screen film to be shown in science centers across the country, supported by virtual reality and augmented reality learning tools. The film will cover select deep ocean science expeditions using the deep-sea vehicles Alvin and ROV Jason. Content will include elements of the research process, activities related to the design and operation of deep-sea vehicles as well as interviews with scientists and technologists. The companion activities, Deep-Ocean Pilot (a VR-360° viewing station) and Plankton Quest (an AR biology treasure hunt) will extend the audience experience of the deep ocean out of the giant screen theater and into the surrounding museum environment. The website and social media will extend awareness and resources into homes. The project will be appropriate for a broad general audience, with particular appeal for the target audience of women and girls (ages 7-20). The larval biologist team is led by the PI at the University of Oregon, in collaboration with scientists from North Carolina State University, Western Washington University and the University of Rhode Island. Several young women scientists will be featured in the film providing role models. The production company, Stephen Low Productions, Inc. will use the latest technology on the Alvin and other cinematic tools to capture the visual images in the abyss. Collaborating museums will participate in the development and implementation of the Virtual and Augmented Reality learning tools as well as showing the film in their theaters.

Broader impact project goals include 1) Advancing public awareness of the abyssal ocean, the role of microscopic larvae, and what scientists are learning from expeditions that use deep submergence technologies; 2) Introducing public audiences and young women specifically to the wide range of STEM-related occupations encompassed in the field of ocean exploration and research; and 3) Advancing STEM learning research and practice in the area of immersive media in conveying STEM concepts and enhancing audience identification with STEM. Oregon State University’s STEM Research Center will build new knowledge by conducting formative and summative evaluation of the film and its associated support products (e.g., Virtual and augmented reality activities, website resources), addressing the following evaluation questions: 1)What do audiences take away from their experience in terms of fascination/interest, awareness and understanding related to ocean science exploration? 2) To what degree does the film alone or in combination with supplemental experiences trigger career awareness in girls and young women, and youth of racial/ethnic backgrounds? 3) To what degree do immersive experiences (a sense of “being there”) contribute to learning from the film? 4) How enduring are outcomes with audiences past the onsite immediate experience? Formative evaluation will be designed as ongoing improvement informed by empirical evidence in which evaluators work with team members to answer decision-relevant questions in a timely and project-focused way. The summative evaluation will be structured as an effectiveness study using mixed methods and ascertaining whether key programmatic outcomes have been reached and the degree to which particular program elements will have contributed to the results.
DATE: -
TEAM MEMBERS: Craig Young Alexander Low Stephen Low George von Dassow Trish Mace
resource project Media and Technology
Engineering is arguably one of the most critical skills in any society, from building bridges and homes, to designing cell phones and life-saving medical devices. Yet many Americans do not consider engineering to be essential or relevant to their everyday lives, and may even question its positive impact on society. While there have been gains in the number of women and underrepresented minorities in STEM professions over the past few decades, their numbers in the field remain disproportionately low. The Built World integrated multimedia and research project therefore aims to expand access to engineering content through the lens of “inclusive engineering,” which highlights how problem-solvers of all ages, genders, backgrounds, and perspectives approach and overcome challenges to innovate. The project applies this concept through the creation of Built World, a three-hour documentary series for broadcast on PBS stations nationwide, and a complementary interactive escape game streamed live on Twitch, where individuals of all ages and backgrounds can play and solve engineering challenges together. There is a need for effective remote and virtual interaction to support informal STEM learning, and live streaming game platforms present a promising approach to filling this need. Built World is poised to advance the field through: (1) content - creating high-quality inclusive engineering content across multiple platforms to reach a wide audience (Built World documentary, digital reporting and short form videos, community outreach campaign); (2) applied research - designing and studying how live-streaming, collaborative platforms can serve as safe and inclusive spaces for engineering learning; and (3) best practices - exploring how audiences engage with inclusive engineering on different platforms—a traditional documentary format (Built World) versus an interactive, collaborative space (Twitch game)—and identifying what learning outcomes might be expected on each.

A three-phase research design aims to understand what motivates users to engage with STEM content on Twitch; how to define and measure learning outcomes associated with the platform; and how to mitigate the risk of toxic environments in online communities by fostering safe spaces for a diversity of gamers. Phase 1 informs the initial design of the Twitch game and audience interaction strategies and seeks to answer: What is the best way to measure informal learning on Twitch? What is the best way to design a Twitch channel to create an inclusive space while optimizing learner engagement? Phase 2 is the core focus of the research and uses a semi-experimental design to answer questions such as: Is there evidence of learning on Twitch, and what type of learning is happening? What is the digital culture that emerges? Phase 3 assesses the pairing of the documentary series with the Twitch game to maximize informal STEM learning and is guided by questions such as: How does inclusive engineering content presented on two platforms (Twitch game and Built World series) mediate learning outcomes? How does inclusive engineering content presented on two platforms shape learners’ experiences of inclusivity and belonging? Knowledge generated through the Built World project will offer tools and best practices to other STEM media producers so that they may also leverage live streaming platforms for learning.
DATE: -
TEAM MEMBERS: Chris Schmidt
resource project Media and Technology
Data is increasingly important in all aspects of people’s lives, from the day-to-day, to careers and to civic engagement. Preparing youth to use data to answer questions and solve problems empowers them to participate in society as informed citizens and opens doors to 21st century career opportunities. Ensuring equitable representation in data literacy and data science careers is critical. For many girls underrepresented in STEM, developing a "data science identity" requires personally meaningful experiences working with data. This project aims to promote middle school-aged girls’ interest and aspirations in data science through an identity-aligned, social game-based learning approach. The goals are to create a more diverse and inclusive generation of data scientists who see data as a resource and who are equipped with the skills and dispositions necessary to work with data in order to solve practical problems. The research team will run 10 social clubs and 10 data science clubs mentored by women in data science recruited through the University of Miami’s Institute for Data Science and Computing. Participants will be 250 middle school-aged girls recruited in Miami, FL, and Yolo County, CA, through local and national girls’ organizations. Youth will participate in a data science club and will learn key data science concepts and skills, including data structures, storage, exploration, analysis, and visualization. These concepts will be learned from working with their own data collected in personally meaningful ways in addition to working with data collected by others in the same social game eco-system. The project will also develop facilitator materials to allow adult volunteers to create game-based informal data science learning experiences for youth in their areas. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments and is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST), which seeks to engage underrepresented students in technology-rich learning environments, including skills in data literacy, and increase students’ knowledge and interest in information and communication technology (ICT) careers.

Researchers will focus on two primary research questions: 1) Across gameplay and club experiences, in what ways do participants engage with data to pursue personal or social goals? 2) How do gameplay and club experiences shape girls’ perceptions of data, data science, and their fit with data and data science? The project will use design-based research methods to iteratively design the game and social club experiences. To ensure that uses of data feel personally and socially meaningful to young girls, the virtual world’s goals, narratives, and activities will be co-designed with girls from groups underrepresented in data science. The project will research engagement with game data in two informal, game-based learning scenarios: organic, self-directed, social play club, and structured, adult-facilitated data science clubs. The research will use a combination of quantitative and qualitative methods including surveys, focus groups, interviews, and gameplay and club observations. Project evaluation will determine how gameplay and club experiences impact participants' attitudes toward and interest in data-rich futures. The project holds the potential for broadening participation and promoting interest in data science by blending game-based learning with the rich social and adult mentoring through club participation. The results will be disseminated through conference presentations, scholarly publications, and social media. The game and facilitator materials will be designed for dissemination and made freely available to the public.
DATE: -
TEAM MEMBERS: Lisa Hardy Gary Goldberger Jennifer Kahn
resource project Exhibitions
Artificial intelligence (AI) is in many of our everyday activities—from unlocking phones to running Internet searches to parking cars. Yet, most instruction on how AI works is only in computer science courses. The unique role that AI plays in making decisions that affect human lives heightens the need for education approaches that promote public AI literacy. Little research has been done to understand how we can best teach AI in informal learning spaces. This project will engage middle school age youth in learning abouts AI through interaction with museum exhibits in science and technology centers. The exhibits employ embodied interactions and creative making activities that involve textiles, music making, and interactive media. The research will build on three exhibit prototypes that teach about concepts including bias in data in machine learning, AI decision-making processes, and how AI represents knowledge. Female-identifying and Title 1 youth will be recruited as participants during the exhibit design iterations and testing. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments

Researchers will explore two key research questions: 1) How can the design of interactive museum exhibits encourage interest development in and learning about AI among learners without a Computer Science background by using embodiment and creative making? and 2) How do embodied interaction and creative making mediate learning about AI in informal learning environments? The project will take a design-based research approach, iteratively building on existing exhibit prototypes and testing them in-situ with learners. Data sources and modes of analysis will include retrospective surveys to assess interest, content knowledge gain, creativity, learning talk analysis of audio recordings, and coding of embodied movements in video recordings. Learning talk analysis will identify instances of joint sensemaking during naturalistic interactions with our exhibit to reveal connections between sensemaking talk; learners' behaviors and embodied actions during real-time collaborative knowledge building; and outcomes in knowledge, interest, and creativity measures as elicited in retrospective surveys. The final set of exhibits will be rigorously evaluated with over 500 museum visitors. The key contributions of this work will include a set of rigorously tested exhibits, publicly available exhibit designs, a set of design guidelines for developing AI literacy museum exhibits, and an improved understanding of the relationship between AI-related learning and interest development, embodiment, and creativity.
DATE: -
TEAM MEMBERS: Brian Magerko Duri Long Jessica Roberts
resource project Media and Technology
In both the STEM media and entertainment sectors women are significantly unrepresented. Women account for only 21% of the upper-level positions in film (directors, writers, executive producers, cinematographers, etc.) according to a recent study. This small conference directly addresses how to expand the volume of STEM focused media and entertainment content centered on women and girls. The Creative Workforce Summit: Women Storytellers Explore STEM will be held in New York City and online (hybrid) in September 2022. The goal of the conference is to 1) encourage an infrastructure of support for the creation and distribution of informal STEM educational film, digital, and television content that is centered on women and girls and 2) to strengthen ties between women in media, entertainment, and women in STEM fields. The agenda includes keynote addresses by thought leaders in STEM disciplines and media, panels of industry leaders, a youth journalist interviews, and film screenings with filmmaker and scientist Q&As. The conference will be a hybrid event to allow for the greatest access to a broader audience. The projected 300 in-person and 1000+ virtual attendees will be drawn from New York Women in Film and Television’s extensive membership and 100+ partner organizations in entertainment and media, including Black Public Media, Brown Girls Doc Mafia, Firelight Media, ReelAbilities, and the National Association of Latino Independent Producers. The conference will be followed by a publication based on the convening featuring the keynotes, abridged panel discussions, additional interviews, and industry representation data analysis. In addition, a curriculum guide for high schools and colleges focused on STEM and film collaborations will be developed and distributed.

A post conference quantitative survey will be conducted with conference participants to gather data on the impacts of the conference. Questions to be asked include: What new professional connections were made by women attending the conference? What was learned related to the craft of STEM related media production and distribution? Were new and meaningful connections made with participants outside the participant’s current field/networks? Additional analysis will be done by the organizers of the conference in planning post-conference strategies for supporting and building the women in STEM infrastructure.
DATE: -
TEAM MEMBERS: Cynthia Lopez