Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey;1 and analyzing data collected through both the survey2 and Pathable, the virtual platform.
The meeting specifically focused on inviting and including community partners, and on
The Detroit Zoo will partner with community-based organizations serving youth in metropolitan Detroit to implement a program to develop and present remote STEM programming for students in this area, targeting low- to moderate-income students of color. Staff from the zoo and three afterschool programs (American Institutional Management Services, Arab Community Center for Economic and Social Services, and Boys and Girls Clubs of Southeast Michigan) will participate in professional development workshops on virtual, inquiry-based, humane STEM education. They will then utilize skills developed in the workshops to develop and lead virtual education programming for a total of 24 groups of 20 middle school youth.
The University of Montana will create “Transforming Spaces” to foster a more inclusive, culturally responsive space for Missoula’s urban Indian population and to better meet the community’s needs. The project will explore cross-cultural, collaborative approaches to STEM and Native Science. In collaboration with Montana’s tribal communities, the museum’s education team and advisory groups will design and implement hands-on activities that engage visitors with Native Science. The project will engage tribal role models and partner with tribal elders to create a library of videos for tribal partners, K–12 schools, and organizations. The project will offer teachers professional development designed to fulfill the statewide mandate of Indian Education for All. The exhibit will connect Native and non-Native museum visitors, close opportunity and achievement gaps, and ensure that all Missoula children feel a sense of belonging in museums, higher education, and STEM.
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
DATE:
-
TEAM MEMBERS:
Jessie Herbert-Meny
resourceprojectProfessional Development, Conferences, and Networks
Growth in the US Latinx population has outpaced the Latinx growth in science, technology, engineering, and math (STEM) degrees and occupation, further widening the ethnic gap in STEM. Mathematics has often identified as a bottleneck keeping many youth, especially minoritized youth, from pursuing STEM studies. Unequal opportunities to develop powerful math assets explain differences in math skills and understanding often experienced by minoritized youth. Implementing culturally responsive practices (CRP) in afterschool programs has the potential to promote math skills and motivation for youth from minoritized groups. However, extensive research is needed to understand which culturally responsive informal pedagogical practices (CIPPs) are most impactful and why. This project aims to identify and document such practices, shed light on the challenges faced by afterschool staff in implementing them, and develop training resources for afterschool staff to address these challenges. This project is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The fundamental research questions addressed by the project focus on (1) which CIPPs matter most in the context of a STEM university-community partnership engaging Latinx youth, and (2) in what context(s) and under what conditions do these CIPPs relate to positive outcomes for both youth participants and college mentor/facilitator. A third aim is to build capacity of afterschool staff for implementing CIPPs in informal STEM afterschool programs. The first two aims are addressed through a mixed-methods research study which includes quantitative surveys and qualitative in-depth interviews with five cohorts of adolescent participants, parents, and undergraduate mentors. Each year, surveys will be collected from adolescents and mentors at four time points during the year; the in-depth interviews will be collected from adolescents, parents, and mentors in the spring. In total, 840 adolescents and 210 mentors will be surveyed; and 87 adolescents, 87 parents, and 87 mentors will be interviewed. The third aim will be addressed by leveraging the research findings and the collective knowledge developed by practitioners and researchers to create a public archive containing documentation of CIPPs for informal STEM afterschool programs and training modules for afterschool staff. The team will disseminate these resources extensively with informal afterschool practitioners in California and beyond. Ultimately, this project will lead to improved outcomes for minoritized youth in informal STEM afterschool programs across the nation, and increased representation of minoritized youth in STEM pursuits.
DATE:
-
TEAM MEMBERS:
Alessandra PantanoSandra SimpkinsCynthia Sanchez Tapia
resourceprojectProfessional Development, Conferences, and Networks
Data science is ever-present in modern life. The need to learn with and about data science is becoming increasingly important in a world where the quantity of data is constantly growing, where one’s own data are often being harvested and marketed, where data science career opportunities are rapidly increasing, and where understanding statistics, data sources, and data representation is integral to understanding STEM and the world around us. Museums have the opportunity to play a critical role in introducing the public to data science concepts in ways that center personal relevance, social connections and collaborative learning. However, data science and statistics are difficult concepts to distill and provide meaningful engagement with during the brief learning experiences typical to science museums. This Pilot and Feasibility study brings together data scientists, data science educators, and museum exhibit designers to consider these questions:
What are the important data science concepts for the public to explore and understand in museum exhibits?
How can museum exhibits be designed to support visitors with diverse backgrounds and experiences to engage with these data science concepts?
What principles can shape these designs to promote broadening participation in data science specifically and STEM more broadly?
This Pilot and Feasibility project combines multidisciplinary expert convening, feasibility testing, and early exploratory prototyping around the focal topic of data science exhibits. Project partners, TERC, the Museum of Science, Boston, and The Tech Interactive in San Jose will engage in an iterative process to develop a theoretical grounding and practical guidance for museum practitioners. The project will include two convenings, bringing together teams of experts from the fields of data science, data science education and museum exhibit design. Prior to the first convening, an initial literature summary and a survey of convening participants will be conducted, culminating in a preliminary list of big ideas about data science. Periodically, participants will have the opportunity to rank, annotate and expand this list, as a form of ongoing data collection. During the convenings, participants will explore the preliminary list, share related work from the three disciplines, engage with related data science activities in small groups, and work together to build consensus around promising data science topics and approaches for exhibits. Participant evaluation will allow for iterative improvement of the convenings and the capture of missed points or overlooked topics. After each convening, museum partners will create prototypes that respond to the convening conversations. Prototypes will be pilot tested (evaluated) with an intentionally recruited group of families that includes both frequent visitors and those who are less likely to visit the museum; diversity in terms of race, languages and dis/ability will be reflected in selection. Pilot data collection will consist of structured observations and interviews. Results from the first round of prototyping will be shared with convening participants as a way to modify the list of big ideas and to further interrogate the feasibility of communicating these ideas in an exhibit format. Results from the convenings and from both rounds of prototyping will be combined in a guiding document that will be shared on all three partner websites, and more broadly with the informal STEM learning field. The team will also host a workshop for practitioners interested in designing data science exhibits, and present at a conference focused on museum exhibits and their design.
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
Creating science education that can contribute to cultivating just, culturally thriving, and sustainable worlds is an important issue of our time. Indigenous peoples have persistently been under-represented in science reproducing inequalities in a myriad of ways from educational attainment, participation in and contributing to innovations in foundational knowledge, to effective policy making that upholds and respects Indigenous sovereignty. The development of models of science education that attend to intersections of knowledge and development, socio-scientific decision-making and civic leadership, and the complexities and contradictions of these realities, is imperative. This five-year Innovations in Development project broadens participation and strengthens infrastructure and capacity for Indigenous learners to meet, adapt to, and lead change in relation to the socio-ecological challenges of the 21st century. The project engages multi-sited community-based design studies to develop and research the impacts of Indigenous informal field-based science education with three Indigenous leadership communities from the Pacific Northwest and the Great Lakes. This project will have broader impacts through model development, building infrastructure to transform the capacity of informal field-based science education, and will produce cutting edge foundational knowledge about pressing 21st century issues with a particular focus on Indigenous communities. The project increases Indigenous participation in research through 1) engagement of Indigenous community members as research assistants, 2) training of Indigenous graduate fellows, and post-doctoral fellows, and 3) supporting the careers of more junior Indigenous scholars.
This research seeks to identify key design features of an Indigenous field (land/water) based model of science education and to understand how learners’ and educators’ reasoning, deliberation, decision-making, and leadership about complex socio-ecological systems and community change evolve in such learning environments. The project also examines key aspects of co-design and partnership with Tribal communities and how these methods of co-production of new science enable new capacities for systems transformation. This multi-layered project is organized through 3 panels of studies including: Panel 1) community-based design experiments to develop and refine a model of Indigenous informal science education; Panel 2) co-design and implementation of professional learning programs for Indigenous informal science education; and Panel 3) foundational studies in cognition and learning with respect to socio-ecological systems thinking and the impact on learning and instructional practices. Of particular importance in this research is the rigorous development and articulation of effective pedagogical practices and orientations. More broadly, findings will have clear implications for theories of cognitive development, deliberation and environmental decision making and especially those pertaining to how knowledge is shaped by culture and experience.
This project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Filiberto Barajas-LopezAnna LeesMegan BangAnna LeesFiliberto Barajas-Lopez
resourceprojectProfessional Development, Conferences, and Networks
Among scientists, science communication is an increasingly important area of practice, scholarship, and research, especially with early career scientists. The growing interest in combating widespread disinformation and inaccurate public perception of science has increased demand for training in science communication; however, there is a significant gap in both research and training for scientists from diverse racial and ethnic cultural backgrounds. The project will address this knowledge and research gap by applying intercultural communication theory to the design, development, and testing of a new curriculum that will provide evidence-based methods to make science communication trainings inclusive and intersectional. The curriculum will be designed and evaluated to build capacity among science communication trainers and practitioners. Sixty pre-tenure environmental science faculty of diverse racial and ethnic backgrounds will be trained in strategic science communication skills using cultural perspectives and academic goals in science communication. The project will gather research data in collaboration with the national SciComm Trainers Network. In addition to advancing science communication research, training, and practice, the project will implement a novel, peer-reviewed podcast for broader impact. The project Fellows will be prepared to engage in a wide range of science communication activities throughout their careers and lead related efforts at their home institutions. Following a final workshop to develop culturally responsive guidance for science communication trainers, the project team will share findings to the field to inform future practice and societal impacts from advancing culturally relevant science communication in training programs. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
The project will address two significant gaps in science communication and intercultural communication research. First, despite the recognition that more research about race and ethnicity is needed in science communication, few studies have been conducted. Second, while findings on intercultural communication research are consistent across fields, such as health communication and business communication, the research has yet to examine how well-established theories in this area of study apply to the unique norms and processes of science. Investigators will test a novel theoretical framework grounded in two intercultural communication theories: identity negotiation theory and communication accommodation theory. The project will test the extent to which the professional norms and processes of STEM and academia relate to cultural norms and communication styles of underrepresented racial and ethnic minority scientists, and how these factors influence their science communication efforts. The project will use a mixed methods approach including in-depth interviews and surveys. The results of the study will be used to develop and adapt culturally tailored science communication training for 60 pre-tenure environmental science faculty from underrepresented groups. The results of the project will provide evidence to make science communication training and practice more inclusive and effective. The collaboration with the national SciComm Trainers Network will ensure broad dissemination and professional application of project findings. The project will increase representation of racial and ethnic minority scientists as science communicators, including in environmental news coverage; provide a new peer-reviewed podcast series for public audiences that will introduce listeners to environmental research through a culturally responsive lens; provide tested methods for designing inclusive and effective science communication training curricula; and will inform faculty efforts to incorporate science communication activities as part of career advancement.
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
resourceprojectProfessional Development, Conferences, and Networks
Millions of Latinx youth, aged 14 to 18, work formal or informal jobs to provide income for themselves or their families. In the context of these workplaces, Latinx youth demonstrate numerous skills that are essential to industrial engineering, such as minimizing workplace injuries or optimizing processes to maximize efficiency. However, their workplace ingenuity and skills are often underrecognized by educational systems. To counter this lack of recognition, the purpose of this project is to iteratively develop and research an out-of-school engineering program for working Latinx youth. This program is designed to recognize and build from youths’ workplace experiences by connecting them with industrial engineering concepts and practices, such as those used to promote worker safety. This program is also designed for youth to articulate transformational visions of industrial engineering, which expand current goals, values, and methods commonly embraced within this discipline. This year-long program will be facilitated by educators of existing out-of-school programs (e.g., Mathematics, Engineering, and Science Achievement), in partnership with undergraduate mentors from the Society for Professional Hispanic Engineers and other local organizations that serve Latinx youth (e.g., Latinos in Action). Approximately 220 youth are expected to participate in the programming. Researchers will explore whether and how youth participants develop identities in engineering, as well as how the educators and mentors understand and enact assets-based, out-of-school engineering education grounded in youths’ experiences. Researchers will also identify the individual, institutional, and systemic factors that support or inhibit sustained implementation of the program over time in different sites and contexts. This project will result in a set of empirically tested, bilingual program materials that will be disseminated widely to professional organizations dedicated to out-of-school programming and to serving Latinx youth.
This project will result in a localizable, transferable, and sustainable model for an out-of-school time program that recognizes and amplifies Latinx youths’ workplace funds of knowledge and leverages them toward youth-driven visions and applications of engineering. This program, which will connect with other people and sites in youths’ learning ecosystems, is grounded in principles of translanguaging, transformational mentorship, and educational dignity and recognition. In partnership with youth participants, researchers will use a social design experiment to explore the following research questions: What are the engineering identity trajectories of working high school youth, and how do specific moments of identity negotiation and recognition relate to broader patterns across program sessions and identity trajectories for individual participants over time? To answer these questions, a pre-, mid- and post-program Engineering Identity Scale; recordings of program implementations; interviews; and youth artifacts will be analyzed using various methods such as critical multimodal discourse analysis. After implementations of the program across multiple sites, researchers will use design-based implementation research to answer the following questions: How do educators and mentors understand and enact assets-based pedagogies designed to foster recognition across sites? What institutional and systemic features (designed or naturalistic) support or inhibit productive adaptations and implementations of the program? These questions will be answered using constant comparative analyses of data sources such as interviews with the program educators and mentors, observations of program implementations, observations of professional development sessions, and public documents. Culturally responsive, educative evaluation will be used to iteratively improve the program. The resulting research and program materials will be disseminated widely through professional organizations dedicated to Latinx youth, engineering education, and out-of-school learning.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Amy Wilson-LopezAlfonso Torres-RuaMarisela Martinez-ColaColby Tofel-GrehlAlfonso Torres-Rua
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.