This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
Arizona State University, in partnership with the National Informal STEM Education Network, will build fieldwide capacity for sustainability by empowering professionals, engaging public audiences, and leveraging museum and community assets to help build a sustainable future for people and the planet. The project will engage 90 museum professionals in a six-month professional development program, who along with other staff at their organizations will receive support in planning, developing, and/or implementing a sustainability-related project that aligns with their museum’s mission and their community’s priorities. A community of practice will promote ongoing learning and sharing of experiences among program participants. Additional professionals across the museum field will benefit from an online workshop series and other resources produced by the project.
The goal of this project is to understand and support the development of evidence-based public engagement with science (PES) strategies within STEM research organizations. It specifically seeks to understand how scientists, institutional leaders, and staff within the NSF’s Long Term Ecological Research (LTER) Network make decisions about the design and implementation of PES activities. The LTER Network includes 28 varied sites across North America and provides a unique opportunity to study PES decision-making within scientific organizations. The project is especially interested in the degree to which these types of organizations consider the interests and assets of local communities, including underrepresented communities. This project will lead to increased capacity for effective, evidence-based PES in an essential sector of the nation’s STEM research infrastructure. The project is a collaboration between PES practitioners within the LTER Network and PES researchers at Michigan State University and Oregon State University.
The project will address three primary research questions: (1) How do scientists, institutional leaders, and staff view and make decisions about the design and implementation of PES? (2) To what degree do PES activities and PES strategies consider the interests and assets of local communities, including those underrepresented in STEM? (3) How, and to what degree, can scientists, institutional leaders, and staff develop shared PES strategies aimed at enhancing reciprocal exchanges and ongoing relationships with communities? The project design includes: (a) surveys and interviews with LTER scientists, institutional leaders, and staff; (b) case studies coupled with strategic engagement planning to investigate the community contexts of PES; (c) a PES working group with LTER scientists and PES-related staff to integrate research and practice; (d) a PES monitoring system for tracking PES activities at LTER sites; and (e) an external advisory board of PES experts and representatives of other STEM research organizations to promote accountability of the work and broaden its impact beyond the LTER Network. The overall hypothesis is that it is possible to improve the effectiveness of PES through a focus on helping scientific organizations develop PES strategies in collaboration with relevant communities.
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
resourceprojectProfessional Development, Conferences, and Networks
Diversity, equity, access, inclusion, and belonging-related change is often difficult to achieve in organizations. In the context of Informal STEM Learning (ISL), this results in inequitable opportunities for both ISL professionals and learners to engage in STEM environments and experiences. For people to thrive in these settings, creative and innovative approaches that address historical and current realities of intersectional marginalization and inequitable norms within informal STEM institutions are necessary to disrupt conventions, institutional barriers, and patterns of inequities. TERC and the Detroit Zoological Society will develop and implement an ISL Equity Resource Center (the Center). The Center will advance equity within the ISL field by cultivating a multi-sector, diverse learning community that designs and conducts evidence-based research and practice, including but not limited to equity-focused leadership, decision-making, theory, methods, project topic selection and design, and budget management.
The Center will cultivate lasting change in the ISL and broader STEM learning ecosystem via (a) sharing more inclusive, culturally relevant, and responsive ISE research and practice; (b) identifying scalable, equity-focused research findings useful in ISL programming; and (c) promoting greater public awareness of the importance of broadening participation in STEM. The Center's primary stakeholders are ISL professionals, including researchers, practitioners, and evaluators. The Center will maintain and expand a digital infrastructure to support innovation and sharing across the ISL field. Through its combined efforts, the Center will raise the visibility and impact of ISL equity-focused research and practice and its contributions to the overall STEM endeavor. The Center will also organize and host the biennial AISL Awardee Meeting. The Center is funded by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Stephen AlkinsDiane MillerLisette Torres-GeraldPati Ruiz
resourceresearchProfessional Development, Conferences, and Networks
One of the many ways that scientific societies and associations aim to support and encourage public and civic engagement among their membership is by conferring awards to those who excel in these areas. This report describes research designed to better understand this class of awards (referred to throughout this report as “engagement awards,” though the awards themselves are often described as recognizing a variety of activities, including science communication, advocacy, engagement, outreach, public service, and community- or publicly-engaged research). Specifically, we explore the kinds of
DATE:
TEAM MEMBERS:
Emily HowellRose HendricksNiveen AbiGhannamTimothy EatmanAnthony Dudo
The Da Vinci Science Center will expand its Women in Science and Engineering Network by partnering with community organizations, colleges, and universities to enhance the STEM learning and support ecosystem for women and girls in the Lehigh Valley and surrounding communities in eastern Pennsylvania. The museum will assess the needs of K-12 girls, undergraduate women, and women in STEM employment, and map opportunities for cross-sector collaborations to support them. The project team will identify marketing and recruitment messages that encourage STEM-interested girls and women to participate in programs and follow developmental pathways within a STEM learning ecosystem. Based on identified needs and messages, the museum will pilot and evaluate new STEM programs for girls and women, and train educators and mentors to sustain this work.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The project is building a nationwide online coaching/mentoring program for out of school educators in rural settings.
Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
Access & opportunity in STEM remain limited for youth from historically underrepresented backgrounds in the US & UK. We present findings grounded in Participatory Ethnographies into STEM pathways, highlighting how youth participate in ISL across time and settings in equitable and transformative ways, and practices that ISL practitioners engage in towards supporting pathway authoring. We take a pathways lens to highlight the multiple directions one may take through a particular ecology towards a wide range of outcomes beyond the STEM career, such as STEM agency and identities. Our study
This 4-year project addresses fundamental equity issues in informal Science, Technology, Engineering and Mathematics (STEM) learning. Access to, and opportunities within informal STEM learning (ISL) remain limited for youth from historically underrepresented backgrounds in both the United States and the United Kingdom. However, there is evidence that ISL experiences can expand opportunities for youth learning and development in STEM, for instance, increase positive attitudes towards educational aspirations and future careers/pursuits, improve grades and test scores in school settings, and decrease disciplinary action and dropout rates. Through research and development, this project brings together researchers and practitioners to focus on the experiences, practices and tools that will support equitable youth pathways into STEM. Working across conceptual frameworks and ISL settings (e.g. science centers, community groups, zoos) and universities in four urban contexts in two different nations, the partnership will produce a coherent knowledge base that strengthens and expands research plus practice partnerships, builds capacity towards transformative research and development, and develops new models and tools in support of equitable pathways into STEM at a global level. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This Equity Pathways project responds to three challenges at the intersections of ISL research and practice in the United States and the United Kingdom: 1) lack of shared understanding of how youth from historically underrepresented backgrounds perceive and experience ISL opportunities across national contexts, and the practices and tools needed to support empowered movement through ISL; 2) limited shared understanding and evidence of core high-leverage practices that support such youth in progressing within and across ISL, and 3) limited understanding of how ISL might be equitable and transformative for such youth seeking to develop their own pathways into STEM. The major goal of this Partnership is for practitioners and researchers, working with youth through design-based implementation research, survey and critical ethnography, to develop new understandings of how and under what conditions they participate in ISL over time and across settings, and how they may connect these experiences towards pathways into STEM. The project will result in: 1) New understandings of ISL pathways that are equitable and transformative for youth from historically underrepresented backgrounds; 2) A set of high leverage practices and tools that support equitable and transformative informal science learning pathways (and the agency youth need to make their way through them); and 3) Strengthened and increased professional capacity to broaden participation among youth from historically underrepresented backgrounds in STEM through informal science learning. The project will be carried out by research + practice partnerships in 4 cities: London & Bristol, UK and Lansing, MI & Portland, OR, US, involving university researchers (University College London, Michigan State University, Oregon State University/Institute for Learning Innovation) practitioners in science museums (@Bristol Science Centre, Brent Lodge Park Animal Centre, Impressions 5, Oregon Museum of Science & Industry) and community-based centers (STEMettes, Knowle West Media Centre, Boys & Girls Clubs of Lansing, and Girls, Inc. of the Pacific Northwest).
This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal