The Wild Center has been running climate programs for over a decade and has embraced a culture of evaluation in its work to reflect on and improve the programs over time. This evaluation built on findings from prior evaluations to further explore the programs’ impact on rural youth and teachers, but also sought to understand broader contributions to the ecosystem of organizations doing climate resilience work across New York state and around the country.
This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
The Da Vinci Science Center will expand its Women in Science and Engineering Network by partnering with community organizations, colleges, and universities to enhance the STEM learning and support ecosystem for women and girls in the Lehigh Valley and surrounding communities in eastern Pennsylvania. The museum will assess the needs of K-12 girls, undergraduate women, and women in STEM employment, and map opportunities for cross-sector collaborations to support them. The project team will identify marketing and recruitment messages that encourage STEM-interested girls and women to participate in programs and follow developmental pathways within a STEM learning ecosystem. Based on identified needs and messages, the museum will pilot and evaluate new STEM programs for girls and women, and train educators and mentors to sustain this work.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The Rural Activation and Innovation Network (RAIN) project aims to engage, support and better understand rural communities in:
Changing perceptions of the importance of STEM Learning
Leveraging of local STEM resources and expertise with Rural Innovation Councils (RICs)
Strategic Planning embedding asset maps, gap analysis, budget, media, and communication.
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Maker Education scholarship is accumulating increasingly complex understandings of the kinds of learning associated with maker practices along with principles and pedagogies that support such learning. However, even as large investments are being made to spread maker education, there is little understanding of how organizations that are intended targets of such investments learn to develop new maker related educational programs. Using the framework of Expansive Learning, focusing on organizational learning processes resulting in new and unfolding forms of activity, this paper begins to fill
This Smart and Connected Community (SCC) project will partner with two rural communities to develop STEMports, an innovative Science, Technology, Engineering and Mathematics (STEM) learning game for workforce development. The game's activities will take players on localized Augmented Reality (AR) missions to both engage in STEM learning challenges and discover emerging STEM careers in their community, specifically highlighting innovations in the fields of sustainable agriculture and aquaculture, forest products, and renewable energy. Community Advisory Teams (CATs) and co-design teams, including youth, representatives from the targeted emerging STEM economies, and decision-makers will partner with project staff to co-design STEMports that reflect the interests, cultural contexts, and envisioned STEM industries of the future for each community.
The project will: (a) design and pilot an AR game for community STEM workforce development; (b) develop and adapt a community engagement process that optimizes community networking for co-designing the gaming application and online community; and (c) advance a scalable process for wider applications of STEMports. This project is a collaboration between the Maine Mathematics and Science Alliance and the Field Day Lab at the University of Wisconsin-Madison to both build and research the co-designing of a SCC based within an AR environment. The project will contribute knowledge to the informal STEM learning, community development, and education technology fields in four major ways:
Deepening the understanding of how innovative technological tools support rural community STEM knowledge building as well as STEM identity and workforce interest.
Identifying design principles for co-designing the STEMports community related to the technological design process.
Developing social network approaches and analytics to better understand the social dimensions and community connections fostered by the STEMport community.
Understanding how participants' online and offline interactions with individuals and experiences builds networks and knowledge within a SCC.
With the scaling of use by an ever-growing community of players, STEMports will provide a new AR-based genre of public participation in STEM and collective decision making. The research findings will add to the emerging literature on community-wide education, innovative education technologies, informal STEM learning (especially place-based learning and STEM ecosystems), and participatory design research.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In the 1990s, Science Cafes emerged that brought together people from all walks of life with scientists in conversation over science, technology, engineering, and mathematics (STEM) topics. The cafes were popular as conversations were informal in casual settings and engendered deep discussions. In 2007, Science Education Solutions received a grant from NSF and began an experiment to see if the adult science café model could be adapted to appeal to high school teens. The program, Café Scientifique New Mexico, became very popular with teens in towns across northern New Mexico. The blend of conversing with scientists about interesting science topics in an out-of-school social setting and digging deeper with hands on activities proved successful. The teen model was refined through trial and error and formal evaluation over several years. Today it continues to provide teens with a new perspective on the nature of science and a picture of scientists as real people leading interesting lives. The Teen Science Café Network (TSCN) was formed in 2012 with NSF funding to allow other individuals and organizations to start their own versions of the Teen Science Café, adapted to their local institutions and demographics. Five founding member organizations around the United States formed the initial Network and each began creating their own Teen Science Café programs. Today the TSCN is a dynamic, growing community of practice spread across the country with the mission of connecting high school teenagers with STEM and STEM experts via the science café model. The network currently has approximately 133 member organizations in 46 states and Canada. This project will move the network to a much larger scale by creating organization and professional support structures to create a strategically growing social movement with distributed leadership, organizational infrastructure, and robust professional development for long-term stability with a goal to increase the number of member organizations to 500 over five years. Building on the literature on professional development for informal science educators and the literature on network capacity building, network sustainability, and scale, the project will also conduct research that will inform the field about successful model diffusion. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants.
This Innovations in Development project has five objectives. The first is to re-structure the Teen Science Café Network (TSCN) to a more distributed leadership model that will move the network to long-term sustainability. The PI team will identify five experienced individuals already leading strong café programs to become Guides for new sites. These Guides will provide training, support, and mentorship to new network members. Each Guide will have responsibility over a given year for mentoring two cohorts of nine sites, allowing the network to increase in size over the next five years. The second objective is to implement an interactive program of professional development for new network members. The training will involve approximately 15 hours of adult leader training focused on building skills around teen engagement and café management. The third objective will be to strategically engage all members in the network community of practice through opportunities to participate in and lead ongoing learning with their peers. Through webinars, Birds of a Feather groups and annual workshops and a Science Events Summit, café leaders will actively hone professional skills and broaden their personal network. Objective four is to broaden the involvement of organizations and communities not currently in the network through strategic recruitment of STEM professional societies, military youth programs, library networks, and youth-serving organizations, among other organizations. Finally, objective five is to implement a research agenda to contribute to the informal learning knowledge base. The research will focus on how the project's approach to network growth and distributed leadership leads to effective scaling and sustainability.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Potential STEM talent is lost each day for some of the most underserved and underrepresented populations in our nation's incarcerated men, women, and youth. With years devoid of quality STEM education and opportunities while in prison, incarcerated individuals are often significantly underprepared in STEM and for the STEM workforce. This educational debt exacerbates the pattern of marginalization for these vulnerable populations. Their STEM literacy, employability and potential for earning sustainable wages upon release are stifled. This deficit in opportunity is especially stark for underrepresented groups in the United States. Roughly 61% of the prison population is non-white, which far exceeds the national average of 35%. The U.S. also has the highest per capita incarceration rates in the world, incarcerating 698 men, women, and youth for every 100,000 people. Equally unsettling, for the first time in American history the population growth rate for incarcerated women has outpaced men by almost 2 to 1 for the past 25 years. While there are many contributing factors to the high rate of incarceration in the U.S., high quality prison STEM education programs have been shown to help counter socio-economic and education debts through greater STEM knowledge attainment, successful societal integration, and increased wage and advancement potential, which increase the likelihood that formerly incarcerated individuals and their children can live productive lives. The NSF INCLUDES STEM Opportunities in Prison Settings (STEM-OPS) Alliance endeavors to build a national network aimed at providing and supporting viable pathways to STEM for the incarcerated and formerly incarcerated. Using a collective impact approach, the Alliance will work collaboratively with key stakeholders and the target population to advance extant and untapped knowledge on high quality prison STEM education and opportunities. This work builds on efforts supported by the National Science Foundation, including exploratory work piloted by two NSF INCLUDES Design and Development Launch Pilots. If successful, this Alliance has the potential to significantly transform the face of the STEM workforce and the narrative regarding the incarcerated and formerly incarcerated and their potential to succeed in STEM.
The STEM-OPS Alliance is comprised of partner organizations committed to ensuring that STEM preparation during and post incarceration is commonplace and successful. During its first year, the Alliance will focus on establishing its national network through a shared vision and goals and a collective impact approach. It will conduct systems ecology mapping to inform the supports and resources needed for the target population to succeed in STEM. Focus groups and interviews will be conducted with incarcerated middle/high school aged youth to better understand their experiences in K-12 schools and with STEM education prior to and during incarceration. The results of the mapping and youth study will be used to inform the future work of the Alliance. Affordances the network endeavors to achieve include: (a) creating accessible STEM opportunities for the target populations through STEM courses, in-prison laboratories, research experiences for undergraduates (REUs), internships, and mentoring, (b) a culturally responsive platform to connect formerly incarcerated job seekers with STEM employment opportunities, (c) an evidence-based toolkit for effective STEM in-prison program design and implementation, (d) an annual convening of key stakeholders and representatives from the target populations to share learnings, disseminate findings and resources, and support the growth and development of the Alliance, and (d) leveraging connections to the greater NSF INCLUDES National Network. A formative and summative evaluation will be conducted by an external evaluator. Through its network, the STEM OPS Alliance is well poised to directly impact 700-880 incarcerated and formerly incarcerated men and women and reach a significant number of organizations working to improve STEM opportunities and outcomes within prison contexts.
This NSF INCLUDES Alliance is funded by NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES), a comprehensive national initiative to enhance U.S. leadership in discoveries and innovations by focusing on diversity, inclusion and broadening participation in STEM at scale. Significant co-funding has also been provided by the NSF Innovative Technology Experiences for Students and Teachers (ITEST) program and the NSF Advancing Informal STEM Learning Program (AISL).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Eden BadertscherStanley AndrisseJannette CareyRich Milner