Through desk-based research and expert interviews, this study set out to investigate how funders and policy makers could drive coordination and improvements in the evaluation of youth engagement with STEM. The study explored the current landscape of evaluating youth engagement with STEM, gaps and challenges and key learnings from the evaluation practice in other sectors and key initiatives. Between February and March 2022, 18 project and programme evaluation reports and papers were reviewed, approximately 40 academic papers were analysed and synthesised, and 14 experts were interviewed.
The COVID-19 pandemic tested many fundamental connections between science and society. A growing field working to strengthen those connections exists within the informal STEM learning (ISL) community which provides diverse learning and engagement environments outside the formal classroom. One of the largest funders of ISL initiatives is the National Science Foundation (NSF) which runs the Advanced Informal STEM Learning (AISL) program in the United States. The AISL program supports initiatives through six categories that include pilots and feasibility studies, research in service to practice
Centering Native Traditional Knowledge within informal STEM education programs is critical for learning for Native youth. In co-created, place-based learning experiences for Native youth, interweaving cultural traditions, arts, language, and community partnerships is vital for authentic, meaningful learning. Standardized STEM curricula and Western-based pedagogies within the mainstream and formal education systems do not reflect the nature of Native STEM knowledge, nor do they make deep connections to it. The absence of this knowledge base can reinforce a deficit-based STEM identity, which can directly impact Native youths’ participation and engagement in STEM. Reframing STEM education for Native youth to prioritize the vitality of community and sustainability requires active consideration of what counts as science learning and who serves as holders and conduits of STEM knowledge. As highly regarded holders of traditional and western STEM knowledge, Native educators and cultural practitioners are critical for facilitating Native youths’ curiosity and engagement with STEM. This Innovations in Development project is Native-led and centers Native knowledge, voice, and contributions in STEM through a culturally based, dual-learning approach that emphasizes traditional and western STEM knowledge. Through this lens, a network of over a dozen tribal nations across 20 U.S. states will be established to support and facilitate the learning of Traditional and Western STEM knowledge in a culturally sustaining manner. The network will build on existing programs and develop a set of unique, interconnected, and synchronized placed-based informal STEM programs for Native youth reflecting the distinctive cultural aspects of Native American and Alaska Native Tribes. The network will also involve a Natives-In-STEM Role Models innovation, in which Native STEM professionals will provide inspiration to Native youth through conversations about their journeys in STEM within cultural contexts. In addition, the network will cultivate a professional network of STEM educators, practitioners, and tribal leaders. Network efforts and the formative evaluation will culminate in the development and dissemination of a community-based, co-created Framework for Informal STEM Education with Native Communities.
Together with Elders and other contributors of each community, local leads within the STEM for Youth in Native Communities (SYNC) Network team will identify and guide the STEM content topics, as well as co-create and implement the program within their sovereign lands with their youth. The content, practitioners, and programming in each community will be distinct, but the community-based, dual learning contextual framework will be consistent. Each community includes several partner organizations poised to contribute to the programming efforts, including tribal government departments, tribal and public K-12 schools, tribal colleges, museums and cultural centers, non-profits, local non-tribal government support agencies, colleges and universities, and various grassroots organizations. Programmatic designs will vary and may include field excursions, summer and after school STEM experiences, and workshops. In addition, the Natives-In-STEM innovation will be implemented across the programs, providing youth with access to Native STEM professionals and career pathways across the country. To understand the impacts of SYNC’s efforts, an external evaluator will explore a broad range of questions through formative and summative evaluations. The evaluation questions seek to explore: (a) the extent to which the culturally based, dual learning methods implemented in SYNC informal STEM programs affect Native youths’ self-efficacy in STEM and (b) how the components of SYNC’s overall theoretical context and network (e.g., partnerships, community contributors such as Elders, STEM practitioners and professionals) impact community attitudes and behaviors regarding youth STEM learning. Data and knowledge gained from these programs will inform the primary deliverable, a Framework for Native Informal STEM Education, which aims to support the informal STEM education community as it expands and deepens its service to Native youth and communities. Future enhanced professional development opportunities for teachers and educators to learn more about the findings and practices highlighted in the Framework are envisioned to maximize its strategic impact.
DATE:
-
TEAM MEMBERS:
Juan ChavezDaniella ScaliceWendy Todd
resourceprojectProfessional Development, Conferences, and Networks
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
Science communication is proliferating in the developing world, however, with respect to science centres, as a whole Africa is being left behind. Here 15 participants in a capacity building program are investigated using traditional needs-based and contemporary asset-based development conceptualisations. These development theories parallel deficit and participatory approaches, respectively, within science communication and demonstrate synergies between the fields. Data showed staffing, funding, governments, host institutions, and audiences are prominent needs and assets, networks are a major
DATE:
TEAM MEMBERS:
Graham WalkerLeapotswe BantsiSiphesihle BukhosiniKnowledge ChikundiAkash DusrathMartin KafeeroBhamini Kamudu ApplasawmyKenneth Monjero IgadwaKabelo MoswetsiSandile RikhotsoMarthinus J. SchwartzPuleng Tsie
The Researching Invention Education white paper compiles contributions from a community of individuals and organizations working in Invention Education (IvE) in the United States. IvE is a term that refers to the practice of teaching students how to problem-solve and think like inventors in order to become positive change-makers in the world. The paper was written by researchers interested in IvE who attended the 2018 InventEd convening hosted by The Lemelson Foundation. The group worked together for a year to publish their findings that were then uncovered at the 2019 InventEd convening in
DATE:
TEAM MEMBERS:
Audra SkukauskaiteStephanie CouchLeslie Flynn
The pilot test for Changemakers: Advancing Community Science Literacy was a capacity building program integrating strategic discourse & community change theory that identified a new path for advancing community STEM literacies. The results of experiment established partnerships with locally based non-profits, and a collaborative effort to address environmental justice and social disparities in areas threatened by climate change.
The evaluation was underaken with instruments developed for multiple research projects to support cross-project comparative analysis.
This instrumemts presented
The pilot test of a capacity building program integrating strategic discourse & community change theory identified a new path for advancing community STEM literacies. The results of experiment established partnerships with locally based non-profits working to address environmental justice and social disparities in areas threatened by climate change identified five recommendations to reset the role of ISLC’s as more relevant to the communities: 1) Allocate Time to Build Relationships; 2) Develop a Shared Definition of Resilience; 3) Situate Community Aspirations as Context for STEM Learning; 4)
Inclusive science communication (ISC) is a new and broad term that encompasses all efforts to engage specific audiences in conversations or activities about science, technology, engineering, mathematics, and medicine (STEMM) topics, including, but not limited to, public engagement, informal science learning, journalism, and formal science education. Unlike other approaches toward science communication, however, ISC research and practice is grounded in inclusion, equity, and intersectionality, making these concerns central to the goals, design, implementation, evaluation, and refinement of
Complex political decisions increasingly require scientific knowledge and expertise. But the exchange between actors from the political and the scientific systems is confronted by challenges. Science policy interfaces are needed in order to overcome the barriers to communication. This article analyses and discusses the importance of foundations as science policy interfaces. To this end, we will first present the salient features and functions of foundations as organisations in the framework of theoretical considerations and discuss their fundamental suitability as mediators of scientific
In 2010 both India and Europe launched new strategies focused on innovation, for economic growth and for addressing societal challenges: the Decade of Innovation from the Indian Government and the Innovation Union from the European Union. This piqued our interest in investigating how these two political entities have envisioned the concept of innovation, particularly in studying and comparing how they have focused on people, both as final beneficiaries (and thus principal legitimisers) of policy actions, and as actors themselves in the innovation process. Per contra we found, in institutional