The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
Participants in this study reported a variety of resources used in the past to learn to code in Apex, including online tutorials, one-day classes sponsored by Salesforce, and meet-up groups focused on learning. They reported various difficulties in learning through these resources, including what they viewed as the gendered nature of classes where the men already seemed to know how to code—which set a fast pace for the class, difficulty in knowing “where to start” in their learning, and a lack of time to practice learning due to work and family responsibilities. The Coaching and Learning Group
This summative evaluation report presents findings and lessons learned on the STEM Ambassadors project. The STEM Ambassadors project, funded by the National Science Foundation’s (NSF) Advancing Informal STEM Learning (AISL) program, combines elements of existing programs designed to engage STEM professionals with the public around their scientific research to create a new model for public engagement of science. This new model recruits, provides training for, and assists STEM professionals in drawing on their own interests, hobbies and backgrounds to connect with audiences that may not have
The Multi-Site Public Engagement with Science—Synthetic Biology (MSPES) initiative was an Innovations in Development project funded by the National Science Foundation (DRL-1421179) through the Advancing of Informal STEM Learning program (AISL). MSPES promoted public engagement with science (PES)—a model of mutual dialogue and learning between public and scientist audiences—through the creation and distribution of PES kits to nearly 200 informal science education sites around the country. Kits included two types of learning experiences: (1) forum programs during which scientists and teen or
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Research in Service to Practice project examines how informal place-based collaborative learning can support local communities' planning processes related to current environmental changes. As a part of this study workshops will be conducted in 8 communities that have a range of planning mandates based on recent extreme environmental changes such as drought/wildfires, flooding, invasive species, or loss of native wildlife. Place-based adaptation workshops will be designed to be locally relevant and empower people to learn and act on their newly acquired understandings. Local community collective actions may include a range of decisions (e.g., infrastructure changes such as building defenses against sea level rise in coastal communities or improving the quality of roads to withstand higher temperatures.) Collective action may also lead to community wide behavioral changes such as individuals using less water or farmers planting different crops. The study will focus on the efficacy of the methods used in 8 workshops in communities throughout the country. Research objectives include: 1) identifying experts' belief about the most critical components of successful workshops; 2) Understanding of prior workshop outcomes and 3) test hypothesized effective practices and understand how learning takes place and collective action does or does not take place. The project addresses key AISL solicitation priorities including strategic impact on the field of informal STEM learning, advancing collaboration, and building professional capacity. It engages both public and professional audiences as described in the solicitation. Public audiences include stakeholders in each of the 8 communities such as community environmental groups, NGOs, businesses, landowners, and local government planners. Professional audiences include the workshop scientists and facilitators who will be trained in the experimental workshop approach. The project builds upon and expands the existing AISL portfolio of science communication projects such as science cafes, science festivals, science media, and library based projects. This is a collaborative project of EcoAdapt and Virginia Tech with participants from the National Parks Conservation Association, the Desert Research Institute, and the Wildlife Conservation Society and others. The research will progress through two phases. Phase 1 is designed to identify consensus-based effective practices for promoting learning and action in adaptation workshops. It includes a Delphi study to synthesize beliefs about effective practices held by experienced workshop facilitators across the United States. Phase 2 includes iterative design and research of eight adaptation workshops in various communities with a range of planning mandates and recent extreme weather experience. By iteratively revising the workshop design, the study will elucidate how different workshop components influence participant learning, individual behavioral intentions, and subsequent efforts toward collective action. The overall research design will examine the relationships of pedagogical and collaborative techniques to learner outcomes and collective action. Many of these lessons are likely relevant to other collaborative informal science learning contexts. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Please join us in celebrating Citizen Science Day, which falls this year on Saturday, April 14th. This issue of Connected Science Learning is dedicated to highlighting effective citizen science programs that involve classroom students in collecting data for research scientists, while also engaging them in key STEM (science, technology, engineering, and math) content and practices. Students get a “front row seat” to what scientists do and how scientists work, plus develop the reasoning skills and practices used by scientists.
With support from the National Science Foundation (NSF), SciStarter 2.0 was launched to enhance, diversify, and validate participant engagement in scientific research in need of the public’s help. SciStarter’s leadership is part of the National Academy of Sciences’ Committee, Designing Citizen Science to Support Science Learning, which is developing guidelines and a research agenda for citizen science in education. This article briefly introduces educators to SciStarter 2.0.
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
resourceprojectProfessional Development, Conferences, and Networks
This is a project to offer the Forum on Inclusive STEMM Entrepreneurship (FISE), a novel effort to broaden the participation of underrepresented minority women in STEMM entrepreneurship and to enhance the diversity of the science and engineering workforce. Through a convening of educators, entrepreneurs, aspiring entrepreneurs, industry leaders, investors and policy experts, entrepreneurial education thought leaders, and intersectionality scholars the PI proposes to use this conference as a platform for building capacity in the preparation and development of future entrepreneurs from underrepresented groups. The PI also seeks to contribute to the emerging field of research that bridges tech entrepreneurship and education policy.
The proposed forum has the potential to advance knowledge in the field of entrepreneurship education and engineering education. Given the dearth of research-based interventions to broaden participation in tech entrepreneurship, this conference offers an opportunity for participants to contribute to the leading edge of research and interventions in this field.
The convening and associated activities will leverage the social capital of knowledgeable experts in the academy and industry, investors, entrepreneurs and aspiring entrepreneurs to address critical needs of the nation that relate to enhanced global competitiveness, an improved national economy, and the participation of underrepresented cohorts in entrepreneurship and commercialization.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will conduct research designed to deepen our fundamental knowledge about culture, experience, and ecosystems cognition and to develop innovative practices and approaches to support learning about changing ecological systems and environmental decision making. Work on cultural differences in the production of complex systems knowledge is severely lacking. This gap in knowledge may contribute to the continued reproduction of inequities in science education. More broadly findings from this project will have clear implications for theories of cognitive development, especially those pertaining to how knowledge is shaped by culture and experience. Focusing on ecosystems may represent an opportunity to not only increase engagement and achievement in science among non-dominant communities and Native youth specifically, but also advance effective learning for all communities. The primary deliverables for the project are conference presentations and research publications. However, the project will also develop additional resources freely available to researchers, educators, and the general public. These will include summer curricular materials and teaching tools, professional development workshops, practitioner briefs about research findings that can be used in professional development workshops and shared share more broadly, and evaluation reports.
A deeper understanding of cultural influences on conceptions of the natural world can serve to advance the educational needs of children, including children from diverse linguistic and cultural backgrounds. Project research will include two interrelated series of studies designed to expand knowledge about human cognition of complex ecosystems and the affordances of informal STEM learning environments in developing and supporting the critical 21st century skill of ecological systems level reasoning. The first consists of a series of experiments focused on ecological cognition and the role of humans in nature. The second consists of design-based research interventions in informal settings, summer workshops for youth and the communities, focused on ecological systems level thinking and socio-environmental decision making. The project will recruit and engage both child and adult participants from two broad cultural communities, Native Americans and European Americans living in urban and suburban communities, in part because it affords a sharp test of human-nature relations. Sampling from two different urban communities will avoid simple Native-non-Native comparative binaries and to conduct Native-to-Native comparative analysis. Based on results from this, the project will result in: 1) foundational knowledge about human learning and reasoning and ecosystems and environmental decision making, 2) culturally responsive models of learning and practice about complex ecosystems for indoors and outdoors informal learning environments, and 3) insights about research-practice-community partnerships. One important objective of the research is to broaden participation and close opportunity gaps for under-represented groups in STEM fields broadly and more specifically for Indigenous people. Members of Indigenous communities, who provide strong role models for other aspiring scholars, will be involved as postdoctoral fellows, research assistants and graduate fellows.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
This project will coordinate and focus existing educational elements with the common goal of increasing the participation of underrepresented minorities in STEM degree programs and the STEM workforce. This goal will help the US maintain its leadership in science and engineering innovation while supporting the expansion of the talent pool needed to fuel economic growth in technical areas. The program will feature an assessment system that addresses both social influence factors and the transfer of STEM skills with the aim of identifying the reasons that underrepresented minorities leave the STEM pipeline. By including both curricular and extracurricular elements of the STEM pipeline, ranging from middle school through college, the program will be able to respond quickly to findings from the assessment component and take proactive steps to retain STEM students and maintain their self perception as future scientists or engineers.
The program proposes to assess, unite and coordinate elements in the New Mexico STEM pipeline with the ultimate goal of increasing the participation of underrepresented groups in the STEM workforce. The need to grow a diverse science, technology, engineering and mathematics (STEM) workforce is recognized throughout the State of New Mexico, and beyond, by both the public and private sectors. The project develops a crosscutting assessment system that addresses both social influence factors and the skills component of STEM education. The project develops a collective impact framework aimed at increasing the participation of underrepresented minorities in the STEM workforce and implements a common assessment system for students in the 6-20+ STEM pipeline. This assessment system will address both social influence factors and the transfer of STEM related skills with the aim of building a research base to investigate why students from underrepresented minorities leave the STEM pipeline. The output from this research will drive the development of a set of best practices for increasing retention and a scheme for improving the integration of minority students into the STEM community. The retention model developed as part of the program will be shared with the STEM partners through a series of workshops with the goal of developing a more coordinated approach to the retention of underrepresented minorities. The program focuses on a small set of STEM programs with existing connections to the College of Engineering.
DATE:
-
TEAM MEMBERS:
Steven StochajPatricia SullivanLuis Vazquez