Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In 2017, the Education Development Center (EDC) received a grant from the National Science Foundation (NSF) to bring together PIs of STEM Program Resource Centers (PRC) funded under NSF’s Education and Human Resources (EHR), evaluators of NSF STEM projects and programs, and evaluation advisors to address concerns about the quality and consistency of STEM evaluations. According to the grant proposal, the goal was “to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of
The challenge to the science communication field put forward by Bruce Lewenstein, of the sector becoming a ‘ghetto’ of women's over-representation (see the commentary by Lewenstein in this issue), is a very timely wake-up call. This Commentary however, elaborates and frames the pivotal and constructivist premises on which this phenomenon should be interrogated and understood on many levels. It is critical that we undertake a deeper introspection, beyond just simplistic head counts of the number of women and men in the field, if we are to make sense of the seeming paradoxes that pervade the
The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
Scientists (and engineers) wishing to conduct public engagement do so in the context of established disciplinary norms and complex institutional systems that may support or limit their success. This report seeks to convey the known complexity, unique challenges, and opportunities for universities to better support for scientists in their public engagement work. The report is intended to drive discussion towards deeper exploration and development of actionable next steps.
This is a report from Workshop III: Academic Institutions, part of the Support Systems for Scientists' Communication and
The American Association for the Advancement of Science (AAAS) is creating, implementing and evaluating a forum for the NSF INCLUDES broadening participation community of practice and for engaging the NSF INCLUDES awardees and science, technology, engineering and mathematics (STEM) researchers across the nation to expand the NSF INCLUDES broadening participation network. The NSF INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in STEM discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields.
The NSF INCLUDES Open Forum will use the AAAS Trellis networking platform and the organization's experience engaging communities of practice focused on broadening participation, STEM education and STEM research. The project builds on the success of a prior NSF INCLUDES Conference award (HRD-1650509) that was addressing goals to define networking needs of the first round of NSF INCLUDES Design and Development Launch Pilots (DDLP); to develop design specifications for NSF INCLUDES networking, curating of resources, and supporting communities of practice; and to propose tools, techniques, capacities and functionalities for an NSF INCLUDES national network.
The NSF INCLUDES Open Forum project includes advisory board members with expertise in networking platforms and others with broadening participation knowledge and experience. A yearly conference for NSF INCLUDES awardees will offer participants an opportunity to learn about how Trellis platform upgrades, functionality and technology options (e.g., a smartphone application) can be used in new ways to engage a broader community of partners interested in broadening participation in STEM research and education contexts. An external evaluator will assess the activities and outcomes of the NSF INCLUDES Open Forum both during implementation and at project end. The PIs will also communicate the outcomes of the project to broader audiences, both academic and non-academic, and encourage a dialogue within the NSF INCLUDES community about the use of technology for organization and communication within a network.
DATE:
-
TEAM MEMBERS:
Shirley MalcomJosh Freeman
resourceresearchProfessional Development, Conferences, and Networks
Each year, the National Alliance for Broader Impacts (NABI) seeks to understand the current state of broader impacts (BI) in the national context. In 2017, NABI convened two forums to identify needs and solicit recommendations. The first event was a 90-minute town hall session with 120 participants facilitated by Jamie Bell at the April 2017 BI Summit. The second event was a two-day convening facilitated by Goose Creek Consulting at NSF headquarters in May 2017 of stakeholder groups including university administrators (e.g., provosts, associate provosts, vice-presidents of research)
This report presents findings from a formative evaluation of Science Education for New Civic Engagements and Responsibilities-Informal Science Education (SENCER-ISE), a National Science Foundation and Noyce Foundation funded initiative to support partnerships between informal science and higher education institutions. This evaluation looked primarily at the collaborative infrastructure of SENCER-ISE, which included the web site, SENCER Summer Institute, and communications with project staff and/or the advisory board. This evaluation is the third evaluation that Randi Korn & Associates, Inc
DATE:
TEAM MEMBERS:
RK&A, Inc.
resourceevaluationProfessional Development, Conferences, and Networks
The National Center for Science and Civic Engagement (NCSCE) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of its SENCER-ISE project partnerships. SENCER-ISE is an initiative that brings partners from higher education (HE) together with partners from informal science education (ISE) to create projects that engage audiences in science using the lens of civic engagement. SENCER funded 10 partnerships over three years—six through the National Science Foundation (DRL #1001795) and four through the Noyce Foundation. Previously, RK&A conducted a formative
DATE:
TEAM MEMBERS:
RK&A, Inc.William Burns
resourceprojectProfessional Development, Conferences, and Networks
The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) intiative supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Cincinnati, lead for a tri-state (OH, KY, IN) project, will convene a three-day conference to convene national and local experts to explore the best practices that support the development of a backbone organization in the context of using a social innovation model for broadening participation in STEM. The intent is to strengthen the network among participants and leverage learning from the Cincinnati Strive experience with collective impact across the Midwest and beyond.
Results from the NextLivesHere: Social Change Innovation Summit, will be disseminated in the tri-state region through the Greater Cincinnati STEM Collaborative (GCSC and the Ohio STEM Learning Network (OSLN). National dissemination will occur through informal and formal STEM professional organizations and publications as well as through participation in the NSF-developed national backbone organization.
DATE:
-
TEAM MEMBERS:
Kathie MaynardRoss MeyerShiloh TurnerGeoffrey ZimmermanGisela Escoe
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of California-Irvine (UCI), in partnership with the University of California-San Diego and the University of California-Davis will convene a state-wide conference on inclusion in science, technology, engineering and mathematics (STEM) higher education. The California STEM INCLUDES Conference and Network will share best practices for promoting STEM inclusion and provide an infrastructure to further these practices and track the outcomes. The purpose of the conference is to form a backbone for a large regional network in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative.
The five goals of the conference are to:
--increase California educator awareness of demographic gaps in STEM participation and the research on factors influencing such participation gaps;
--engage participants in discussion of promising practices for increasing STEM inclusion
--broaden the impact of existing successful programs for STEM inclusion, through program modification and replication, scale-up, and increased collaboration;
--create a mechanism for sustained discussion, sharing and collaboration around STEM inclusion across California institutions;
--create central repository and common standards for reporting on STEM inclusion and implementation program impact for the state.
Approximately 340 individuals serving a broad cross-section of California's K-12, higher education, public, private and non-profit constituencies will participate in 2 ½ days of intense dialogue on topics such as data and research, successful implementations and sustainable networks for collaboration and sharing. The conference will be held in Spring 2017.