If your project, large or small, needs an external review panel or evaluation advisory committee to help oversee the extent to which project impacts were achieved, one option is to create an Evaluation Committee of Visitors (COV). A COV is commonly used when a project team wants to ensure a consistent outsider lens and broader perspective. As an external group, the COV reviews work and provides recommendations to improve project performance. In this example from the NISE Network, a COV was designated for evaluation efforts. Depending on how the evaluation activities are situated in your
DATE:
TEAM MEMBERS:
Oregon Museum of Science and Industry
resourceevaluationProfessional Development, Conferences, and Networks
The purpose of this report is to summarize the findings from the Years 6-10 (2010-2015) Nanoscale Informal Science Education Network (NISE Net) summative evaluation studies and to discuss factors that contributed to the achievement of NISE Net’s goals. The report centers on summative evaluation findings, while also including major project output data and corroborating findings from the Years 6-10 NISE Net research studies. By synthesizing findings across studies, this summary evaluation report provides a high-level description of the cross-cutting and integrated knowledge generation efforts
The National Science Foundation (NSF) Climate Change Education Partnership Alliance (CCEPA) is a consortium made up of the six Phase II Climate Change Education Partnership (CCEP-II) program awardees funded in FY 2012. Collectively, the CCEPA is establishing a coordinated network devoted to increasing the adoption of effective, high quality educational programs and resources related to the science of climate change and its potential impacts. The establishment of a CCEPA Coordination Office addresses the need for a coordinating body that leverages and builds upon the CCEPA projects' individual initiatives. The CCEPA Coordination Office facilitates interactions to leverage a successful network of CCEP-II projects and individuals engaged in increasing climate science literacy. The efforts of the Coordination Office advance knowledge and understanding of how to effectively network related, but different, projects into a cohesive enterprise. The goal is to coordinate a functional network, where the whole is greater than the sum of the parts.
The CCEPA Coordination Office at the University of Rhode Island is helping to move the CCEPA network forward on a number of key initiatives that strengthen it, reduce duplication, and enhance its overall impact. An important role of the Coordination Office is the facilitation of the transfer of best practices between projects. An effective network forges collaborations and establishes communities of practice through network working groups, building intellectual capital network-wide. The CCEPA Coordination Office has a key role in assisting the CCEPA project PIs and staff to disseminate the results of their work. Partnerships with other relevant societies and organizations assist the Coordination Office in identifying opportunities and synergies for sharing, disseminating, and leveraging network products as well as best practices that emerge as Earth system science education models and tools are evaluated. This endeavor broadens the collective impact of the individual projects across the country.
DATE:
-
TEAM MEMBERS:
Gail Scowcroft
resourceprojectProfessional Development, Conferences, and Networks
The primary goal of the STEM Evaluation Community project is to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects. The project will contribute to the exploration of innovative new approaches for determining the impact of NSF programs and projects, promote the usefulness of NSF program and project evaluations, and help to expand the theoretical foundations for evaluating STEM education, workforce, and outreach initiatives. The STEM Evaluation Community will serve as a focal point for evaluation capacity building with and across the NSF programs that fund STEM education, workforce and outreach activities, bringing people and ideas together, facilitating dialogue, sharing resources, offering opportunities for dissemination and more. The resulting connected system of evaluators will promote social innovation through a lively, dynamic evaluation professional community in which NSF program and project evaluators will share their work, learn from each other, and, ultimately, leverage and enhance the existing evaluation capacity building infrastructure that has been developed for specific NSF programs and audiences, thus charting a course to build further evaluation capacity across NSF.
The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) intiative supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Cincinnati, lead for a tri-state (OH, KY, IN) project, will convene a three-day conference to convene national and local experts to explore the best practices that support the development of a backbone organization in the context of using a social innovation model for broadening participation in STEM. The intent is to strengthen the network among participants and leverage learning from the Cincinnati Strive experience with collective impact across the Midwest and beyond.
Results from the NextLivesHere: Social Change Innovation Summit, will be disseminated in the tri-state region through the Greater Cincinnati STEM Collaborative (GCSC and the Ohio STEM Learning Network (OSLN). National dissemination will occur through informal and formal STEM professional organizations and publications as well as through participation in the NSF-developed national backbone organization.
DATE:
-
TEAM MEMBERS:
Kathie MaynardRoss MeyerShiloh TurnerGeoffrey ZimmermanGisela Escoe
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of California-Irvine (UCI), in partnership with the University of California-San Diego and the University of California-Davis will convene a state-wide conference on inclusion in science, technology, engineering and mathematics (STEM) higher education. The California STEM INCLUDES Conference and Network will share best practices for promoting STEM inclusion and provide an infrastructure to further these practices and track the outcomes. The purpose of the conference is to form a backbone for a large regional network in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative.
The five goals of the conference are to:
--increase California educator awareness of demographic gaps in STEM participation and the research on factors influencing such participation gaps;
--engage participants in discussion of promising practices for increasing STEM inclusion
--broaden the impact of existing successful programs for STEM inclusion, through program modification and replication, scale-up, and increased collaboration;
--create a mechanism for sustained discussion, sharing and collaboration around STEM inclusion across California institutions;
--create central repository and common standards for reporting on STEM inclusion and implementation program impact for the state.
Approximately 340 individuals serving a broad cross-section of California's K-12, higher education, public, private and non-profit constituencies will participate in 2 ½ days of intense dialogue on topics such as data and research, successful implementations and sustainable networks for collaboration and sharing. The conference will be held in Spring 2017.
DATE:
-
TEAM MEMBERS:
Michael DenninSarah Eichhorn
resourceprojectProfessional Development, Conferences, and Networks
SRI International and the Carnegie Foundation for Advancement of Teaching will jointly lead a workshop with the dual goals of supporting INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Launch Pilots during their first year and contributing to plans for a National Backbone. The workshop will strengthen and deepen the potential for rapid, continuous improvement cycles within and across INCLUDES networks. To do so, they will combine the expertise of SRI and Carnegie in improvement science, rapid analytics, and fostering networks of researchers and practitioners to engage participants in conducting a complete improvement cycle within and across INCLUDES Launch Pilots.
The workshop will have three phases. A first phase, conducted online, will share expertise related to each of the four parts of a complete improvement cycle: (1) problem definition, (2) data collection, (3) formative evaluation, and (4) effective communication. This first phase will combine an initial presentation with facilitated, online opportunities to interactively engage in the topics. A second phase, conducted face-to-face, will work intensively with teams from INCLUDES networks to improve their operational and long-term plans. The third phase will reflect and report on the workshop and contribute plans to build capacities for the National Backbone organization. Through the combination of these three phases, they will support the first-year work of INCLUDES teams and also refine understanding of how a national network could combine online and face-to-face elements to advance INCLUDES efforts. The workshop team will create and disseminate resources that are immediately useful to INCLUDES and related projects, and the workshop will openly coordinate with other workshops to achieve synergies. The online offerings will be open, broadly advertised, and permanently available. The lessons learned regarding plans for a national backbone will be disseminated broadly. In addition to participants from INCLUDES networks, additional stakeholders will be invited to both phases so as to shape the future plans to achieve broader impacts aligned with overall INCLUDES goals.
DATE:
-
TEAM MEMBERS:
Timothy Podkul
resourceprojectProfessional Development, Conferences, and Networks
The University of Wisconsin-Madison, Iowa State University, University of Pittsburgh, University of Texas at El Paso, Michigan State University, University of Georgia and University of California, Los Angeles will lead this Design and Development Launch Pilot to build the foundation for a national alliance that will prepare a new national STEM faculty, spanning all of post-secondary education, able to use evidence-based teaching, mentoring and advising practices that yield greater learning, persistence and completion of women and historically underrepresented minorities (URM) undergraduates in STEM. This project was created by this group of institutions, who are members of the Center for the Integration of Research, Teaching and Learning (CIRTL), in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address a STEM achievement and the graduation gap between undergraduate STEM students who are women and men, and between those who are URMs and non-URMs. At the same time U.S. universities and colleges struggle to recruit, retain and promote a diverse STEM graduate student body, and a diverse STEM faculty, who serve as role models and academic leaders for URM and female students to learn from, to work with and to emulate. This project, the CIRTL INCLUDES - Toward an Alliance to Prepare a National Faculty for Broadening Success of Underrepresented 2-Year and 4-Year STEM Students, has the potential to advance a national network of organizations to improve the success of future STEM faculty who will educate a diverse undergraduate body and contribute to the learning, retention and graduation of women and URMs in STEM fields.
The collaborating CIRTL universities will work closely with multiple organizations to address key goals, including Achieving the Dream, Advanced Technological Education Central, the American Association for the Advancement of Science, the American Mathematical Society of Two-Year Colleges, the American Physical Society, the American Society for Engineering Education, the Association of American Universities, the Association of Public and Land-Grant Universities, the Council of Graduate Schools, the Council for the Study of Community Colleges, Excelencia in Education, the Infrastructure for Broadening Participation in STEM, the Louis Stokes Midwest Center for Excellence, the Math Alliance, the National Institute for Staff and Organizational Development, the National Research Mentoring Network, the Partnership for Undergraduate Life Science Education, the Southern Regional Education Board, the Summer Institutes on Scientific Teaching, and the Women in Engineering Programs and Advocates Network. Together, this extensive collaborative network will three goals: (1) To deepen the preparation of future STEM faculty in teaching, mentoring and advising practices that promote the success of undergraduates who are women and URMs; (2) To expand and strengthen faculty preparation specifically for 2-year colleges; and (3) To target the preparation of future STEM faculty who are members of underrepresented groups for effective teaching and mentoring, contributing to their early-career success. The seven universities who are partnering to lead this project will work to: (1) Form active partnerships and national coalitions for each of the three goals; (2) Employ a collective impact framework for each goal team and the entire alliance, ensuring common agendas, shared metrics, mutually reinforcing activities and an integrated process using data improvement cycles; and (3) Achieve pilot outcomes that position the alliance for future work.
DATE:
-
TEAM MEMBERS:
Robert MathieuRenetta TullKatherine BarnicleCraig OgilvieLeslie GonzalesErin SandersJudy MiltonMary Besterfield-SacreBenjamin FloresOcegueda Isela
Mathematics is the foundation of many STEM fields and success in mathematics is a catalyst for success in other scientific disciplines. Increasing the participation of women and other under-represented groups in the mathematics profession builds human capital that produces a diverse pool of problem solvers in business and industry, research mathematicians, faculty at all levels, and role models for the next generation. Existing support and enrichment programs have targeted women in mathematics at different stages in their undergraduate and graduate education, with different strategies to building community, creating a sense of belonging, and promoting a growth mind set. These strategies challenge some of the most common obstacles to success, including isolation, stereotype threat, not committing to mathematics early enough, and imposter syndrome. Acknowledging the diversity among women in terms of socio-economic background and educational background, this project proposes to examine the effectiveness of these programs through the lens of two primary questions: (1) Which elements of these programs are most critical in the success of women, as a function of their position along these distinct diversity axes?, and (2) which features of these programs are most effective as a function of the stage of the participant's career? These questions are guided by the rationale that a better understanding of, and improved pathways by, which programs recruit and retain undergraduate and graduate women in mathematics has the strong potential to increase the representation of women among mathematics PhDs nationwide.
This project seeks to increase and diversify the number of professional mathematicians in the United States by identifying and proliferating best practices and known mechanisms for increasing the success of women in mathematics graduate programs, particularly women from under-represented groups. The PIs on this proposal, all of whom are leaders of initiatives that have been active for nearly two decades, will work with experts in management, data collection and reporting, and communications to address the following three challenges: (1) develop a common system of measuring the effectiveness of each element in these initiatives; (2) develop a process for effective, collective decision making; and (3) create connections between existing activities and resources. This project is both exploratory research and effectiveness research. The project team first will explore the contextual factors that serve to support or inhibit female pursuit of mathematics doctorates by interviewing a variety of women who were undergraduate mathematics majors in the past, as well as current professional mathematicians. They then will use this information to better understand the most effective features of various current and past initiatives that are trying to increase the participation of women in advanced mathematics. A key stakeholder meeting will develop a process for effective, collective decision-making, to utilize what the project team learns from the interviews. The leadership team will develop a website with discussion board and social media components to highlight best practices and facilitate a virtual community for women interested in mathematics. Finally, a distillation of program elements and their targeted effectiveness will inform the selection of interconnected activities to test on a scalable model. These prototypes will be implemented at several sites chosen to represent a diversity of constituencies and local support infrastructure.
DATE:
-
TEAM MEMBERS:
Judy WalkerAmi RadunskayaRuth HaasDeanna Haunsperger
Lack of diversity in science and engineering education has contributed to significant inequality in a workforce that is responsible for addressing today's grand challenges. Broadening participation in these fields will promote the progress of science and advance national health, prosperity and welfare, as well as secure the national defense; however, students from underrepresented groups, including women, report different experiences than the majority of students, even within the same fields. These distinctions are not caused by the students' ability, but rather by insufficient aspiration, confidence, mentorship, instructional methods, and connection and relevance to their cultural identity. The long-term vision of this project is to amplify the impact of a successful broadening participation model at the University of Maine, the Stormwater Research Management Team (SMART). This program trains students and mentors in using science and engineering skills and technology to research water quality in their local watershed. Students engage in numerous science and technology fields: engineering design, data acquisition, analysis and visualization, chemistry, environmental science, biology, and information technology. Students also connect with a diversity of professionals in water and engineering in government, private firms and non-profits. SMART has augmented the traditional science and engineering classroom by engaging students in guided mentored apprenticeships that address community problems.
Technical
This pilot project will form a collaborative and define a strategic plan for scale-up to a national alliance to increase the long-term success rate of underrepresented minority students in science, engineering, and related fields. The collaborative of multiple and varied organizations will align to collectively contribute time and resources to a pre-college educational pathway. There are countless isolated programs that offer short-term interventions for underrepresented and minority students; however, there is lack of organizational coordination for aligning current program offerings, sharing best practices, research results or program outcomes along the education to workforce pathway. The collaborative activities will focus on the transition grades (e.g., 4-5, 8, and high school) and emphasize relationships among skills, confidence, culture and future careers. Collaborative partners will establish a centralized infrastructure in each location to coordinate recruiting of invested community leaders, educators, and parents, around a common agenda by designing, deploying and continually assessing a stormwater-themed project that addresses their location and demographic specific needs. This collaborative community will consist of higher education faculty and students, K-12 students, their caregivers, mentors, educators, stormwater districts, state and national environmental protection agencies, departments of education, and other for-profit and non-profit organizations. The collaborative will address the need for research on mechanisms for change, collaboration, and negotiation regarding the greater participation of under-represented groups in the science and technology workforce.
DATE:
-
TEAM MEMBERS:
Mohamed MusaviVenkat BhethanabotlaCary JamesVemitra WhiteLola Brown
resourceprojectProfessional Development, Conferences, and Networks
The University of Georgia, Florida International University, Savannah State University, Clark Atlanta University and Fort Valley State University will lead this Design and Development Launch Pilot to address enhancing recruitment, retention, productivity and satisfaction of historically underrepresented minority (URM) undergraduate students who enroll in STEM graduate programs at primarily white (PWI) and research intensive (RI) universities. This project was created in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address the STEM education practices for retaining and educating URM undergraduate STEM students at our nation's research intensive universities (RIs). This project, NSF INCLUDES: An Integrated Approach to Retain Underrepresented Minority Students in STEM Disciplines, has the potential to advance a collaborative approach by a group of organizations to improve the success of URM undergraduates in STEM disciplines.
The collaborating universities will work together for the purposes of empowering URM students to more effectively navigate STEM undergraduate and graduate education at minority serving institutions (MSIs) and PWIs, and for transforming the culture of PWIs and RIs. The team plans to use evidence-based approaches to gain insights into cultural differences that impact the success of URM STEM students. Three interventions will be included in the pilot study: (1) undergraduate URM student exchanges between MSIs and PWIs, (2) collaborative inquiry to engage URM students in social science research about issues and experiences of under-representation in STEM, and (3) the adaptation of resources from the Center for the Integration of Research, Teaching and Learning (CIRTL) to train STEM faculty to embrace diversity and improve teaching in diverse classroom settings. The project team plans to develop strategies to scale approaches and develop an alliance of institutions to maximize potential project outcomes.
DATE:
-
TEAM MEMBERS:
Suzanne BarbourJuan GutierrezMichelle CookJoachim WaltherTimothy BurgJaideep ChaudharyShekhar BhansaliSarwan DhirMohamad Mustafa
resourceprojectProfessional Development, Conferences, and Networks
Education pathways have grown increasingly complex in recent decades and today are characterized by a multitude of entry points, stops and starts, longer times to degrees, and changing career directions. As a result, the STEM "pipeline" metaphor has become outdated, and the current institutional structures are not well suited to meeting the educational needs of today's students. This project will create coordinated strategic pathways between 2-year colleges, national laboratories, industry, and the University of Colorado Boulder aimed at changing the educational landscape and facilitating opportunities for students who begin their higher education path at 2-year colleges. In doing so, these efforts will broaden participation among those matriculating in STEM majors who are ready to engage and contribute to a knowledgeable and skilled STEM workforce. This initiative will create links and strengthen pathways to establish a systematic, holistic and sustainable transfer ecosystem that will dramatically increase the number of Colorado 2-year college students that go on to pursue 4-year STEM degrees.
This project will establish a network (hub and spoke system) in STEM education that will serve as a model for regional STEM education collaboration. These efforts will create a cooperative and transformational infrastructure that streamlines STEM pathways for diverse students from 2- to 4- year colleges. By developing a student-centered infrastructure focused on lowering and eliminating barriers that inhibit 2-year college student transfer to 4-year colleges, this initiative will encourage talented 2-year college students interested in pursuing a STEM baccalaureate to successfully transfer, ultimately advancing the technical capacity of Colorado and beyond.
DATE:
-
TEAM MEMBERS:
Sarah MillerNoah FinkelsteinSean ShaheenAnne-Barrie Hunter