As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
resourceresearchProfessional Development, Conferences, and Networks
An interview with Jacquelynne S. Eccles, an academic researcher, is presented. Eccles states that after enrolling in graduate school at UCLA in Los Angeles, California, she learned more about what it entailed to be an academic researcher. Eccles avers that she is interested in how people make selections. Eccles believe that the expectations for one's performance and the value that one connects to acting well are heavily socialized within the cultural setting as individuals grow up.
DATE:
TEAM MEMBERS:
Héfer Bembenutty
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The Algebra Project, in partnership with the Young People's Project, will convene a conference on inclusion in science, technology, engineering and mathematics(STEM) higher education in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative. The conference will examine a critical question: What roles and structures are needed for a mini-backbone organization in order to scale a "bottom up" model of social change into an organized, full scale collective impact model? Additionally, the conference will develop participants' capacity to link action on the various design challenges, and backbone structures, to future actions that meet the needs of a potential Alliance on this Broadening Participation Challenge and others facing similar challenges.
Five pre-conference design teams will focus on key components to improve education of students from underrepresented and disadvantaged populations over a four-month period prior to the convening of the stakeholders in St. Louis, Missouri in 2017.
DATE:
-
TEAM MEMBERS:
Robert MosesBeverly Walker
resourceprojectProfessional Development, Conferences, and Networks
The University of Wisconsin-Madison, Iowa State University, University of Pittsburgh, University of Texas at El Paso, Michigan State University, University of Georgia and University of California, Los Angeles will lead this Design and Development Launch Pilot to build the foundation for a national alliance that will prepare a new national STEM faculty, spanning all of post-secondary education, able to use evidence-based teaching, mentoring and advising practices that yield greater learning, persistence and completion of women and historically underrepresented minorities (URM) undergraduates in STEM. This project was created by this group of institutions, who are members of the Center for the Integration of Research, Teaching and Learning (CIRTL), in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address a STEM achievement and the graduation gap between undergraduate STEM students who are women and men, and between those who are URMs and non-URMs. At the same time U.S. universities and colleges struggle to recruit, retain and promote a diverse STEM graduate student body, and a diverse STEM faculty, who serve as role models and academic leaders for URM and female students to learn from, to work with and to emulate. This project, the CIRTL INCLUDES - Toward an Alliance to Prepare a National Faculty for Broadening Success of Underrepresented 2-Year and 4-Year STEM Students, has the potential to advance a national network of organizations to improve the success of future STEM faculty who will educate a diverse undergraduate body and contribute to the learning, retention and graduation of women and URMs in STEM fields.
The collaborating CIRTL universities will work closely with multiple organizations to address key goals, including Achieving the Dream, Advanced Technological Education Central, the American Association for the Advancement of Science, the American Mathematical Society of Two-Year Colleges, the American Physical Society, the American Society for Engineering Education, the Association of American Universities, the Association of Public and Land-Grant Universities, the Council of Graduate Schools, the Council for the Study of Community Colleges, Excelencia in Education, the Infrastructure for Broadening Participation in STEM, the Louis Stokes Midwest Center for Excellence, the Math Alliance, the National Institute for Staff and Organizational Development, the National Research Mentoring Network, the Partnership for Undergraduate Life Science Education, the Southern Regional Education Board, the Summer Institutes on Scientific Teaching, and the Women in Engineering Programs and Advocates Network. Together, this extensive collaborative network will three goals: (1) To deepen the preparation of future STEM faculty in teaching, mentoring and advising practices that promote the success of undergraduates who are women and URMs; (2) To expand and strengthen faculty preparation specifically for 2-year colleges; and (3) To target the preparation of future STEM faculty who are members of underrepresented groups for effective teaching and mentoring, contributing to their early-career success. The seven universities who are partnering to lead this project will work to: (1) Form active partnerships and national coalitions for each of the three goals; (2) Employ a collective impact framework for each goal team and the entire alliance, ensuring common agendas, shared metrics, mutually reinforcing activities and an integrated process using data improvement cycles; and (3) Achieve pilot outcomes that position the alliance for future work.
DATE:
-
TEAM MEMBERS:
Robert MathieuRenetta TullKatherine BarnicleCraig OgilvieLeslie GonzalesErin SandersJudy MiltonMary Besterfield-SacreBenjamin FloresOcegueda Isela
Mathematics is the foundation of many STEM fields and success in mathematics is a catalyst for success in other scientific disciplines. Increasing the participation of women and other under-represented groups in the mathematics profession builds human capital that produces a diverse pool of problem solvers in business and industry, research mathematicians, faculty at all levels, and role models for the next generation. Existing support and enrichment programs have targeted women in mathematics at different stages in their undergraduate and graduate education, with different strategies to building community, creating a sense of belonging, and promoting a growth mind set. These strategies challenge some of the most common obstacles to success, including isolation, stereotype threat, not committing to mathematics early enough, and imposter syndrome. Acknowledging the diversity among women in terms of socio-economic background and educational background, this project proposes to examine the effectiveness of these programs through the lens of two primary questions: (1) Which elements of these programs are most critical in the success of women, as a function of their position along these distinct diversity axes?, and (2) which features of these programs are most effective as a function of the stage of the participant's career? These questions are guided by the rationale that a better understanding of, and improved pathways by, which programs recruit and retain undergraduate and graduate women in mathematics has the strong potential to increase the representation of women among mathematics PhDs nationwide.
This project seeks to increase and diversify the number of professional mathematicians in the United States by identifying and proliferating best practices and known mechanisms for increasing the success of women in mathematics graduate programs, particularly women from under-represented groups. The PIs on this proposal, all of whom are leaders of initiatives that have been active for nearly two decades, will work with experts in management, data collection and reporting, and communications to address the following three challenges: (1) develop a common system of measuring the effectiveness of each element in these initiatives; (2) develop a process for effective, collective decision making; and (3) create connections between existing activities and resources. This project is both exploratory research and effectiveness research. The project team first will explore the contextual factors that serve to support or inhibit female pursuit of mathematics doctorates by interviewing a variety of women who were undergraduate mathematics majors in the past, as well as current professional mathematicians. They then will use this information to better understand the most effective features of various current and past initiatives that are trying to increase the participation of women in advanced mathematics. A key stakeholder meeting will develop a process for effective, collective decision-making, to utilize what the project team learns from the interviews. The leadership team will develop a website with discussion board and social media components to highlight best practices and facilitate a virtual community for women interested in mathematics. Finally, a distillation of program elements and their targeted effectiveness will inform the selection of interconnected activities to test on a scalable model. These prototypes will be implemented at several sites chosen to represent a diversity of constituencies and local support infrastructure.
DATE:
-
TEAM MEMBERS:
Judy WalkerAmi RadunskayaRuth HaasDeanna Haunsperger
Lack of diversity in science and engineering education has contributed to significant inequality in a workforce that is responsible for addressing today's grand challenges. Broadening participation in these fields will promote the progress of science and advance national health, prosperity and welfare, as well as secure the national defense; however, students from underrepresented groups, including women, report different experiences than the majority of students, even within the same fields. These distinctions are not caused by the students' ability, but rather by insufficient aspiration, confidence, mentorship, instructional methods, and connection and relevance to their cultural identity. The long-term vision of this project is to amplify the impact of a successful broadening participation model at the University of Maine, the Stormwater Research Management Team (SMART). This program trains students and mentors in using science and engineering skills and technology to research water quality in their local watershed. Students engage in numerous science and technology fields: engineering design, data acquisition, analysis and visualization, chemistry, environmental science, biology, and information technology. Students also connect with a diversity of professionals in water and engineering in government, private firms and non-profits. SMART has augmented the traditional science and engineering classroom by engaging students in guided mentored apprenticeships that address community problems.
Technical
This pilot project will form a collaborative and define a strategic plan for scale-up to a national alliance to increase the long-term success rate of underrepresented minority students in science, engineering, and related fields. The collaborative of multiple and varied organizations will align to collectively contribute time and resources to a pre-college educational pathway. There are countless isolated programs that offer short-term interventions for underrepresented and minority students; however, there is lack of organizational coordination for aligning current program offerings, sharing best practices, research results or program outcomes along the education to workforce pathway. The collaborative activities will focus on the transition grades (e.g., 4-5, 8, and high school) and emphasize relationships among skills, confidence, culture and future careers. Collaborative partners will establish a centralized infrastructure in each location to coordinate recruiting of invested community leaders, educators, and parents, around a common agenda by designing, deploying and continually assessing a stormwater-themed project that addresses their location and demographic specific needs. This collaborative community will consist of higher education faculty and students, K-12 students, their caregivers, mentors, educators, stormwater districts, state and national environmental protection agencies, departments of education, and other for-profit and non-profit organizations. The collaborative will address the need for research on mechanisms for change, collaboration, and negotiation regarding the greater participation of under-represented groups in the science and technology workforce.
DATE:
-
TEAM MEMBERS:
Mohamed MusaviVenkat BhethanabotlaCary JamesVemitra WhiteLola Brown
Northern Michigan University's Center for Native American Studies and the Office of Diversity and Inclusion will lead this Design and Development Launch Pilot about culturally inclusive K-16 STEM education for American Indian and Native Alaskan (AIAN) students. This project was created in response to the NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address the undergraduate STEM achievement and the graduation gap between NAAIs and non-native Americans. This project, the NSF INCLUDES: Indigenous Women Working Within the Sciences (IWWS), has the potential to advance knowledge, instructional pedagogy and practices to improve the performance of NAAI high school students and undergraduate students in STEM.
This project team will work to: (1) pilot activities and coursework to train K-16 STEM educators about American Indian inclusive methods and materials, (2) to provide AIAN high school students with STEM college preparatory experience using inclusive STEM practices, and (3) to provide a cohort of female AIAN high school students additional university experiences and mentors as these students transition to postsecondary education. Activities include a five-day summer educators institute for 40 K-16 STEM educators, an additional weekend workshop for 20 K-16 STEM educators, a summer STEM academy for 96 AIAN high school students, a STEM weekend workshop for female AIAN high school students, and a mentoring program for AIAN high school students.
DATE:
-
TEAM MEMBERS:
April LindalaJessica CruzMartin Reinhardt
resourceprojectProfessional Development, Conferences, and Networks
This collaboration between two Historically Black Colleges and Universities (HBCUs) will form a networked improvement community located within the Piedmont Region of North Carolina. In close partnership with community colleges and civic organizations, the project will reach families and students that lead to broader participation of underrepresented groups in science, technology, engineering, and mathematics (STEM) fields. The overall goal is to build and sustain a scalable, inquiry-based network with the purpose of increasing the academic success of underrepresented ethnic minorities and women in the STEM continuum. By engaging in culturally relevant socio-environmental frameworks, project outcomes will positively impact student retention, knowledge, and quantitative skills in STEM across socio-economic divides and STEM disciplines.
The Launch Pilot phase will focus on evidence-based teaching and learning approaches for middle school students. The core structure of the network will serve as a platform to launch and guide other age- and level-specific educational instruction, research, and assessment initiatives. Student understanding of the nature of science will be enhanced by adapting structure, behavior, and function (SBF) theory and system thinking hierarchical (STH) models. Ultimately, the network will represent a driver for social innovation that positively impacts broadening participation in STEM.
The Association of Public and Land-Grant Universities (APLU) will lead this Design and Development Launch Pilot to conduct activities aimed to increase the number of STEM faculty at APLU member universities from underrepresented and traditionally underserved groups: Women, historically underrepresented minorities (URM), persons with disabilities (PWD), and people from low socioeconomic backgrounds. This project was created in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address a STEM achievement and the graduation gap between postsecondary STEM students who are women, URM, PWD, and persons from low socioeconomic backgrounds and males, non-URM, non-PWD, and persons from middle and upper socioeconomic backgrounds. At the same time U.S. universities and colleges struggle to recruit, retain and promote a diverse STEM faculty as role models and academic leaders for historically underrepresented and traditionally underserved students to learn from, to work with and to emulate. Recent NSF reports indicate that URM STEM associate and full professors occupy 8% of the senior faculty positions at all 4-year colleges and universities and about 6% of these positions at the nation's most research-intensive institutions. The APLU INCLUDES: A Collective Impact Approach to Broadening Participation in the STEM Professoriate has the potential to advance a national network of organizations to improve the representation of women, URMs, PWDs and persons from low socioeconomic backgrounds in STEM faculty positions, eventually providing URM STEM role models to STEM undergraduate and graduate students at postsecondary academic institutions across the Nation.
APLU will work closely with multiple organizations to address key objectives, including the American Association for the Advancement of Science, the Center for the Integration of Research, Teaching and Learning, the Collaborative on Academic Careers in Higher Education, the Committee on Institutional Cooperation (recently renamed the Big Ten Academic Alliance), the Council of Graduate Schools, the Florida Education Fund's McKnight Doctoral Fellowship Program, Southern Regional Education Board State Doctoral Scholars Program and the University of California's Office of the President. Together this network plans to connect APLU member institutions and experts to (1) develop and test a set of diagnostic tools and practices for recruiting, hiring, retaining and supporting faculty, to (2) identify a set of institutional activities to increase participation along STEM pathways toward the professoriate, to engage a group of institutions to collectively implement one or more of the activities, and to (3) evaluate the adequacy and coverage current data sources and metrics available to track students from entry into postsecondary education through the professoriate.
DATE:
-
TEAM MEMBERS:
Howard GobsteinAlan MabeTravis YorkChristine KellerKimberly Griffin
resourceprojectProfessional Development, Conferences, and Networks
Jobs are growing most rapidly in areas that require STEM knowledge, causing business leaders to seek skilled American workers now and in the near future. Increase in the number of students pursuing engineering degrees is taking place but the percentages of underrepresented students in the engineering pipeline remains low. To address the challenge of increasing the participation of underrepresented groups in engineering, the National Society of Black Engineers, the American Indian Science and Engineering Society, the Society of Hispanic Professional Engineers, and the Society of Women Engineers have formed the 50K Coalition, a collaborative of over 40 organizations committed to increasing the number of bachelors degrees awarded to women and minorities from 30,000 annually to 50,000 by 2025, a 66% increase. The 50K Coalition is using the Collective Impact framework to develop an evidence-based approach that drives management decision-making, improvements, sharing of information, and collective action to achieve success. The first convening of the 50K Coalition in April, 2016, brought together 83 leaders of the engineering community representing 13 professional societies with over 700,000 members, deans of engineering, minority engineering and women in engineering administrators from 11 leading colleges of engineering, and corporate partners representing six global industries. Consensus was reached on the following Common Agenda items: 1.) Undergraduate support and retention; 2.) Public awareness and marketing; 3.) K-12 support; 4.) Community College linkages; 5.) Culture and climate. The Coalition will encourage member organizations to develop new programs and scale existing programs to reach the goal.
The Coalition will use shared metrics to track progress: AP® Calculus completion and high school graduation rates; undergraduate freshmen retention rates; community college transfer rates and number of engineering degrees awarded. The 50K Coalition will develop the other elements of the Collective Impact framework: Infrastructure and effective decision-making processes that will become the backbone organization with a focus on data management, communications and dissemination; a system of continuous communication including Basecamp, website, the annual Engineering Scorecard, WebEx hosted meetings and convenings; and mutually reinforcing activities such as programs, courses, seminars, webinars, workshops, promotional campaigns, policy initiatives, and institutional capacity building efforts. The National Academy of Sciences study, Expanding Underrepresented Minority Participation: America's Science and Technology Talent at the Crossroads recommended that professional associations make recruitment and retention of underrepresented groups an organizational goal and implement programs designed to reach that goal by working with their membership, academic institutions and funding agencies on new initiatives. While these types of organizations work together now in a variety of ways, the relationships are one-on-one. The 50K Coalition brings together, for the first time professional societies, engineering schools, and industry to consider what mutually reinforcing activities can most effectively encourage students from underrepresented groups to complete calculus and graduate from 4-year engineering programs.
DATE:
-
TEAM MEMBERS:
Karl ReidBarry CorderoSarah EcohawkKaren Horting
Because of the siloed nature of formal educational curricula, students who opt out of STEM coursework, for whatever reason, lose the opportunity to engage with the domain of science almost entirely, thereby closing the door to the STEM workforce pipeline. This disproportionately impacts students of color and women. This project advances an alliance that consists of a consortium of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and local businesses. The project built around this alliance will leverage interdisciplinary spaces in the curriculum, particularly the humanities and social sciences, across academic levels, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life. The PIs establish a physical Community STEM Center as an anchoring institution for STEM engagement. This Center will be situated within the community that the alliance serves, bringing STEM opportunities and engagement to students instead of asking them to come where STEM education is currently provided. The activities enacted through the Community STEM Center will focus on enduring problems experienced by the communities, where students, community residents, teachers, and experts from higher education, industry and other community-based entities can come together to work on understanding them and developing evidenced centered advocacy as a means for addressing them. To facilitate the work at the Community STEM Center, the project creates a Community Ambassadors Program (CAP), leveraging participation across alliance members in partnership with the community. This Design and Development Launch Pilot will cultivate the necessary knowledgebase to develop a scalable model for implementation across diverse urban communities.
Technical Summary
This Design and Development Launch Pilot focuses on shifting the narrative of STEM education away from a solitary focus on formalized educational experiences and targets STEM content. This project develops and facilitates a parallel set of activities designed to engage under-represented students in learning how and why STEM is relevant to their lives, and approached through new and non-traditional educational dimensions. The five main objectives of this proposed pilot are to: (1) Develop a pilot alliance of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and industry;(2)Establish a physical Community STEM Advocacy Center as an anchoring institution for change embedded within the community that the pilot alliance serves; (3) Leverage interdisciplinary spaces in curricula, across academic levels, particularly the humanities and social sciences, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life; (4) Create a Community Ambassadors Program (CAP), leveraging participation across higher education pilot alliance members in partnership with the community; and (5)Conduct an evaluation of project initiatives and research regarding the usability and feasibility of a systemic approach to developing community-based, interdisciplinary pathways to broaden STEM participation pathways. Efforts to examine the impact of this community-based, interdisciplinary approach concentrates on the proximal outcomes related to STEM interest, self-efficacy and identity. Data will be collected in pre/post format across our three constituent samples: 1) Community STEM Advocacy Center participants; 2) k-12 students; and, 3) postsecondary students. Analysis of data will be conducted through MANCOVAs to account for potential co-variation among construct scores. Qualitative data will also be collected to contextualize findings and enable the development of a rich case study. At least two observations will be conducted in the Community STEM Advocacy Center and the two classroom implementations to document engagement, participant interactions and level of STEM content.
DATE:
-
TEAM MEMBERS:
Kimberly LawlessDonald WinkLudwig Carlos NitscheAixa AlfonsoJeremiah Abiade
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.