As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
resourceresearchProfessional Development, Conferences, and Networks
In order to engage visitors, guests, participants or audiences in positive STEM learning experiences, informal learning institutions need professionals who understand how to design for and facilitate engaging activities. Initial professional training for informal STEM educators, and subsequent ongoing professional learning create considerable challenges. There is a need for providing informal STEM educators with pathways to professionalization that guarantee high quality educators who can support successful informal STEM education. In this symposium, we propose to share research on key aspects
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought
Many scientists want to connect with the public, but their efforts to do so are not always easy or effective. Visionary programs and institutions are leading the way identifying the support needed to enable scientists’ connections with the public. However, the current appetite by -- and demand for -- scientists to do this exceeds the capacity of those who facilitate quality communication and engagement efforts. More can be done to ensure that those who support scientists are networked, sharing best practices, and supported by a reliable infrastructure.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought together leaders in different parts of the field who bridge scientists and the public and led to the emergence of a number of key priority areas. While the initial intention was to also hold a plenary event to provide a more holistic view of scientists’ support system in order to collectively discern directions to advance the field, we feel a more efficient way forward right now is to focus our efforts and resources on building community and advancing these priority areas.
Our invitation-only workshops brought together scientists, academic leaders, engagement professionals, researchers, communication trainers, and foundation leaders. For each workshop, we also commissioned a “landscape overview”, to better understand the high-level state of each community. Workshops included:
Workshop I: Communication and engagement training programs - Dec. 4-5, 2017 at SUNY Global Center/Alan Alda Center for Communicating Science in New York
Workshop II: Associations, societies and other professional organizations - Feb. 28 - March 1, 2018 at the Howard Hughes Medical Institute in Chevy Chase, MD
Workshop III: Academic institutions - March 27-28, 2018 at UC San Diego
Workshop IV: Science engagement facilitators (museums, science festivals, connectors) - May 2-3, 2018 at Monterey Bay Aquarium
TBD - Workshop V: Plenary event
The goal of the workshops was to explore how to ensure scientists’ communication and engagement support is effective and sustained. In doing so, we hoped to 1) deepen our understanding of how scientists are currently supported in these areas, 2) map the broader support system to expose the opportunities and obstacles that play a role in achieving this goal, and 3) identify strategic and practical next steps that move us closer to this goal. This initiative also aimed to forge and strengthen networks across communities and institutions – and in so doing, take a view of the entire system to explore how everyone can better ensure their efforts are impactful, mutually supportive, and connected to a greater whole.
Included in the links below are summaries from each workshop.
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
The University of Maine will address the grand challenge of increasing Native American participation in the science,technology, engineering and mathematics (STEM) enterprise in an NSF INCLUDES Design and Development Launch Pilot project addressing culturally relevant pedagogy, incorporating Community Elders, Cultural Knowledge Keepers, and mainstream secondary and higher education institutions in the development of STEM pedagogy that can be replicated to other underrepresented and underserved populations. Partners in the effort include the Wabanaki Youth in Science program (WaYS)(a non-profit organization), Salish Kootenai College (a Tribal College), Massachusetts Institute of Technology (a research university), the National Indian Education Association (a non-profit membership organization) and the current NSF INCLUDES Design and Development Launch Pilot project at the University of Maine (the Stormwater Research Management Team (SMART)). This NSF INCLUDES partnership provides students with evidence-based STEM activities involving culturally relevant internships, mentoring, STEM professional development activities and other support. Non-native students will reciprocally participate in Native American learning environments.
The foundation for the project's activities is based on the WaYS program in science education that incorporates Traditional Ecological Knowledge (TEK). The goals of the project are to: 1) create and integrate curriculum that embraces TEK and western science as equal partners; 2)develop and implement protocols to incorporate a continued mentorship program for WaYS and STREAM engineering students; 3)develop a framework to bridge the gap between high school and college; and 4) foster collaboration among Community Elders, Cultural Knowledge Keepers and University of Maine faculty in a model that could be transferred to other communities. Internal and external evaluation activities will add to the scholarly literature on educating Native Americans and non-native students in STEM disciplines. Dissemination of project results will include published peer-reviewed journal articles on newly developed pedagogy and conference presentations at the American Indian Science and Engineering (AISES) national conference, the National Diversity in STEM Conference, National Science Teachers Association, AAAS, ASEE and the National NSF INCLUDES Network.
DATE:
-
TEAM MEMBERS:
Darren RancoJohn DaigleMindy CrandallShaleen Jain
Underrepresented minorities (URMs) are less than 10% of engineering faculty, despite comprising nearly a third of the nation's population. A common explanation for their disproportionate representation, at the engineering faculty level, is related to a lack of access to effective mentorship from other faculty. This NSF INCLUDES Design and Development Launch Pilot project will expand a new mentoring and advocacy-networking paradigm to bring together two stakeholder groups: (1) underrepresented minorities (URMs) who are engineering faculty and (2) well-regarded (primarily non-URM) emeriti/retired engineering faculty. A previously-funded NSF project found that this mentor-mentee pairing was viewed favorable by both parties and beneficial, particularly by the URM engineering faculty. Because of these results, the investigators proposed to scale, test, and evaluate the approach on a broader scale by creating national infrastructural network partners to help increase capacity to serve a greater number of URM engineering faculty and to introduce tele-mentoring and training models to serve URM faculty who work in remote geographical locations with very little access to mentors.
The project will use a multi-phased phenomenological, mixed method research design to gain greater understanding of the ways in which the URM faculty and emeriti faculty experience the opportunities afforded by the project. Further, the investigators plan to collect data to examine how project participants perceive and experience conventional, direct communications (e.g., telephone calls, e-mail, and in-person meetings)through the mentoring process versus the use of Embodied Conversational Agents (ECAs), anthropomorphic interface agents that engage a user in real-time dialogue by using verbal-nonverbal channels to emulate the in-person experience. This project has the potential to broaden participation in the engineering professoriate and opens up new possibilities for supporting URM engineering faculty.
DATE:
-
TEAM MEMBERS:
Comas HaynesValerie ConleySylvia MendezKinnis GoshaRosario Gerhardt
resourceprojectProfessional Development, Conferences, and Networks
This NSF INCUDES Design and Development Launch Pilot will increase the recruitment, retention, and matriculation of racial and ethnic minorities in STEM Ph.D. programs contributing to hazards and disaster research. Increasing STEM focused minorities on hazards mitigation, and disaster research areas will benefit society and contribute to the achievements of specific, desired societal outcomes following disasters. The Minority SURGE Capacity in Disasters (SURGE) launch pilot will provide the empirical research to identify substantial ways to increase the underrepresentation of minorities in STEM disciplines interested in hazards mitigation and disaster research. Increasing the involvement of qualified minorities will help solve the broader vulnerability concerns in these communities and help advance the body of knowledge through the diversity of thought and creative problem solving in scholarship and practice. Utilizing workshops and a multifaceted mentorship program SURGE creates a new model that addresses the diversity concerns in both STEM and disaster fields, and make American communities more resilient following natural disasters. This project will be of interest to policymakers, educators and the general public.
The Minority SURGE Capacity in Disasters (SURGE) NSF INCLUDES Design and Development Launch Pilot will enhance the social capital of racial and ethnic minority communities by increasing their networks, connections, and access to disaster management decision-making among members of their community from STEM fields. The four-fold goals of SURGE are to: (1) increase the number of minority graduate researchers in STEM fields with a disaster focus; (2) develop and guide well-trained, qualified disaster scholars from STEM fields; (3) provide academic and professional mentorship for next generation minority STEM scholars in hazards mitigation and disaster research; and (4) develop professional and research opportunities that involve outreach and problem solving for vulnerable communities in the U.S. The SURGE project is organized as a lead-organization network through the University of Nebraska at Omaha and includes community partners. As a pilot project, SURGE participation is limited to graduate students from research-intensive universities across the country. Each student will attend workshops and training programs developed by the project leads. SURGE investigators will conduct project evaluation and assessment of their workshops, training, and mentorship projects. Results from evaluations and assessments will be presented at STEM and disaster-related conferences and published in peer-reviewed academic journals.
DATE:
-
TEAM MEMBERS:
DeeDee BennettLori PeekTerri NortonHans Louis-Charles
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The Algebra Project, in partnership with the Young People's Project, will convene a conference on inclusion in science, technology, engineering and mathematics(STEM) higher education in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative. The conference will examine a critical question: What roles and structures are needed for a mini-backbone organization in order to scale a "bottom up" model of social change into an organized, full scale collective impact model? Additionally, the conference will develop participants' capacity to link action on the various design challenges, and backbone structures, to future actions that meet the needs of a potential Alliance on this Broadening Participation Challenge and others facing similar challenges.
Five pre-conference design teams will focus on key components to improve education of students from underrepresented and disadvantaged populations over a four-month period prior to the convening of the stakeholders in St. Louis, Missouri in 2017.
DATE:
-
TEAM MEMBERS:
Robert MosesBeverly Walker
resourceresearchMuseum and Science Center Programs
The National Autonomous University of Mexico (UNAM) is one of the world's single largest employers of science communicators, with over 350,000 students and 40,000 staff. Its science communication activities include five museums (Universum, Museo de la Luz, the Geology Museum, Museo de la Medicina Mexicana and Musem of Geophysics), botanical gardens, as well as a wide range of cultural and outreach activities. It has several programmes for training professional science communicators. The science communication staff are spread across the campuses in Mexico City and four other cities, including
DATE:
TEAM MEMBERS:
Ana Claudia NepoteElaine Reynoso-Haynes
resourceprojectProfessional Development, Conferences, and Networks
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.