As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Presentation slides from the session "Social Science Research Collaboration: Advance the field and your Organization" shared at the 2020 AZA Annual Conference (Virtual).
Computing fields are foundational to most STEM disciplines and the only STEM discipline to show a consistent decline in women's representation since 1990, making it an important field for STEM educators to study. The explanation for the underrepresentation of women and girls in computing is twofold: a sense that they do not fit within the stereotypes associated with computing and a lack of access to computer games and technologies beginning at an early age (Richard, 2016).
Informal coding education programs are uniquely situated to counter these hurdles because they can offer additional
Informal learning institutions, such as museums, science centers, and community-based organizations, play a critical role in providing opportunities for students to engage in science, technology, engineering, and mathematics (STEM) activities during out-of-school time hours. In recent years, thousands of studies, evaluations, and conference proceedings have been published measuring the impact that these programs have had on their participants. However, because studies of informal science education (ISE) programs vary considerably in how they are designed and in the quality of their designs, it
The nature of the learning that occurs with real versus replicated objects and environments is an important topic for museums and science centers. Our comparative, exploratory study addressed this area through an investigation of family visits to two different settings: an operating permafrost research tunnel, and a replica of this permafrost tunnel at a science center. We conducted and analyzed family interviews, grounding our work in the Contextual Model of Learning and ideas about sensory components of learning. We found significant differences between the real and replicated environments
Informal learning institutions (ILIs) create opportunities to increase public understanding of science and promote increased inclusion of groups underrepresented in Science, Technology, Engineering, and Math (STEM) careers but are not equally distributed across the United States. We explore geographic gaps in the ILI landscape and identify three groups of underserved counties based on the interaction between population density and poverty percentage. Among ILIs, National Park Service lands, biological field stations, and marine laboratories occur in areas with the fewest sites for informal
Science learning occurs throughout people's lives, inside and outside of school, in formal, informal, and nonformal settings. While museums have long played a role in science education, learning in this and other informal settings has not been studied nor understood as deeply as in formal settings (i.e., schools and classrooms). This position paper, written by learning researchers in a science museum engaged in equity and access work, notes that while the researchers consider the ethics of their work regularly and deeply, little formal guidance exists for the ethical challenges they routinely
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this pilot and feasibility study is to increase participation in informal STEM learning in rural Idaho through Stories of Fire, a program based on personal narratives of wildland fire. Idaho is a rural state, with an average population of just 19 people per square mile, the fourth lowest population density in the United States. The state is experiencing increasingly severe wildfire, and effective responses to such environmental change require a better understanding of the underlying science. Contextualizing science learning, making connections between everyday lives and a sense of place can engage learners and bring about a better understanding of wildfire. This project will bring together a science communicator, a narratologist, a fire ecologist, and a specialist on emotions and public lands. They will work collaboratively with informal educators based in rural areas of Idaho underrepresented in STEM fields. Rural areas are rich in knowledge based on years of cumulative observations, cultural beliefs, and practices shared through community networks. This project builds on these rural assets while addressing the challenges rural populations face. The project addresses broadening participation in STEM through narrative practices that encourage more diverse ways of knowing, being, and representing science.
This research study will explore: 1) what mechanisms of narrative (storytelling) most effectively integrate individuals? personal experiences and accurate STEM content in fire science communication, and 2) what audience-centered approaches best facilitate narrative approaches to informal STEM learning. This project engages four levels of participants over four phases of research and programming: 1) The research team will interview and analyze the narratives of 40 Frontliners (e.g., wildland firefighters and evacuees) from the inland Northwest region with first-hand experience with wildfire. 2) They will conduct a narrative workshop to train 20 informal STEM Educators from across the state on audience-centered approaches that facilitate participant storytelling about fire. 3) Educators will pilot their own narrative-based informal science learning programs with program participants in their rural home communities across the state, 4) A professional podcaster will create two podcasts modeled on our research findings for public audiences reached through media.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teresa CohnLeda KobziarJennifer LadinoErin James
Diversity in the STEM workforce is essential for expanding the talent pool and bringing new ideas to bear in solving societal problems, yet entrenched gaps remain. In STEM higher education, students from certain racial and ethnic groups continue to be underrepresented in STEM majors and fields. Colleges and universities have responded by offering precollege STEM programs to high school students from predominantly underrepresented groups. These programs have been shown to positively affect students' analytical and critical thinking skills, STEM content knowledge and exposure, and self-efficacy through STEM-focused enrichment and research experiences. In fact, salient research suggests that out-of-school-time, precollege STEM experiences are key influencers in students' pursuit of STEM majors and careers, and underscore the value of precollege STEM programs in their ability to prepare students in STEM. This NSF INCLUDES Alliance: STEM PUSH - Pathways for Underrepresented Students to Higher Education Network - will form a national network of precollege STEM programs to actualize their value through the creation, spread and scale of an equitable, evidence-based pathway for university admissions - precollege STEM program accreditation. Building on several successful NSF INCLUDES Design and Development Launch Pilots, this Alliance will use a networked improvement community approach to transform college admissions by establishing an accreditation process for precollege STEM programs in which standards-based credentials serve as indicators of program quality that are recognized by colleges and universities as rigorous and worthy of favorable consideration during undergraduate admissions processes. Given the high enrollment of students from underrepresented groups in precollege STEM programs, the Alliance endeavors to broaden participation in STEM by maximizing college access and STEM outcomes in higher education and beyond.
The STEM PUSH Network is a national alliance of precollege STEM programs, STEM and culturally responsive pedagogy experts, formal and informal education practitioners, college admissions professionals, the accreditation sector, and other higher education representatives. The Alliance will establish a formidable collaborative improvement space using the networked improvement community model and a "next generation" accreditation model that will serve as a mechanism for communicating the power of precollege programs to admissions offices. Framing this work is the notion that the accreditation of precollege STEM programs is an equitable supplemental admissions criterion to the current, often cited as a culturally biased, standardized test score-based system. To achieve its shared vision and goals, the Alliance has four key objectives: (1) establish and support a national precollege STEM program networked community, (2) develop a standards-based precollege STEM program accreditation system to broaden participation in STEM, (3) test and validate the model within the networked improvement community, and (4) spread, scale, and sustain the model through its backbone organization, the STEM Learning Ecosystem Community of Practice. Each objective will be closely monitored and evaluated by an external evaluator. In addition, the data infrastructure developed through this Alliance will provide an unprecedented opportunity to advance scholarship in the fields of networked improvement community design and development, the efficacy of STEM precollege programs, and effective practices for broadening participation pathways from high school to higher education. By the end of five years, the STEM PUSH Network will transform ten urban ecosystems across the country into communities where students from underrepresented groups have increased college access and therefore, entree to STEM opportunities and majors in higher education. The model has the potential to be replicated by another 80 STEM ecosystems that will have access to Alliance materials and strategies through the backbone organization.
This NSF INCLUDES Alliance is funded by NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES), a comprehensive national initiative to enhance U.S. leadership in discoveries and innovations by focusing on diversity, inclusion and broadening participation in STEM at scale. It is also co-funded by the NSF Innovative Technology Experiences for Students and Teachers program and the Advancing Informal STEM Learning Program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJan MorrisonJennifer IritiAlaine AllenDavid Boone
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This EAGER seeks to explore the state of research ethics in practice in science and, specifically, how ethics plays out in informal STEM institutions, through lenses of multiple cultural traditions and perspectives. By means of producing a documentary, Decolonizing Science, the project will engage scientists and informal STEM educators in considering how informal STEM institutions could re-envision their work to fundamentally embrace inclusivity and belonging. The exploratory process will challenge and inform informal STEM learning institutions and the scientists with whom they work to consider how to navigate contemporary social tensions, support research that values diverse perspectives, and promote decolonizing practices. A significant component of the project includes screenings, workshops, and difficult conversations, in conjunction with informal learning institutions that are already on the front lines of new language and knowledge creation. The project will be a collaborative process as participants' thoughts, views, and arguments will shape the project from the beginning. Once the film is made, collaboration will continue by engaging science-based practitioners at institutions that serve communities of color and that are invested in working towards greater diversity, inclusivity, equity, and access. Discussions related to the film's screenings will inform how informal learning institutions can radically re-imagine their work and their spaces, including teaching, curation, research, communication, and knowledge and literature production.
The film will explore the origins, creation, and evolution of Western science as an enterprise that can sublimate, marginalize and re-narrativize the practices, procedures, ethics, and contributions of the underrepresented people of color in science. Through focus groups, interviews, and facilitated discussions, this EAGER will document and share the interactions among scientists, informal STEM educators, and filmmakers as they explore how to practice more ethical science in communities of color, on their lands, and within their nations, as well as how science can be portrayed and enacted within informal STEM learning institutions. The project seek to challenge and shift both informal STEM learning institutions and the sciences, through a yet-untested, well-considered, and humane approach to ethical practices of science and their implementation in informal STEM learning institutions through a film and by envisioning possible futures.
This project is jointly funded by Directorate for Education and Human Resources/Advancing Informal STEM Learning Program, the Directorate for Social, Behavioral and Economic Sciences Ethical and Responsible Research program and the Directorate for Geosciences Education and Diversity program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.