We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
Few would argue that the national parks provide significant value to both the nation and the world. The question remains though, What is that value and how to measure it? Increasingly, a key indicator of this value is the learning that parks support. However, as we will discuss, even defining what is meant by educational value is challenging, let alone coming up with a park-specific set of metrics to measure this dimension of value of national parks.
Immersion in well-designed outdoor environments can foster the habits of mind that enable critical and authentic scientific questions to take root in students' minds. Here we share two design cases in which careful, collaborative, and intentional design of outdoor learning environments for informal inquiry provide people of all ages with embodied opportunities to learn about the natural world, developing the capacity for understanding ecology and the ability to empathize, problem-solve, and reflect. Embodied learning, as facilitated by and in well-designed outdoor learning environments, leads
DATE:
TEAM MEMBERS:
Katherine GillJocelyn GlazierBetsy Towns
This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07).
Appendix A: Installation Site Intercept Interview Instrument
Appendix B: Artists-Scientists Walk & Talks Instrument
Appendix C: Post-Performance Event Survey Instrument
Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS:
John FraserRebecca Joy NorlanderSophie SwansonNezam ArdalanKate FlinnerJoanna Laursen BruckerNicole LaMarca
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.